Skip to main content
print this page

Data metric collector job is failing for custom proxy customers.

· 2 min read
Fix Available
Fix Available
This bug has been fixed

Scheduled backend job data metric collection is failing with error 'some pip modules could not be installed'.

Affected Versions: 2.6, 2.6.1

Fix Version: 2.7

Root cause(s)​

Sqlpares module import is failed in the data resource metric job for the customers using a custom proxy. Enhancement of adding SQL query based data ingestion in version 2.6 resulted in this error. Sqlparse package is added as --additional-python-modules in glue job arguments. Glue job will try to download the package from internet(pypi domain) and customers with custom proxy may not whitelist this domain. Since the custom proxy is blocking this domain, the data metric collector job will fail while running the glue script.

Impact​

The data metric collector job will fail for customers with custom proxy enabled who doesn't whitelisted the domain https://pypi.org/

Mitigation​

Fix available

Fix will be available in Amorphic version 2.7.

Timeline​

gantt
    title Timeline
    dateFormat YYYY-MM-DD
    tickInterval 7day
    axisFormat %b-%d
    todayMarker off
    section Tracker
        %% update the ticket number and date of bug report
        CLOUD-4903 : done, 2024-08-21, 0d
    section Identification
        Reported : crit, des1, 2024-08-22, 1d
    section Mitigation
        %% Update number of days took for each step below
        Bug fixed: milestone, 2024-08-23, 1d
    section Delivery
        %% update the date of each step below
        testing complete: milestone, 2024-09-27, 0d
        fix available: milestone, 2024-10-14, 0d
  • 2024-08-21: Bug reported/identified (CLOUD-4903)
  • 2024-08-22: Bug triaged
  • 2024-08-23: Bug fixed
  • 2024-09-27: Testing of fix is completed
  • 2024-10-14: Amorphic version 2.7 released with the bugfix