Dataset Cleanup Manager Job Failure.
· 2 min read
Dataset Cleanup Manager Job Failure
Affected Versions: 2.6
Fix Version: 2.6.1
Root cause(s)
As part of the code refactoring, we replaced all instances of utcnow() with now(). In the Dataset Cleanup Manager Lambda, we were using datetime.now(timezone.utc), which returns an offset-aware datetime, but the code was expecting an offset-naive datetime.
Impact
After upgrading to 2.6, Dataset Cleanup Manager Job will fail with error - can't subtract offset-naive and offset-aware datetimes
if there are datasets with 'Dataset Cleanup Enabled'(IsDataCleanupEnabled) and the dataset contains temporarily deleted files.
Mitigation
Fix available
Fix is available in Amorphic version 2.6.1. Please upgrade to the latest version to resolve this issue.
Timeline
gantt
title Timeline
dateFormat YYYY-MM-DD
tickInterval 7day
axisFormat %b-%d
todayMarker off
section Tracker
%% update the ticket number and date of bug report
CLOUD-5030 : done, 2024-07-25, 0d
section Identification
Reported : crit, des1, 2024-07-25, 0d
section Mitigation
%% Update number of days took for each step below
Bug Fixed: crit, done, 2024-07-25, 1d
section Delivery
%% update the date of each step below
testing complete: milestone, 2024-07-25, 0d
- 2024-07-25: Bug reported/identified (CLOUD-5030)
- 2024-07-25: Bug triaged
- 2024-07-25: Bug fixed
- 2024-07-25: Testing of fix is completed
- 2024-08-01: Amorphic version 2.6.1 released with the bugfix