AWS Jobs Stuck in Processing

Incident Report for JupiterOne

Resolved

This incident has been resolved.
Posted Mar 28, 2025 - 09:40 EDT

Update

Impact: Some AWS integrations experienced issues causing inconsistent updates.
Update: We have deployed fixes, and the system has been restoring. We are now in the final stages of monitoring to ensure full stability and proper functionality.
Next Steps: If no further issues arise, we will mark this incident as resolved soon.

Thank you for your patience.
Posted Mar 27, 2025 - 23:25 EDT

Update

We are continuing to monitor for any further issues.
Posted Mar 27, 2025 - 21:04 EDT

Update

Impact: Some AWS jobs experienced processing issues, leading to delays.
Update: We have deployed a fix and are currently monitoring the system to ensure stability and normal job execution.
Next Steps: We will continue to observe system performance and provide updates as needed.

Thank you for your patience.
Posted Mar 27, 2025 - 18:40 EDT

Update

We are continuing to monitor for any further issues.
Posted Mar 27, 2025 - 15:18 EDT

Update

We are continuing to monitor for any further issues.
Posted Mar 27, 2025 - 13:48 EDT

Update

A fix has been implemented and we are monitoring the results.
Posted Mar 27, 2025 - 13:48 EDT

Monitoring

Impact: Some AWS jobs experienced processing issues, leading to delays.
Update: We have deployed a fix and are currently monitoring the system to ensure stability and normal job execution.
Next Steps: We will continue to observe system performance and provide updates as needed.

Thank you for your patience.
Posted Mar 27, 2025 - 13:43 EDT

Update

Impact: Some AWS jobs experienced processing issues, leading to delays.
Update: The team has implemented a change and is currently evaluating solutions while monitoring job execution.
Next Steps: We will continue to assess system performance and provide updates as needed.

Thank you for your patience.
Posted Mar 27, 2025 - 12:27 EDT

Update

Impact: Some AWS jobs experienced processing issues, leading to delays.
Update: The team has implemented a change and is currently evaluating solutions while monitoring job execution.
Next Steps: We will continue to assess system performance and provide updates as needed.

Thank you for your patience.
Posted Mar 27, 2025 - 11:04 EDT

Identified

Impact: AWS jobs were getting stuck and not completing as expected, causing processing delays.
Root Cause: We believe this issue is related to an error, likely introduced by the new base image for integrations that was pushed yesterday.
Current Action: Our team is working on verifying the issue and testing a rollback to a stable Node.js version. We are also monitoring system performance to confirm resolution.
Next Update: We will provide further updates once the fix is applied and job processing is fully restored.

Please reach out if you have any questions or need further assistance.
Posted Mar 27, 2025 - 09:39 EDT

Investigating

Impact: AWS jobs are getting stuck and not completing as expected. This may cause delays in processing.
Current Action: Our team is actively investigating the root cause and working to restore normal operation. We are engaging with AWS support to diagnose potential underlying issues.
Next Update: We will provide further updates as soon as we have more information or a resolution.

Please reach out if you have any immediate concerns.
Posted Mar 27, 2025 - 08:52 EDT
This incident affected: Integrations (AWS).