We’ve noticed a spike in RefineAndRender workflows stuck in Running state on Temporal: 🧱 Root Cause: Bottlenecks were found in: • clip-tin-refine • clip-fp-render-service These services run on Spot-backed MIGs, which sometimes fail to scale due to limited spot availability. ✅ Fix: When this happens, manually scale the fallback standard MIGs: • clip-fp-render-service-standard • clip-tin-refine-standard (if available)
Resolved
Major outage
Started 6 days agoLasted about 2 hours
Affected
Video Clipping Service
Operational from 3:30 PM to 5:32 PM
Updates
- ResolvedResolved
- InvestigatingInvestigating