Blog tag

#task queues

2 posts tagged with task queues.

← Back to all posts
4 min read

Building a Resilient Task Requeue Mechanism in GhostGraph: Recovering Orphaned Pipeline Jobs

How we built a requeue endpoint in GhostGraph to revive stalled Redis Stream jobs and maintain pipeline integrity.

Redis Streamstask queuespipeline resilienceGhostGraphdistributed systems
Read more
4 min read

Replacing ARQ with a Unified Redis Streams Worker: Why We Simplified Our Distributed Task System

We replaced ARQ with a lightweight Redis Streams polling worker—cutting 6k+ lines and improving reliability across our scraping fleet.

pythonredisdistributed systemstask queuesarchitecture
Read more