Blog tag

#data consistency

3 posts tagged with data consistency.

← Back to all posts
4 min read

How We Scaled a Distributed Crawler with Atomic Redis State Management

How atomic Redis operations fixed state corruption during worker shutdowns in our distributed Vultr Crawler.

redisdistributed-systemsweb-crawlerpythondata-consistency
Read more
4 min read

Migrating Job State Management from Redis to Postgres: Why We Centralized Crawler Jobs in a Single Source of Truth

We moved job claiming in the Vultr Crawler from Redis to Postgres for better consistency, auditability, and operational simplicity.

distributed systemsPostgresRedisjob queuescrawler architecturedata consistency
Read more
4 min read

Fixing Data Order Bugs in AI Pipelines: A Debugging Story from Lockline AI

How a subtle data ordering bug in Lockline AI's pipeline threatened lead prioritization—and how I tracked it down.

debuggingAI pipelinesdata consistencybackend engineeringTypeScript
Read more