Blog tag

#data-consistency

3 posts tagged with data-consistency.

← Back to all posts
4 min read

How I Scaled a Distributed Crawler with Atomic Redis State Management

How atomic Redis operations fixed state corruption during worker shutdowns in my distributed Vultr Crawler.

redisdistributed-systemsweb-crawlerpythondata-consistency
Read more
4 min read

Migrating Job State Management from Redis to Postgres: Why I Centralized Crawler Jobs in a Single Source of Truth

I moved job claiming in the Vultr Crawler from Redis to Postgres for better consistency, auditability, and operational simplicity.

distributed systemsPostgresRedisjob queuescrawler architecturedata consistency
Read more
4 min read

Fixing Data Order Bugs in AI Pipelines: A Debugging Story from Lockline AI

How a subtle data ordering bug in Lockline AI's pipeline threatened lead prioritization—and how I tracked it down.

debuggingAI pipelinesdata consistencybackend engineeringTypeScript
Read more