{"generated_at":"2026-11-12T18:49:10.315Z","source":{"name":"Hacker News public API","url":"https://github.com/HackerNews/API","attribution":"Stories and comments are public Hacker News submissions by their respective authors. HackerHub is an independent reader, not affiliated with Y Combinator.","content_is_untrusted":true},"story":{"id":50468977,"type":"story","title":"Show HN: Bringing Pulumi's 20x faster journaling to DIY back ends","url":"https://github.com/ebrake/pulumi-journaling","hn_url":"https://news.ycombinator.com/item?id=50468977","hackerhub_url":"https://hackerhub.site/stories/50468977","author":"unconscionable","points":2,"comments_count":0,"created_at":"2026-11-12T15:27:50.000Z","average_comments_per_hour":0,"heat":null,"text":"Hey HN! I created a fork of pulumi to explore how we can bring Pulumi's state-journaling architecture to DIY and self-hosted state backends. It's available at https://github.com/ebrake/pulumi-journaling\nBackground: Pulumi recently detailed their journaling architecture (https://www.pulumi.com/blog/journaling/), which changes how state snapshots are synced. Instead of uploading a massive full state snapshot on every operation (which gets sluggish for large stacks), it streams incremental state operations in parallel, achieving up to 20x speedups.\nJournaling optimization has historically been tied to Pulumi Cloud. This repo brings similar state journaling and crash-recovery mechanics (like tracking epoch manifests) that works for file/S3/DIY backends.\nI measured these timings against standard OSS pulumi using a GCS rapid bucket (https://docs.cloud.google.com/storage/docs/rapid/rapid-bucke...) which has low latency and is inexpensive given the amount of storage usage with a state bucket. Speedups become more effective the more resources you have.\n\n Resources | Updated | Without journaling | With journaling | Speedup\n\n ----------+---------+--------------------+-----------------+--------\n\n 24 | 15 | 19.66 | 1.69 | 11.6x\n\n 91 | 50 | 71.36 | 2.12 | 33.7x\n\n 152 | 50 | 70.97 | 1.91 | 37.1x\n\nWould love feedback from anyone else working on IaC state management, concurrency, or crash recovery patterns!"},"heat_definition":"Average comments per hour since posting, using a minimum age of 30 minutes. A single story has no relative colour rank."}