Small Threadhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/A slow blog about data engineering and the craft of shipping software.en Partitioning Strategies I Wish I'd Known Earlierhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/partitioning-strategies-i-wish-i-d-known-earlier.htmlhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/partitioning-strategies-i-wish-i-d-known-earlier.htmlSun, 19 Jul 2026 09:00:00 +0000I've been working with dbt for about 3 years now, and my opinions on partitioning have changed more than I expected. Backfills Are a Product Featurehttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/backfills-are-a-product-feature.htmlhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/backfills-are-a-product-feature.htmlMon, 08 Jun 2026 09:00:00 +0000I've been working with Python for about 8 years now, and my opinions on backfills have changed more than I expected. Data Contracts Without the Hypehttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/data-contracts-without-the-hype.htmlhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/data-contracts-without-the-hype.htmlThu, 30 Apr 2026 09:00:00 +0000For a long time I treated data contracts as something to worry about later. Then a small change to our Airflow setup turned into a week of debugging, and "later" arrived all at once. Testing Pipelines Like Application Codehttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/testing-pipelines-like-application-code.htmlhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/testing-pipelines-like-application-code.htmlThu, 12 Feb 2026 09:00:00 +0000There is no shortage of articles about DuckDB. Most of them cover the happy path. This one is about what happened after the happy path ended. Small Data Is Underratedhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/small-data-is-underrated.htmlhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/small-data-is-underrated.htmlWed, 31 Dec 2025 09:00:00 +0000There is no shortage of articles about Python. Most of them cover the happy path. This one is about what happened after the happy path ended. Polars vs. pandas for Everyday Workhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/polars-vs-pandas-for-everyday-work.htmlhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/polars-vs-pandas-for-everyday-work.htmlThu, 18 Dec 2025 09:00:00 +0000Every codebase has one area everyone is a little afraid to touch. On our team, it was everything related to slowly changing dimensions. The Metric Everyone Defined Differentlyhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/the-metric-everyone-defined-differently.htmlhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/the-metric-everyone-defined-differently.htmlMon, 04 Aug 2025 09:00:00 +0000There is no shortage of articles about DuckDB. Most of them cover the happy path. This one is about what happened after the happy path ended. DuckDB Replaced Half of Our Data Stackhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/duckdb-replaced-half-of-our-data-stack.htmlhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/duckdb-replaced-half-of-our-data-stack.htmlTue, 22 Jul 2025 09:00:00 +0000I've been working with DuckDB for about 9 years now, and my opinions on data quality checks have changed more than I expected. Incremental Models That Don't Lie to Youhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/incremental-models-that-don-t-lie-to-you.htmlhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/incremental-models-that-don-t-lie-to-you.htmlFri, 20 Jun 2025 09:00:00 +0000This post started as a note to my future self. Every few months I relearn the same lessons about incremental models, so this time I'm writing them down. Dealing With Late-Arriving Datahttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/dealing-with-late-arriving-data.htmlhttps://hk100mqianzhi.jp2haozu-naookg-okak.cc/posts/dealing-with-late-arriving-data.htmlWed, 07 May 2025 09:00:00 +0000There is no shortage of articles about Snowflake. Most of them cover the happy path. This one is about what happened after the happy path ended.