Data Engineering Field NotesTechnical notes on Microsoft Fabric, Apache Spark and Delta Lake, drawn from my experience working with customers. A closer look at data platform design, performance tuning and practical engineering decisions.https://jdocampo.github.io/Measure Fabric CU usage with Capacity Operation Eventshttps://jdocampo.github.io/fabric-blog/blog/monitor-cu-usage-capacity-operation-events/https://jdocampo.github.io/fabric-blog/blog/monitor-cu-usage-capacity-operation-events/Capture Fabric capacity events and use reusable KQL to measure notebook, Custom Live Pool, and pipeline CU consumption.Thu, 08 Oct 2026 00:00:00 GMTRefresh Materialized Lake Views with OneLake events: match the Delta commit, not the file noisehttps://jdocampo.github.io/fabric-blog/blog/onelake-triggered-mlv-refresh/https://jdocampo.github.io/fabric-blog/blog/onelake-triggered-mlv-refresh/Configure event-triggered MLV refresh in Microsoft Fabric with a UI walkthrough and OneLake event filters that match published Delta commits.Wed, 07 Oct 2026 00:00:00 GMTDeploy, configure, and monitor Custom Live Pools with REST APIshttps://jdocampo.github.io/fabric-blog/blog/manage-custom-live-pools-through-apis/https://jdocampo.github.io/fabric-blog/blog/manage-custom-live-pools-through-apis/A REST API how-to for deploying, configuring, scheduling, and monitoring Microsoft Fabric Custom Live Pools.Tue, 06 Oct 2026 00:00:00 GMTFaster or cheaper? Choosing Custom Live Pools and High Concurrency for Microsoft Fabric medallion ETL pipelineshttps://jdocampo.github.io/fabric-blog/blog/custom-live-pools-high-concurrency-medallion/https://jdocampo.github.io/fabric-blog/blog/custom-live-pools-high-concurrency-medallion/Performance and CU trade-offs across Starter Pools, Custom Live Pools, and High Concurrency for a Bronze-Silver-Gold pipeline.Mon, 05 Oct 2026 00:00:00 GMT