Data Engineering Field Notes

FILTER · data-engineering

4 entries

  1. v0004

    Measure Fabric CU usage with Capacity Operation Events

    Capture Fabric capacity events and use reusable KQL to measure notebook, Custom Live Pool, and pipeline CU consumption.

    fabric spark monitoring data-engineering
  2. v0003

    Refresh Materialized Lake Views with OneLake events: match the Delta commit, not the file noise

    Configure event-triggered MLV refresh in Microsoft Fabric with a UI walkthrough and OneLake event filters that match published Delta commits.

    fabric onelake data-engineering materialized-lake-views
  3. v0002

    Deploy, configure, and monitor Custom Live Pools with REST APIs

    A REST API how-to for deploying, configuring, scheduling, and monitoring Microsoft Fabric Custom Live Pools.

    fabric spark data-engineering rest-api
  4. v0001

    Faster or cheaper? Choosing Custom Live Pools and High Concurrency for Microsoft Fabric medallion ETL pipelines

    Performance and CU trade-offs across Starter Pools, Custom Live Pools, and High Concurrency for a Bronze-Silver-Gold pipeline.

    fabric spark data-engineering performance