#MicrosoftFabric CI/CD and #DataOps is easier than it looks—once you stop trying to make pipelines do collaboration. The “ideal” pattern is a handoff: Git integration for change, Deployment Pipelines for promotion, and traditional #CICD for #governance.
Posts by Jason Miles
If your Fabric notebooks keep breaking when you copy them to a new workspace, it’s probably not your Spark—it’s your glue code. Here are the underused NotebookUtils functions that make notebooks modular, portable, and production-friendly. #MicrosoftFabric #DataEngineering #OneLake
Stop granting lakehouse permissions just so people can read a report.
This fixed-identity DirectLake pattern cleanly separates semantic model consumption from OneLake access—and it’s one of the most practical #DataGovernance moves you can make in #MicrosoftFabric today. #DirectLake #PowerBI
“#WorkspaceSprawl” in #MSFabric is mostly a myth. The real risk is stale workspaces: unclear ownership, lingering access, and old data that never dies. If your #Governance model still scales linearly with workspaces, it’s time to shift, so you can take advantage of the power of #workspaces.
Environments are a game-changer for repeatable Spark work—until Private Link forces you to rethink how you ship libraries. If you’re adopting Runtime 2.0 or Azure Artifact Feeds in preview, make sure your network security posture isn’t quietly taking options away. #MicrosoftFabric #DataEngineering
Cross-workspace #OneLake #Shortcuts are one of the best architectural patterns in #MSFabric—until your #SemanticModel hits a 403 and nobody’s sure why. The fix isn’t “make them a workspace member.” It's to really understand the permissioning structures.
#MSFabric storage got expensive? You’re not alone. The fix usually isn’t “delete data”—it’s separating #Archives from analytics storage. In this deep dive, I walk through how to use ADLS Gen2 + #OneLake shortcuts + trusted workspace access to cut storage bloat while keeping Fabric workflows intact.
Your lakehouse doesn’t need more dashboards that claim the data is clean. It needs quality rules that run where your data is built—and signals that tell you when quality drifts. Use #MaterializedLakeViews to add declarative #DataQuality constraints to #MSFabric's lineage, with #PowerBI reports!
A “workspace per data product” sounds clean—until you have 60 #DataProducts. This advanced lakehouse pattern uses shortcuts + #MaterializedLakeViews + versioned schemas to deliver left-shifted data products with #OneLakeSecurity, while keeping the perception of #MSFabric sprawl under control.
#DataSnapshots don’t have to doom you to heavy MERGEs or unbounded refreshes. This #MSFabric #MLV “freeze-and-squash” pattern turns periodic snapshots into a bounded, reusable change feed that can drive both Type 2 dimensions and #DataVault artifacts —without abandoning an MLV-forward architecture.
Want your #MSFabric #MaterializedLakeView deployments to stop being “it worked in dev” stories? Treat your #Lakehouse like code: one SQL-only configuration notebook, promoted through your pipeline, idempotent in every environment—with CDF set intentionally in the final cell.
#Bitemporal isn’t extra history—it’s operational clarity: what was true, and what did we know, at the time. Here’s why #MSFabric Lakehouse on Delta is a powerful bitemporal implementation, plus how materialized lake views can own interval closure and when #AzureSQL belongs in the mix. #MSFabric
DirectLake on OneLake is the semantic layer many Fabric teams want—but CI/CD is still catching up. Here’s a practical two-step deployment pattern using Sempy Labs + Variable Libraries to rebind DirectLake models automatically after promotion. #MicrosoftFabric #PowerBI #DirectLake #CICD
#DirectLake isn’t “one mode,”it’s two. If your #MSFabric #PowerBI semantic model is slow, failing security tests, or behaving inconsistently, there’s a good chance you’re running the wrong DirectLake flavor (or falling back without realizing it).
Your #fraud and #AML signals are hiding in plain sight,inside the relationships your tables don’t model well. This post shows how #Graph in #MicrosoftFabric turns #OneLake data into a network you can query and explore visually—so investigations and insights start from connections, not joins.
Stop treating #SchemaEvolution as an engineering failure. In a modern #MicrosoftFabric #Lakehouse, it’s an interface management problem: Bronze absorbs change, Silver optionally augments it, and Gold publishes the #DataProduct contract—governed, versioned, and consumable. #DataGovernance
Power BI Copilot isn’t one tool—it’s a set of modes. Once you understand where each mode shines (and where Fabric Data Agents fit), you can design an AI analytics experience users actually trust—and actually use. #PowerBI #MicrosoftFabric #Copilot #DataGovernance
Still #Deploying #MicrosoftFabric changes by “click and pray”? A disciplined mix of #Git, #VariableLibraries, #DeploymentRules, and #DeploymentPipelines turns #Eeleases into something you can repeat—and trust.
Stop trying to force fact tables into a single “domain.” The highest-value data usually lives at the intersections—and that’s exactly where #DomainDriven #DataEngineering gets messy.
A #DataProduct model makes intersection facts easier to own, to govern, and to consume. #MicrosoftFabric
Materialize responsibly. #MicrosoftFabric’s Warehouse can land files in seconds—and now #MaterializedLakeViews add optimal refresh (incremental/full/skip) with #DataQuality and #Lineage. Here’s how to stay true to zero unmanaged copy with #OneLakeSecurity and Outbound Access Protection in the loop.
“Real‑time” isn’t a toggle—it’s a tax. This update breaks down the complexity and cost curve from trickle‑scale to internet‑class, plus what Ignite 2025 signals about mirroring, CDC, and integrated streaming stacks. #RealTimeAnalytics #StreamingData #DataPlatforms #CostOptimization
#2025 was the year Microsoft stopped treating “data + AI + governance” as three separate initiatives. #MicrosoftFabric expanded into a true AI-era data estate (databases, OneLake interoperability, #FabricIQ, and agents), while #MicrosoftPurview pulled governance and security into the workflow.
Stop rebuilding #SemanticModels just to rename 100 columns or repoint to a new Lakehouse.
This walkthrough shows a clean PBIP + TMDL folder workflow for #MicrosoftFabric semantic models—including how to retarget the entire model (or a single table) to a different Lakehouse. #PowerBI #DataModeling
Cloud migrations in Financial Services, Insurance, Wealth, and Professional Services often recreate the same old warehouse dynamics—just with better infrastructure. This post applies the SAMR lens to data platforms and shows how data products + design thinking help you move from “inventory” to…
Trust debt hides in the “should‑do” list. See how policy‑aware digital workers plug into existing systems, finish the work that never makes the sprint, and hand back proof—updated for T+1, methane program shifts, BOI changes, and evolving data‑sharing rules. #Automation #WealthManagement #OilAndGas…
From Chunks to Queries—Ignite 2025 Update: Fabric Data Agents, RAG, and the New IQ Layer
Monday, 9:02 a.m. The CFO pings: “What was Q3 gross margin by region—and did audit call out any risks?” Your RAG bot shines on PDFs and wiki pages, but it can’t compute a number you’d put on a KPI card. After…
Microsoft Fabric makes medallion a first‑class citizen – but your data products don’t have to be medallion‑shaped. In a managed, domain‑driven world, inputs and outputs matter more than internal layers. This post shows how to treat medallion as a powerful option, not a mandate, with simple examples…
Your backlog tells you what to build. Your spec should tell you when it’s good enough to ship. Here’s how to make a three‑file spec drive code, tests, and SLOs—without slowing your team. #SpecDrivenDevelopment #Agile #DevOps #APIs
Most “modern” workflows are just yesterday’s paper forms, rebuilt in browsers and automated with bots—sometimes still obeying the preferences of someone who retired fifty years ago. AI gives us a chance to stop automating those ghosts and start designing goal‑based processes that focus on outcomes.
Shipped the feature and still missed the mark? The fix is in your requirements. Here’s a practical way to make nonfunctional requirements measurable and make them stick in agile—without ceremony. #Agile #DevOps #RequirementsEngineering #ProductManagement