I've just published a reference framework covering the full stack: capacities, domains, workspaces, folders, items, schemas, and tables. The opinionated patterns I'd use, and the reasoning behind each one.
Posts by Nikola Ilic
NEW BLOG POST!
A naming framework is the cheapest piece of architecture you'll ever set up in #MicrosoftFabric.
It's also the most expensive one to retrofit.
data-mozart.com/the-name-gam...
Just SQL this time:)
Now, with Materialized Lake Views going GA, I decided to rebuild the same flow using MLVs. Some findings will definitely surprise you! Stay tuned, the video is coming soon:)
What do you say about Claude's work? I like the style!
I recently delivered my "Chief Data Alchemist - Crafting Medallion the right way!" session at SQL Saturday Atlanta, where I used publicly available NBA data to showcase how data flows from raw JSON to fine, gold aggregated tables. I was using notebooks for all the transformations
I asked Claude Opus 4.7 to create a thumbnail for my upcoming YouTube video (btw, it's a small teaser of what to expect soonš).
4ļøā£ The 5 changes that moved MLVs from preview to production-ready at FabCon Atlanta
5ļøā£ When MLVs shine and when to reach for notebooks instead
6ļøā£ The fine print: limitations you should know before committing
#MicrosoftFabric #DataEngineering #Lakehouse
I spent the last few days writing a full deep dive on them, covering:
1ļøā£ What MLVs actually are (and what they replace)
2ļøā£ The Spark SQL syntax + the new PySpark @fmlv decorator API
3ļøā£ How optimal refresh decides between skip, incremental, and full
NEW SUBSTACK ARTICLE!
If you ever tried to debug a silver layer that didn't update because a notebook failed 3h ago, you know why materialized lake views matter.
The promise is simple: what if your entire medallion pipeline could be a few SELECT statements?
datamozart.substack.com/p/materializ...
In need of a thorough and accessible primer on data modeling? @datamozart.bsky.social presents a one-stop resource for analytics engineers.
NEW VIDEO ALERT!
The honest Warehouse vs. Lakehouse comparison for your #MicrosoftFabric Silver layer, based on real client engagements, not vendor marketing. Three questions that actually decide it, plus where Materialized Lake Views change the picture.
youtu.be/QfBU0FYWOmU
You'll walk out with code you wrote, patterns you understand because you built them, and answers to the questions your slide-only workshops never let you ask.
Grab your early-bird ticket today: sharepointeurope26894.ac-page.com/fabcon-sqlco...
What you'll do instead: build a complete Microsoft Fabric solution end-to-end, with your hands on the keyboard the entire day. Real ingestion patterns. Real transformations. Real trade-offs you'll face on Monday morning back at work.
My full-day tutorial at FabCon Europe Barcelona is the opposite of that.
This is not another "what is a lakehouse" session. You already know what a lakehouse is.
I've created this workshop because I was bothered:). Here's what bothers me about most data engineering workshops:
You show up excited, spend the day watching slides, nod along to concepts you already half-knew, and leave with a bunch of papers full of diagrams you'll never open again.
Ok, the cat is out of the box - full-day tutorials for #FabCon Europe in Barcelona have been announced, and I can't be more excited to join the amazing speaker line-up! I'll be teaching how to build a production-ready lakehouse in #MicrosoftFabric.
All ready and set for my #MicrosoftFabric Data Engineer Bootcamp (DP-700) live training at @oreilly.bsky.social!
Skills measured for the exam will be updated next Monday, but you are already covered, as the Bootcamp includes the fresh curriculum and all the topics.
See you soon!
NEW SUBSTACK ARTICLE!
Youāve probably spent last year hearing about Lakehouses and Warehouses until your ears are ringing. If a Lakehouse is a massive library and a Warehouse is a high-end bank vault, the Eventhouse is a 24-hour Air Traffic Control Tower.
datamozart.substack.com/p/the-new-ho...
Are you preparing to take the DP-700 (Fabric Data Engineer) exam soon?
Next Monday and Tuesday, I'll be running the popular Fabric Data Engineer (DP-700) Bootcamp at @oreilly.bsky.social, where we cover each and every topic tested in the exam.
Book your spot: learning.oreilly.com/live-events/...
NEW BLOG POST!
Everyone keeps asking me the same question: What now for #PowerBI?
With #MicrosoftFabric reshaping its identity and AI-generated dashboards challenging its visual layer, the answer isn't as comfortable as it used to be.
data-mozart.com/what-now-for...
NEW BLOG POST!
"Should we process our data in batches or in real-time?
It's not batch vs. stream: it's "when does the answer matter?"
I decided to put down my own thoughts on both approaches and how they can be unified using #MicrosoftFabric capabilities.
data-mozart.com/batch-or-str...
If you want to learn how to build a unified, automated and conversationally driven data platform, join me this Friday at @oreilly.bsky.social for the live course on Architecting intelligence with #MicrosoftFabric Copilot, data agents, Fabric IQ and MCP servers.
learning.oreilly.com/live-events/...
NEW BLOG POST!
While waiting at Atlanta airport for my flight back from #FabCon, I thought: why not finish the blog post I've been working on for last couple of daysš
And, there it is:it's all about the update policies in #RealTimeIntelligence in #MicrosoftFabric.
data-mozart.com/the-unsung-h...
Feedback is in for @powerbidude.bsky.social and my yesterday session at #FabCon Atlanta, and it looks like we did a decent job (or at least 68 attendees who provided feedback agree with that)š
Thank you, everyone, for spending your time to provide valuable feedback, very much appreciated.
Getting ready for Day 2 of #FabCon Atlanta and just learned that my tomorrow's session "The ultimate No ETL Showdown: shortcuts vs. mirroring vs. copy job" is fully booked!
We did it! @powerbidude.bsky.social and I took 400+ people on transformative journey from data analyst to data engineer, by transitioning from Dataflows Gen2 to notebooks.
Many great questions and interaction with the audience - thank you everyone for joining!
I have something for you:)
Making final polishing to a notebook for our demo-heavy session, Transitioning from Dataflows Gen2 to Notebooks, that Thomas LeBlanc and I are doing at #FabCon Atlanta.
We won't talk much - we'd rather show you practical examples that you may take home with you and start applying immediately.
Finally made my way to #FabCon Atlanta!
Looking forward to the full week of learning, networking, and hanging around with like-minded people.