๐ New Lab Replay: Using Delta Tables in Apache Spark (Microsoft Fabric)
๐ฅ Watch the full session:
๐ www.youtube.com/live/gT21FS8...
#MicrosoftFabric #DeltaTables #ApacheSpark #DeltaLake #DP600 #DP700 #Lakehouse #DataEngineering #BigData #ACID #TimeTravel #SparkSQL #PySpark #MicrosoftLearn
What languages can be used in Fabric Notebooks?
Microsoft Fabric Notebooks support:
๐น PySpark
๐น Spark (Scala)
๐น SparkSQL
๐น SparkR (R)
๐น HTML
#MicrosoftFabric #FabricNotebooks #PySpark #SparkSQL #SparkR #Scala #BigData #DataEngineering #DataScience #OneLake #FabricCommunity #DataPlatform #DP700
๐ง Python & Spark SQL Transforms
Use Python for custom logic or Spark SQL for distributed processing. Mix both for maximum control.
Build fast. Iterate faster.
#PythonETL #SparkSQL #DataTransformation #DataPipelines #ETL #OpenSource #OpenETL #DataOmni #BigData #FlexibleEngineering #BuildInPublic
Top 8 Data Visualization Libraries
#Python
#PySpark #SQL #BigData #Databricks #BusinessIntelligence #DataEngineering #PowerBI #DataAnalytics #SparkSQL #XavierDataTech
๐ Working with PySpark SQL? Here's a quick and powerful example!
You can query DataFrames using SQL syntax in Spark โ great for teams coming from SQL backgrounds.
#PySpark #BigData #SparkSQL #DataEngineering #ETL #ApacheSpark #SQL #DataScience #XavierDataTech
Just wait until they found that scalable, powerful native #SQL engines in #RDBMS that scale better and use CPU much more efficient, than #SparkSQL. 5-10 years down the line their code will run on #Oracle, #Snowflake or the likes.
Weโll be at the #Databricks Data + AI Summit in SF next week (6/9โ12).
If youโre around and want to chat about how incremental computing can make your #SparkSQL workloads go from hours to seconds โ letโs connect.
Grab some time here: calendly.com/matt-feldera...
#DataAISummit #DataEngineering
#SparkSQL has been sent to try my patience. Just bloody work and stop complaining!