In private development
Planned, with no date. Nothing on this page is released; the Fabric connector is built and tested only against simulated Fabric services and has not run on a real account.
Microsoft Fabric
Emolysis for Microsoft Fabric.
Microsoft Fabric comes after Databricks. On Fabric, Emolysis writes pipelines for lakehouses in OneLake and deploys them as notebooks in your Fabric workspace.
Planned
Connect
Microsoft Entra ID
Sample
Lakehouse tables through Spark
Prove
Golden tests on DuckDB
Deploy
A PySpark notebook
Overview
What it does on Microsoft Fabric.
Microsoft Fabric comes after Databricks, and there is no date yet. The profile below is drafted; the connector is built and tested only against simulated Fabric services and has not run on a real account.
Fabric mixes languages by item: Spark SQL and PySpark in lakehouses, T-SQL in warehouses and KQL for real-time data. The Fabric profile records which one each item uses, so the agent writes Spark SQL for a lakehouse notebook and T-SQL for a warehouse.
Templates for the ten pipeline shapes are written for Fabric, tested on DuckDB on your machine, and deployed as notebooks in your workspace. They run on your capacity, under your account.
If you run Fabric, the local parts work the same way: golden tests on DuckDB do not need a platform. Fabric support is announced on the news page, with the shapes whose templates pass their tests there.
Platform profile
What the profile captures.
Drafted, not yet checked on a real workspace: what Emolysis loads when you connect a Fabric workspace, so the agent writes code the way Fabric expects.
- Dialects
- Spark SQL and PySpark in lakehouses, T-SQL in warehouses, and KQL for real-time data
- Table format
- Delta tables in OneLake
- Merge idiom
- MERGE on lakehouse Delta tables
- Incremental tools
- Notebooks on a pipeline schedule, and Dataflow Gen2
- Deployment unit
- A PySpark notebook in your workspace, created or updated through the Fabric REST API
- Compute
- Spark job definitions and sessions, and the SQL analytics endpoint
- Sign-in
- Microsoft Entra ID
- Known traps
- Deploying workspace items through the API needs care with item definitions and the order items are created in
- Sampling
- Reading lakehouse tables through Spark
Connect
Connecting a workspace.
How connecting Microsoft Fabric works, step by step. The connector has run only against simulated Fabric services.
Choose Fabric
Sign in to Emolysis, then choose Fabric in the app. From a terminal, the command is emo connect fabric.
Sign in with Microsoft Entra ID
You sign in with your organization's Microsoft Entra ID account. The credentials are kept in your machine's credential store and never sent to Emolysis.
Pick a workspace
Emolysis lists the workspaces your account can reach. You pick the workspace and the lakehouse for deploys.
Sample on request
When you ask for a sample, Emolysis reads a small slice of a table from a lakehouse through Spark into DuckDB on your machine. That query runs on your platform; the tests that follow do not.
emo connect fabricDeploy
Deploys as workspace items.
A green run creates or updates a PySpark notebook in your Fabric workspace, running on your capacity under your account.
Items in the right order
Fabric items depend on each other, and the API needs them created in order with valid definitions. The profile records this trap, so deploys respect it.
The right language per item
Spark SQL and PySpark for lakehouse notebooks, T-SQL for warehouse objects. The profile keeps the agent from mixing them.
Through the REST API
The notebook is created or updated through the Fabric REST API, under your account.
Tagged for Fabric
Every generated file carries its platform and profile version, so it is never deployed to another platform without an explicit translation step.
Ready for semantic models
Aggregation / gold tables land as lakehouse tables that semantic models can read.
Your capacity
Notebooks and pipelines run on your Fabric capacity, on the schedule the pipeline defines, with your account's permissions.
Known traps
Traps the profile knows.
Two mistakes that are easy to make on Fabric, and what the Fabric profile is drafted to record about them.
Item definitions and order
Deploying workspace items through the API needs care with item definitions and the order the items are created in. Items that refer to each other, such as a pipeline that runs a notebook, have to be created in an order that works.
One language per item
Lakehouse notebooks run Spark SQL and PySpark, warehouses run T-SQL, and real-time data uses KQL. The profile records which one each item uses, so the agent does not mix them.
Shapes
Ten shapes on Microsoft Fabric.
Each shape has a template written for Microsoft Fabric, with fixtures and expected outputs. Their golden tests pass on DuckDB; none has run on a real Fabric workspace.
- Ingest (batch)A notebook or a pipeline copy into lakehouse Delta tables in OneLake.
- Incremental appendA notebook that stores its watermark and runs on a pipeline schedule, or Dataflow Gen2.
- CDC mergeMERGE on lakehouse Delta tables with Spark SQL.
- SCD Type 2MERGE on lakehouse Delta tables from a notebook.
- SnapshotOverwrite or partitioned writes to lakehouse Delta tables.
- BackfillA notebook with parameters, called once per date from a pipeline.
- Late-arrivingA notebook that finds the affected dates and rewrites those partitions.
- Dedupe / conformWindow functions in Spark SQL on lakehouse tables.
- Aggregation / goldLakehouse or warehouse tables that feed semantic models.
- Reverse ETLA pipeline copy activity into a database, or a notebook for APIs.
All ten shapes, with their templates and golden tests, are on the pipeline shapes page.
Read next
Glossary
Terms on this page
Questions
Microsoft Fabric questions.
Answers about Microsoft Fabric and how it fits. More in the FAQ.
Is there a date for Microsoft Fabric support?
There is no date yet. Fabric comes after Databricks. Its platform profile is drafted: the dialects, table format, merge idiom, incremental tools, deployment unit, sign-in method and known traps the agent needs to know. The connector is built and tested only against simulated Fabric services; it has not run on a real account. Support is announced on the news page, with the shapes whose templates pass their tests on Fabric.
Does Emolysis write for lakehouses or warehouses?
Lakehouses, as part of Fabric support, which is planned. Lakehouse work uses Spark SQL on Delta tables in OneLake and deploys as a PySpark notebook. When you connect, you pick the workspace and the lakehouse for deploys. The profile also records T-SQL for warehouses, but Emolysis does not deploy to a warehouse.
What does a deploy to Fabric create?
A PySpark notebook, created or updated in your workspace through the Fabric REST API, with your lakehouse as its default. It runs on your capacity under your account. Getting item definitions and creation order right is one of the known traps the Fabric profile is drafted to record.
How do I sign in to Fabric?
With Microsoft Entra ID, your organization's Microsoft sign-in. The credentials are kept in your machine's credential store and never sent to Emolysis. Emolysis acts with your account's permissions in the workspace, no more.
Can I move a pipeline from Databricks to Fabric?
Not by accident. Every file Emolysis generates is tagged with its platform and profile version, so a Databricks pipeline cannot be deployed to Fabric by mistake. Moving one is an explicit step: the SQL is translated into the target platform's dialect, that platform's template for the same shape is filled, and the golden tests run again on the target.
Nothing is released yet
Tell us what you run.
Microsoft Fabric comes after Databricks, with no date yet. Early access starts with Databricks teams. If you run Fabric, tell us what you would need first.