In private development

Databricks comes first. It is in development, Snowflake and Microsoft Fabric are planned, and none has run on a real account yet. PostgreSQL is in development as a source, and SQL Server is planned as a source.

Platforms

Code for the platform you already run.

Emolysis writes code for the data platform you already run, and tests it on your machine first. Development runs locally on DuckDB. Production runs on your platform, under your account, in its native deployment units.

The lineup

Production platforms

Deploy targets: Emolysis writes code for them and deploys to them

Sources

Read from, never deployed to: the data lands on your production platform

Local engine

Your machine: the development loop and the judge for golden tests

Platform profile

What a profile captures.

Connecting a workspace loads a platform profile. The agent reads it on every request, so platform awareness is data, not a hidden instruction.

  1. Dialect and languages

    The SQL dialect generated code is translated into, and the languages the platform runs, such as SQL and Python.

  2. Table format

    Delta, Iceberg or the platform's native tables, and the catalog that governs them.

  3. Merge idiom

    How the platform merges changes into a table, such as MERGE INTO with a change feed.

  4. Incremental tools

    The platform's own tools for incremental loads, such as Auto Loader, or streams and tasks.

  5. Deployment unit

    What a deploy produces: an Asset Bundle, SQL objects or workspace items.

  6. Compute

    How work is submitted: jobs, warehouses or sessions.

  7. Sign-in

    How you sign in to the platform, with credentials kept in your machine's credential store.

  8. Known traps

    Mistakes that are easy to make on this platform, which lint rules flag.

  9. Sampling

    How a small slice of a table is read into DuckDB on your machine for the golden tests.

Principle

Knowtheplatform.Knowtheshape.Proveitbeforeproduction.

Why it fits

Written for your platform.

The same loop on every target platform: a profile, a template, a test on your machine and a deploy in your platform's own unit.

Profile

Written for your platform

Emolysis writes Databricks code for Databricks, and Snowflake code for Snowflake. Connecting a workspace loads a platform profile: the dialect, table format, merge idiom, incremental tools, deployment unit, sign-in method and known traps of that platform.

  • Dialect
  • Table format
  • Merge idiom
  • Known traps

Deploy

Native units, on your account

What deploys is your platform's own unit. Databricks Asset Bundles; Snowflake tables, streams, tasks and dynamic tables; Fabric notebooks. They run on your platform's compute, under your account.

  • Asset Bundle
  • SQL objects
  • Workspace items

Tests

Proven on your machine first

Every change runs golden tests on DuckDB before it reaches your platform. A red test goes back to the template, not to production. Testing on a local sample spends no warehouse compute.

Shapes

Templates for the shapes you build

Most production work follows ten pipeline shapes. Emolysis starts from a template written for your platform instead of writing from scratch, and only your platform's templates are offered.

  • Ten shapes
  • Fixtures
  • Expected outputs

Tagged

Nothing crosses platforms by accident

Every generated file is tagged with its platform and profile version. A Databricks pipeline is never deployed to Fabric without an explicit translation step that swaps in the right template and re-runs the golden tests.

  • platform
  • profile_version

Questions

Platforms, answered.

Which platforms, in what order, and how a pipeline moves between them. More in the FAQ.

Which platforms does Emolysis support?

Databricks is first and in development; Snowflake and Microsoft Fabric are planned after it, and none has run on a real account yet. PostgreSQL is in development as a source and SQL Server is planned as one; Emolysis reads from sources and never deploys to them. DuckDB is the local engine on your machine for development and golden tests; it is not a production target.

What is a platform profile?

A platform profile is a structured description of a data platform that the agent loads the moment you connect a workspace. It records the platform's SQL dialect and languages, its table format, how it merges changes, its incremental tools, its deployment unit, its compute options, how sign-in works, its known traps and how to sample data from it. With the profile loaded, only that platform's templates are offered.

Why is Databricks first?

Databricks offers a complete set of APIs for everything Emolysis needs to do end to end: sign in with OAuth, read Unity Catalog, sample Delta tables, run jobs and deploy Asset Bundles. That makes it the best place to prove the whole loop. The platform profile format is the same for every platform, so the work on Databricks carries over.

Is there a date for Snowflake and Microsoft Fabric support?

There are no dates yet. Both come after Databricks. Their platform profiles are drafted. The Snowflake and Fabric connectors are built and tested only against simulated services; neither has run on a real account. Each one is announced on the news page, together with the shapes whose templates pass their tests on that platform.

Can I move a pipeline from one platform to another?

As an explicit step. Every file Emolysis generates is tagged with its platform and profile version, so a pipeline cannot be deployed to another platform by accident. The pipeline is translated into the target platform's dialect, that platform's template for the same shape is filled, and the golden tests run again on the target.

Can Emolysis read from SQL Server or PostgreSQL?

PostgreSQL is in development as a source and SQL Server is planned as one, with no dates yet. Emolysis reads from them and never deploys to them. Landing their data in bronze tables on your production platform, through the Ingest (batch), Incremental append and CDC merge shapes, is planned.

Databricks first · Nothing is released yet

Start with Databricks.

Early access is by invitation, starting with data engineering teams on Databricks.