FAQ

What are pipeline shapes?

A pipeline shape is a recurring kind of data pipeline with a known correct form, and about ten shapes cover most production work.

Answer

A pipeline shape is a recurring kind of data pipeline with a known correct form, such as loading files into bronze, merging a change feed, or keeping history for a dimension. Data engineering is more repetitive than general software: about ten shapes cover most production work.

For each shape and each target platform, Emolysis has a template with named slots, test fixtures and expected outputs. When you ask for a pipeline, the agent picks the shape, asks only for the slots it is missing, fills the template and runs its tests, instead of writing the pipeline from scratch.

Browse the ten shapes, read how shapes and templates fit together, or see the post the ten pipeline shapes.