Jun 18, 2022
Snowflake eliminates most of the data cleansing and pipeline building but it is mostly meant for analytics.
If the transformations/business logic gets too complex and wanted to maintain a data flow with a sequence of micro steps connected. You would need an job orchestrator like airflow and python like programming knowledge at a minimum.
The digram already presents micro service like architecture as in one can replace compute and storage components with any technology as needed.