--

Snowflake eliminates most of the data cleansing and pipeline building but it is mostly meant for analytics.

If the transformations/business logic gets too complex and wanted to maintain a data flow with a sequence of micro steps connected. You would need an job orchestrator like airflow and python like programming knowledge at a minimum.

The digram already presents micro service like architecture as in one can replace compute and storage components with any technology as needed.

--

--

Lakshmi Shiva Ganesh Sontenam
Lakshmi Shiva Ganesh Sontenam

Written by Lakshmi Shiva Ganesh Sontenam

A man should hear a little music, read a little poetry, and see a fine picture every day of his life.

No responses yet