Hi,
Recently I’ve read about SQLMesh framework as one of the competitors for DBT.
It’s definitely way less popular than DBT, but apparently (according to few blog entries) more scalable and better suitable for data engineers in data warehousing scenarios.
Have anyone looked at it already? I’ve not found any references with Data Vault and SQLMesh so far.
Regards,
Marcin
like dbt, you’d need somebody to create the packages fot a data vault on SQLMesh. I have not used it or seen anyone who does.
Hi Marcin,
This is something I’ve been looking into a little recently so figured I’d chime in.
It might be the case that dbt sees SQLMesh as competition but SQLMesh looks to be fully happy to integrate with dbt without any configuration. If you like, run both!
SQLMesh has a very intuitive and smart plan command for building your pipeline safely and efficiently. But it lacks a package system like dbt.
However as SQLMesh is fine to share it’s toys with dbt its perfectly happy to allow you to use dbt packages as usual. So feel free to continue using your dbt data vault package of choice while integrating your ETL with both technologies.
This is something I’ve been looking at implementing myself recently so do feedback how it goes!
All the best,
Frankie