HackerTrans
トップ新着トレンドコメント過去質問紹介求人

flarco

no profile record

コメント

flarco
·24 日前·議論
It does seem over-engineered.

Normally you'd keep all the transformation in one place in the "data warehouse", which could be Postgres/Redshift/Snowflake/Clickhouse etc. Using some el tools (like sling cli for example) to load into the DW, and then using a transformation tool (like dbt for example) to do all the transformations in SQL, source controlled. It's advantageous to keep all of the transformation logic in one place (to avoid mismatches as you've mentioned). And from the DW, after data is ready, various tools/clients can consume it (such as BI tools, CRMs, APIs, AI, etc). All aligned.
flarco
·8 か月前·議論
Working on https://slingdata.io Platform for moving data around. Also has a free CLI. You can use YAML or even Python.
flarco
·8 か月前·議論
Another complement to easily moving data off cloud, check out https://github.com/slingdata-io/sling-cli. Use CLI, YAML or Python to run etl jobs.
flarco
·8 か月前·議論
For anyone looking to easily ingest data into a Postgres Wire compatible database, check out https://github.com/slingdata-io/sling-cli. Use CLI, YAML or Python to run etl jobs.
flarco
·8 か月前·議論
Check out https://github.com/slingdata-io/sling-cli
flarco
·10 か月前·議論
https://slingdata.io

An alternative tool to Extract/Load data via YAML, Python or CLI.