Orchestrate - Add ETL tasks/steps
when creating a task in Orchestrate there is no possibility to add ETL tasks.
Currently I'm in need to create a weekly process where first we run SRCECC (full)-this was also requested in other ideas - and sequentially run ETL tasks.
Log in to comment and vote
Comments3
John Munkberg
Jan 13, 2025
@Eldrige Joseph Sorry for the slow followup. There is a task in Orchestrate, and in Migrate ETL to run a Replication. Today this is a single replication - not a whole Target or Source.
So it’s possible today, but I think you are asking if we can have a Orchestrate Task to refresh all tables in a Target (TGTS4H) or all tables from a source system. I don’t know for sure, but new Replicate will support “scheduling” the refresh as these levels, so it’s not much a stretch to ask to expose that as a TASK in Replicate.
I have opened a JIRA feature request for Engineering:
https://entota.atlassian.net/browse/DBM-5395
Eldrige Joseph
Dec 5, 2024
When the ETL Task feature in Orchestrate is deployed, will it be accompanied by a “Run Snapshot” task and if so at what level (Snapshot Datasource / Snapshot System Datasource / Table)? It is essential we have this capability in Orchestrate so we can run the Snapshot and follow it up with ETL task.
John Munkberg
Oct 1, 2024
The team is working on this functionality - both to allow Orchestrate to call Migrate ETL jobs, and to allow Migrate to call Orchestrate Workflows.