Delta Data Model Loads
New data integration content available
You're currently viewing a data integration topic that has been replaced and will eventually be removed from our documentation.
For the latest data integration content, see: Data Integration.
This feature allows customers to run delta data model loads, significantly reducing the overall latencies of the data model loads. Instead of exporting the full tables in the data model today, we will offer an option to the users to export only changed records per table. As a prerequisite, the customer needs to implement delta transformations so that we can identify the changed records from the last successful data model load.
In addition, the following conditions must be met:
Each table needs a primary key.
Add the "epoch" column to each view. This column is available hidden in each table.
Tip
To learn more about Delta Data Model Loads, check out this free online training from Celonis Academy: Set up a Delta Data Pipeline (30min).