Skip to main content

Setting up Real-Time Transformations

Setting up Real-Time Transformations (RTT) is not a single task, but a transition from "Batch" thinking to "Delta" thinking. Use the following guides in order to move your process from daily updates to real-time execution.

Phase 1: Preparation and strategy

Before writing SQL, you must understand how RTT changes your data flow.

Phase 2: Implementation

Follow these guides based on the type of data you are transforming:

  • Step 1: Data Model Tables - Learn how to convert standard tables. You will move from "Drop and Create" logic to a "Delete and Insert" delta logic.

  • Step 2: Activity Tables - Activities require a different architecture to prevent database locks. This guide explains how to split your activities by trigger and recombine them using a Union View.

Phase 3: Synchronization

Once your real-time logic is built, you must ensure your existing tools don't break it.

  • Step 3: Data Job Compatibility - Harmonize your weekly full loads and daily tasks with the Replication Cockpit to ensure your Data Model always shows a single, consistent version of the truth.

Quick reference

Use this quick-reference table to decide where to start: