Installation and Prerequisites
Prerequisites - Kafka
Apache Kafka at least 2.3 version and a Kafka Connect cluster.
What is Kafka Connect?
Kafka Connect is a free, open-source component of Apache Kafka® to continuously import and export data as event streams to integrate Kafka with your existing systems. The Kafka Connect cluster is highly scalable and fault-tolerant to ensure continuous operations.
Prerequisites - EMS
The following items are required before you get started:
Create the destination data pool
Generate the app key
Create the destination Vertica table (optional - if not already created, the first message will be used to infer the schema
Steps to follow in EMS
The following steps must be taken to use Celonis Kafka Connector with EMS.
Log in to Admin & Settings
Create an AppKey (in Admin & Settings → Applications)
Create a data pool (in Data → Data Integration)
Allow appkey access to data pool (… next to data pool → Permissions)
Grab the data pool ID (in the browser’s URL bar on going into the data pool)
Create a Vertica table which will be the EMS destination table (table DDL should match Kafka topic schema). If the table already exists, no creation will be attempted.