Connecting to databases

Database credentials (username and password)

Active directory

OAuth

Service account authentication

Application default credentials

Personal access token

Key pair authentication

Pseudonmyzation algorithms

The applied pseudonymization algorithms can be selected in the advanced settings of the extractor builder:

Supported Algorithms:

Parallelization of table extractions

The max. number of parallel requests the extractor makes can be customized in the advanced settings when configuring the extractor.

Timeout for database connection

Timeout for all database connections created in this connection (specific to this connection only).

Live data connection (using the Replication Cockpit)

The ability to establish a live connection to the database using the replication cockpit.

Tables

Views

Synonyms

Analytical views

External tables

Snapshots

Materialized views

Table joins

It is possible to join the extracted table on another table during the extraction.

Time filter

Creation date filter: Used to restrict the number of records to be extracted.

Change date filter: Used for delta extractions.

Filtering

Filters can be applied on table level based on the supported filtering operators (documented below).

=

<; >

>=; <=

IN

NOT IN

Rename target table

The name of the table which is created in Celonis can be customized as part of the table configuration.

Column selection

The subset of columns that should be extracted can be selected.

Column pseudonymization

The columns that should be pseudonymized with the chosen algorithm can be selected.

Customize primary key

Additional columns can be added to the default primary key definition.

Casting of data types

The data type with which the extracted columns are inserted to Celonis can be customized.

Column data types

The column data type with which the extracted columns are inserted to Celonis.

Limit total records

The total number of records to be extracted can be limited using this feature.

Binary data type handling

Table column with binary data type can be represented in two ways:

Depending on the value specified here the binary value will be converted.

Maximum string length configuration

Allows the modification of the default length (80 characters) of String-type columns.

This is configured using the parameter: MAX_STRING_LENGTH

Batch size configuration

Allows specifying the batch size (in records) for one extraction request.

DRIVER_METADATA

This metadata source is supported by all source systems and mostly it is the default one. Here the driver internally runs the metadata Query against the source system and fetches the result set.

SAMPLE_QUERY

This metadata source is supported by all source systems. This also works the same as driver metadata, only the query used is different.

INFORMATION_SCHEMA

This metadata source is supported mainly by Oracle system. And it's a default metadata source for Oracle 11g.

PG_CATALOG

This metadata source is supported by Amazon Redshift. And it's a default metadata source.

Duplicate removal

Duplicate records retrieved within the extraction are removed based on the defined primary key and ordering columns.

Debug

Allows the enablement of a time-limited debug mode in the extraction settings to expose additional log messages.

Extraction preview

Filters can be applied for dependent tables