Skip to main content

Task Mining data reference

NOTE: As at 2.19.

Event types

Description

Browser extensions required?

SAP integration required?

Active window changed

Active window has changed.

No

No

Application window changed

DEPRECATED FROM 2.7.3

State of an application window has changed. The window could, for example, have been opened or closed.

Application window change events are only detected for applications that are launched after the Task Mining Client software has been started. Changes to applications that were launched before the Task Mining Client software was started are not detected. This means if an application is opened before the Task Mining Client software was launched and closed while the Task Mining Client software is running, the close event will not be detected.

No

No

Clipboard changed

Content of the Windows clipboard has changed.

No

No

User comment

Comment added by user via the comment function in theTask Mining UI.

No

No

Focus changed

DEPRECATED FROM 1.0.0

Currently-focused window has changed.

No

No

Keyboard command

Keyboard command , for example Crtl + C, performed.

NOTE: Input of text is indicated by the Entered text event.

No

No

Left-click

Left mouse left click.

Yes

Mouse wheel

This event indicates a move of the mouse wheel in an unknown direction by a given number of units.

No

No

Mouse wheel (up)

This event indicates a move of the mouse wheel up by the given number of units.

No

No

Mouse wheel (down)

This event indicates a move of the mouse wheel down by the given number of units.

No

No

Right-click

Right mouse click.

No

No

Entered text

Input of readable text by the user.

No

No

Activated tab

FROM 1.0.2

Browser tab has been activated. This could be either:

  • A newly-opened tab; or

  • An already existing, previously inactive tab has been reactivated.

Yes

No

Closed tab

FROM 1.0.2

Browser tab has been closed.

Yes

No

Element changed

FROM 1.0.2

Web element (i.e. a text field) has changed.

Yes

No

Text selected

FROM 1.0.2

Text from a text field has been selected (e.g. by mouse, keyboard commands).

Yes

No

Left double click

FROM 1.0.2

Left mouse double-click.

Yes

No

Copy to clipboard

FROM 1.0.2

Text has been copied to the clipboard.

Yes

No

Cut to clipboard

FROM 1.0.2

Text has been cut to the clipboard.

Yes

No

Paste from clipboard

FROM 1.0.2

Text from the clipboard has been pasted to the target web element.

Yes

No

Task Mining Started

FROM 2.4.1

Task Mining Client software has started.

No

No

Task Mining Stopped

FROM 2.4.1

Task Mining Client software has stopped.

No

No

User Idle Started

FROM 2.4.1

Current user idle mode has started.

No

No

User Idle Ended

FROM 2.4.1

Current user idle mode has ended.

No

No

Session Locked

FROM 2.4.1

Current user Windows session has been locked.

No

No

Session Unlocked

FROM 2.4.1

Current user Windows session has been unlocked.

No

No

Session Connected

FROM 2.4.1

Current user session has been connected from the console.

No

No

Session Disconnected

FROM 2.4.1

Current user session has been disconnected from the console.

No

No

Session Remote Connected

FROM 2.4.1

Current user session has been connected to a remote connection.

No

No

Session Remote Disconnected

FROM 2.4.1

Current user session has been disconnected from a remote connection.

No

No

Alive

FROM 2.4.1

Task Mining client is alive.

No

No

Note

As at 2.19.

Attribute name

Description

Data type

Column size

Mandatory/hashable/redactable?

Supported event types

Browser extensions required?

SAP integration required?

Id

Unique identifier for the event.

string

36

Yes/No/No

All

Yes

No

TimestampLocal

Time when the event was detected (local time).

datetime

Yes/No/No

All

Yes

No

TimestampUTC

Time when the event was detected (lUTC).

datetime

Yes/No/No

All

Yes

No

SystemUser

Windows user name of the active user.

string

120

Yes/Yes/No

All

Yes

No

EventType

Type of the event.

string

120

Yes/No/No

All

Yes

No

ProcessName

Name of the Windows OS process for an active application.

string

120

Yes/No/No

All

Yes

No

ProcessId

Identifier of the Windows operating system process in the Windows Task Manager.

NOTE: The ProcessID is not stable and may vary between different runs of the application.

string

120

Yes/No/No

All

No

No

Comment

Comment entered by the user.

string

120

No/No/Yes

User comment

No

No

KeyboardCommand

Command key or key combination used.

string

30

No/No/No

Keyboard command

No

No

EnteredText

Text entered by the user.

NOTE: If the AnonymizeTextInput setting is activated, only the first character of the entered sequence is logged.

string

200

No/Yes/Yes

Entered text

No

No

ClipboardContentType

Type of content saved to the Windows clipboard.

string

120

No/No/No

Clipboard changed

No

No

ClipboardText

Textual content saved to the Windows clipboard.

string

120

No/Yes/Yes

Clipboard changed

Yes

No

ApplicationName

DEPRECATED FROM 2.7.3.

Name/title of an application that has changed its state.

string

120

No/Yes/No

Application window changed

No

No

ApplicationPath

DEPRECATED FROM 2.7.3.

File path of an application has changed its state.

string

120

No/Yes/No

Application window changed

No

No

ApplicationTitle

DEPRECATED FROM 2.7.3.

Title of an application has changed its state.

string

500

No/Yes/No

Application window changed

No

No

ApplicationAction

DEPRECATED FROM 2.7.3.

The window-related action triggers the state change of the application (e.g. launch of the window).

string

120

No/Yes/No

Application window changed

No

No

ActiveWindow

The name / title of the active window.

string

200

No/Yes/Yes

All

Yes

No

ActiveElementName

DEPRECATED FROM 1.0.5

The name of the clicked element (e.g. the name of the clicked button).

string

120

No/Yes/No

  • Left click

  • Right click

  • Mouse wheel

  • Mouse wheel (up)

  • Mouse wheel (down)

  • Focus changed

No

No

ControlType

DEPRECATED FROM 1.0.5

The type of the clicked element (e.g. Button).

string

120

No/Yes/No

  • Left click

  • Right click

  • Mouse wheel

  • Mouse wheel (up)

  • Mouse wheel (down)

  • Focus changed

No

No

SessionId

A unique ID for the Task Mining session. A session is the period of time from starting Task Mining to stopping it. This can either be done manually via the start/stop buttons or automatically, e.g., when starting Task Mining together with Windows or when shutting down Task Mining.

string

36

Yes/No/No

All

Yes

No

SnippetId

A unique id within a session that groups events that occur within a small time distance. If the time distance between consecutive events exceeds the time window, the later event is assigned to a new snippet.

string

120

No/No/No

All

Yes

No

ScreenshotId

The unique file name of the screenshot is related to the event.

string

120

No/No/No

All

Yes

No

MousePositionX

FROM 1.0.2

The X coordinate of the mouse pointer is in the screenshot. A negative value indicates that the mouse pointer is outside of the screenshot.

int

No/No/No

All

Yes

No

MousePositionY

FROM 1.0.2

The Y coordinate of the mouse pointer is in the screenshot. A negative value indicates that the mouse pointer is outside of the screenshot.

int

No/No/No

All

Yes

No

ScrollUnits

The number of units the mouse wheel was moved.

int

No/No/No

  • Mouse wheel

  • Mouse wheel (up)

  • Mouse wheel (down)

No

No

ActiveWindowX

FROM 1.0.2

The X coordinate of the active window is in the screenshot. A negative value indicates that the active window is outside of the screenshot. The point (ActiveWindowX, ActiveWindowY) represents the left upper corner of the active window.

int

No/No/No

All

Yes

No

ActiveWindowY

FROM 1.0.2

The Y coordinate of the active window is in the screenshot. A negative value indicates that the active window is outside of the screenshot. The point (ActiveWindowX, ActiveWindowY) represents the left upper corner of the active window.

int

No/No/No

All

Yes

No

ActiveWindowWidth

FROM 1.0.2

The width of the active window in the screenshot. A negative value indicates that the active window is outside of the screenshot.

int

No/No/No

All

Yes

No

ActiveWindowHeight

FROM 1.0.2

The height of the active window in the screenshot. A negative value indicates that the active window is outside of the screenshot.

int

No/No/No

All

Yes

No

ScreenshotWidth

FROM 1.0.2

The width of the screenshot.

int

No/No/No

All

Yes

No

ScreenshotHeight

FROM 1.0.2

The height of the screenshot.

int

No/No/No

All

Yes

No

ExtensionName

The name of the Celonis Task Mining Extension that logged the event.

string

120

Yes/No/No

All

Yes

No

URL

FROM 1.0.2

The URL of the website is currently opened in the tab that triggered the event. For Internet Explorer, this value can only be retrieved if the interaction is happening on the web page; for interactions outside of the web page (e.g. opening, switching, and closing tabs), no values are available for Internet Explorer.

string

1000

No/Yes/Yes

All

Yes

No

TargetElementType

FROM 1.0.2

The HTML element type of the web element is related to the event.

string

120

No/Yes/No

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

TargetElementId

FROM 1.0.2

The HTML element ID of the web element is related to the event.

string

120

No/Yes/No

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

TargetElementName

FROM 1.0.2

The HTML element name of the web element is related to the event.

string

120

No/Yes/Yes

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

TargetElementValue

FROM 1.0.2

The HTML element value of the web element is related to the event.

string

120

No/Yes/Yes

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

TargetInputType

FROM 1.0.2

The input type of the web element is related to the event if the attribute TargetElementType has the value 'INPUT'.

string

120

No/Yes/No

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

TargetClassName

FROM 1.0.2

The CSS class name of the web element is related to the event.

string

120

No/Yes/No

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

TargetLinkUrl

FROM 1.0.2

The URL is linked by the clicked element if the attribute TargetElementType has the value 'A'.

string

1000

No/Yes/Yes

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

TargetIsChecked

FROM 1.0.2

Indicates if the web element related to the event is checked or not. Can only be true if the attribute TargetElementType has the value 'INPUT' and the attribute TargetInputType has either the value 'RADIO' or the value 'CHECKBOX').

bool

No/No/No

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

SelectedText

FROM 1.0.2

The text that has been selected. For 'Copy to clipboard' and 'Cut to clipboard' events, this represents the text that has been set to clipboard. For events of type 'Text selected' (only triggered when text in a text field of type input or textarea has been selected), this contains the selected text.

string

120

No/Yes/Yes

  • Text selected

  • Copy to clipboard

  • Cut to clipboard

Yes

No

DomPath

FROM 1.0.2

Path in the DOM tree of the web element that is related to the event.

string

5000

No/Yes/No

  • Left click

  • Left double click

  • Element changed

  • Text selected

  • Copy to clipboard

  • Cut to clipboard

Yes

No

ClientVersion

FROM 1.0.2

Version of the Celonis Task Mining Client software that logged the event.

string

120

Yes/No/No

All

Yes

No

ExtensionVersion

FROM 1.0.2

Version of the Task Mining browser extension that logged the event.

string

120

Yes/No/No

All

Yes

No

MachineName

FROM 1.0.4

Name of the local machine that is running the Task Mining Client software.

string

120

No/Yes/No

All

Yes

No

TargetX

FROM 1.0.4

The X coordinate of the web element is related to the event. The value is relative to the left upper corner of the browser window which is expected to be stored in the attribute ActiveWindowX.

int

No/No/No

  • Left click

  • Left double click

  • Element changed

Yes

No

TargetY

FROM 1.0.4

The Y coordinate of the web element related to the event. The value is relative to the left upper corner of the browser window which is expected to be stored in attribute ActiveWindowY.

int

No/No/No

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

TargetWidth

FROM 1.0.4

The width of the web element related to the event.

int

No/No/No

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

TargetHeight

FROM 1.0.4

The height of the web element related to the event.

int

No/No/No

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

UserId

FROM 1.1.1

The hashed Windows user name of the active user. The value is hashed using SHA256.

string

120

Yes/No/No

All

Yes

No

WebPageExtractions

FROM 1.1.6

Specific data extracted from the web page in JSON format

string

16250

No/No/Yes

  • Left click

  • Left double click

  • Element changed

  • Text selected

Yes

No

CaretPositionX

FROM

1.2.1

X position of the caret (text input cursor). The value is relative to the left border of the text input control that owns the caret.

int

No/No/No

  • Keyboard command

  • Entered text

No

No

CaretPositionY

FROM

1.2.1

Y position of the caret (text input cursor). The value is relative to the top border of the text input control that owns the caret.

int

No/No/No

  • Keyboard command

  • Entered text

No

No

ElementTypeSAP

FROM

1.2.1

Type of the SAP GUI element related to the event

string

80

No/No/Yes

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

ElementIdSAP

FROM

1.2.1

ID of the SAP GUI element related to the event. The ID describes the hierarchy of the element in the SAP GUI.

string

1000

No/No/No

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

ElementNameSAP

FROM

1.2.1

Name of the SAP GUI element related to the event. The name is also part of the id stored in ElementIdSAP.

string

80

No/No/Yes

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

ElementTextSAP

FROM

1.2.1

The text of the SAP GUI element related to the event.

string

16250

No/No/Yes

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

ElementToolTipSAP

FROM

1.2.1

Tooltip of the SAP GUI element related to the event.

string

400

No/No/Yes

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

ElementLabelSAP

FROM

1.2.1

Label of the SAP GUI element related to the event.

string

120

No/No/Yes

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

ElementScreenLeftSAP

FROM 1.2.1

Left position (X coordinate) of the SAP GUI element related to the event in screenshot coordinates.

int

No/No/No

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

ElementScreenTopSAP

FROM 1.2.1

Top position (Y coordinate) of the SAP GUI element related to the event in screenshot coordinates.

int

No/No/No

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

ElementWidthSAP

FROM 1.2.1

Width (in pixels) of the SAP GUI element related to the event.

int

No/No/No

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

ElementHeightSAP

FROM 1.2.1

Height (in pixels) of the SAP GUI element related to the event.

int

No/No/No

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

ElementIconNameSAP

FROM

1.2.1

Icon name of the SAP GUI element related to the event.

string

80

No/No/Yes

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

WindowNameSAP

FROM

1.2.1

Name of the window that hosts the SAP GUI element related to the event.

string

80

No/No/Yes

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

CheckboxSelectedSAP

FROM

1.2.1

Selection state of the SAP GUI checkbox related to the event.

bool

No/No/No

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

TitleSAP

FROM

1.2.1

Title of the SAP GUI element related to the event.

string

200

No/No/Yes

  • Left click

  • Right click

  • Mouse wheel

  • Keyboard command

  • Entered text

  • Mouse wheel (up)

  • Mouse wheel (down)

No

Yes

AutomationId_UIAA

FROM

2.0.4

An ID of the element within the GUI of an application related to the event.

string

120

No/Yes/No

All

No

No

ControlType_UIAA

FROM

2.0.4

The control type of the element related to the event.

string

120

No/Yes/No

All

No

No

Name_UIAA

FROM

2.0.4

The name of the GUI element related to the event.

string

120

No/Yes/Yes

All

No

No

Value_UIAA

FROM

2.0.4

The value that is held by the GUI element related to the event.

string

1000

No/Yes/Yes

All

No

No

ElementX_UIAA

FROM

2.0.4

X-coordinate (as absolute screen coordinate) of the GUI element related to the event.

int

No/No/No

All

No

No

ElementY_UIAA

FROM

2.0.4

Y-coordinate (as absolute screen coordinate) of the GUI element related to the event.

int

No/No/No

All

No

No

ElementWidth_UIAA

FROM

2.0.4

Width of the GUI element related to the event.

int

No/No/No

All

No

No

ElementHeight_UIAA

FROM

2.0.4

Height of the GUI element related to the event.

Note

As GUI elements may be composed of different other elements, the value of this field might differ from the expected value. For example, buttons may include text and/or image elements so the value might relate to them rather than

int

No/No/No

All

No

No

ClassName_UIAA

FROM

2.0.4

Programmatic class name of the GUI element related to the event.

Note

As GUI elements may be composed of different other elements, the value of this field might differ from the expected value. For example, buttons may include text and/or image elements so the value might relate to them rather than to the button itself.

string

120

No/Yes/No

All

No

No

HelpText_UIAA

FROM

2.0.4

Help text that describes the GUI element related to the event.

string

120

No/Yes/Yes

All

No

No

IsEnabled_UIAA

FROM

2.0.4

Flag indicating if the GUI element is enabled or disabled.

bool

No/No/No

All

No

No

FrameworkID_UIAA

FROM

2.0.4

Underlying GUI framework of the element.

string

120

No/No/No

All

No

No

ApplicationServerSAP

FROM

2.4.2

Name of the SAP application server.

string

120

No/Yes/No

All

No

Yes

ClientSAP

FROM

2.4.2

Client selected on the SAP login screen.

string

120

No/Yes/No

All

No

Yes

GroupSAP

FROM

2.4.2

SAP login group.

string

120

No/Yes/No

All

No

Yes

ScreenNumberSAP

FROM

2.4.2

Number of the SAP screen that is currently displayed.

int

No/No/No

All

No

Yes

SessionNumberSAP

FROM

2.4.2

Number of the SAP session.

int

No/No/No

All

No

Yes

FROM

2.4.2

Name of the SAP system.

string

120

No/Yes/No

All

No

Yes

SystemNumberSAP

FROM

2.4.2

Number of the SAP system.

int

No/No/No

All

No

Yes

SystemSessionIdSAP

FROM

2.4.2

Identifier of the SAP system session.

string

120

No/Yes/No

All

No

Yes

TransactionSAP

FROM

2.4.2

Identifier of the current SAP transaction.

string

120

No/Yes/No

All

No

Yes

UserSAP

FROM

2.4.2

SAP user name.

string

120

No/Yes/Yes

All

No

Yes

 

Custom1

FROM

2.8.0

Optional custom user attribute that can be defined in the configuration file.

string

2000

No/Yes/No

All

No

No

Custom2

FROM

2.8.0

Optional custom user attribute that can be defined in the configuration file.

string

2000

No/Yes/No

All

No

No

Custom3

FROM

2.8.0

Optional custom user attribute that can be defined in the configuration file.

string

2000

No/Yes/No

All

No

No

 

Custom4

FROM

2.8.0

Optional custom user attribute that can be defined in the configuration file.

string

2000

No/Yes/No

All

No

No

Custom5

FROM

2.8.0

Optional custom user attribute that can be defined in the configuration file.

string

2000

No/Yes/No

All

No

No

Table name

Description

applications

Contains applications and web pages and whether they are productive or non-productive. Used in the Workforce Productivity application Application Usage tab.

Business_Events

Contains all Business Event names.

Business_Event_Instances

Contains all instances of Business Events and the Business Event they belong to.

Business_Event_Object_Attributes

Contains the Attributes for each Business Event instance.

employees

Contains metadata about employees.

Tasks

Contains all Task names.

Task_Instance

Contains all instances of a Task and which Task they belong to.

TM_Labeled_Data

The result event log is inserted into this table after processing. Also contains the event log that is used in the Studio package.

Task_Join

Contains all event IDs which belong to the Task instances. Event IDs can occur more than once if the belong to more than one Task.

TM_Labeled_Data_View

Limits the total number of rows that will be loaded from TM_Labeled_Data to the Data Model to two billion:

CREATE VIEW TM_Labeled_Data_View AS SELECT TM_Labeled_Data.*, epoch FROM TM_Labeled_Data ORDER BY TimestampUTC DESC LIMIT 2000000000

user_interaction_event_log

Contains all the raw Task Mining event data.

user_interaction_event_log_history

Contains all completed and fully-processed recording sessions. These are moved here for scalability/performance reasons.

: