CDC components in DataFlow

Owned by DevPortal Editor (Unlicensed)
13/09/21
1 min read

The Data Flow module offers CDC (Change Data Capture) connectors that allow you to extract data from the source systems from their logs.

The Data Flow integrates CDC components for different technologies:

This origin component is very useful to perform database replication without affecting the source system.

Below is an example of the SQL Server client CDC component used in a product, which extracts the log data and. after processing, dumps it on the Platform.

 

More information here: https://streamsets.com/documentation/datacollector/latest/help/datacollector/UserGuide/Pipeline_Design/CDC-Overview.html