Change Data Capture (CDC)

Integrate CrateDB with CDC applications and frameworks.

CDC applications typically use CrateDB’s PostgreSQL interface. CrateDB also provides native adapter components to leverage advanced features.

Overview of CDC applications and frameworks that work with CrateDB, and how to use them effectively. Additionally, see support for generic ETL solutions.

Connectors

Native and specialized integration connectors for CrateDB, both managed and unmanaged.

Amazon DynamoDB

Load data from DynamoDB, a fully managed NoSQL database service provided by Amazon Web Services (AWS), which is designed for high-performance, scalable applications and offers key-value and document data structures.

DynamoDB
Amazon Kinesis

Load data from Amazon Kinesis Data Streams, a serverless streaming data service that simplifies the capture, processing, and storage of data streams at any scale.

Kinesis
MongoDB

Load data from MongoDB or MongoDB Atlas, a document database, self-hosted or multi-cloud.

MongoDB

Platforms

CrateDB supports popular third-party data integration frameworks and platforms, both managed and unmanaged.

AWS DMS

Use AWS Database Migration Service (AWS DMS), a managed migration and replication service that helps move your database and analytics workloads between different kinds of databases.

DMS (AWS Database Migration Service)
Debezium

Use Debezium, an open source distributed platform for change data capture for loading data into CrateDB. It is used as a building block by a number of downstream third-party projects and products.

Debezium
Estuary

Use Estuary Flow, a managed, real-time, reliable change data capture (CDC) solution, to load data into CrateDB. It combines agentless CDC, zero-code pipelines, and enterprise-grade governance to simplify data integration.

Estuary
RisingWave

Use RisingWave, a stream processing and management platform, to load data into CrateDB. It provides a Postgres-compatible SQL interface, like CrateDB, and a DataFrame-style Python interface. It is available for on-premises and as a managed service.

RisingWave
StreamSets

Use the StreamSets Data Collector Engine to ingest and transform data from many sources into CrateDB. It runs on-premises or in any cloud.

StreamSets