Load and Export (ETL)

Integrate CrateDB with ETL and ELT applications and frameworks.

ETL applications typically use CrateDB’s PostgreSQL interface. CrateDB also provides native adapter components to leverage advanced features.

Overview of ETL applications and frameworks that work with CrateDB, and how to use them effectively. Additionally, see support for Change Data Capture (CDC) solutions.

Databases

• DMS (AWS Database Migration Service)

• DynamoDB

• InfluxDB

• MongoDB

• MySQL and MariaDB

• Oracle

• PostgreSQL

• SQL Server

Load data from database systems.

Streams

• AMQP

• Kafka

• Kinesis

• MQTT

• RisingWave

• StreamSets

Load data from streaming platforms.

Dataflow / Pipeline / Code-first

• Airflow / Astronomer

• dbt

• dlt

• Flink

• ingestr

• Kestra

• Meltano

• NiFi

• Prefect

Use data pipeline programming frameworks and platforms.

Low-code / No-code / Visual

• Estuary

• Hop

• n8n

• Node-RED

Use visual data flow and integration frameworks and platforms.

Serverless Compute

• AWS Lambda

• Azure Functions

Use serverless compute units for custom import tasks.

Datasets

• Iceberg

Load data from datasets and open table formats.