Skip to content
Ingestion

Streaming Connectors

Seamlessly Connect to Any Data Stream.

CrateDB integrates with your existing streaming ecosystem — Kafka, Flink, MQTT, HTTP APIs, and CDC pipelines — for real-time data ingestion at scale. CrateDB fits naturally into modern data streaming architectures. Whether you’re capturing IoT telemetry, synchronizing operational databases, or processing complex event streams, CrateDB connects directly to your pipelines, continuously ingesting, indexing, and making data query-ready within seconds.

Kafka integration for continuous streaming

CrateDB integrates natively with Apache Kafka, the industry standard for event streaming. You can stream millions of events per second from Kafka topics directly into CrateDB, where data becomes instantly searchable and analyzable.

Key benefits:

  • High-throughput ingestion from Kafka topics
  • Low-latency writes with automatic distribution
  • Perfect for IoT, observability, and log analytics use cases
cr-quote-image

Flink for real-time processing

CrateDB works seamlessly with Apache Flink, enabling advanced stream processing and analytics before data lands in the database. Together, Flink and CrateDB create a powerful real-time pipeline. Flink processes and enriches events, while CrateDB stores and indexes them for sub-second querying.

CrateDB works seamlessly with Apache Flink, enabling advanced stream processing and analytics before data lands in the database.
Together, Flink and CrateDB create a powerful real-time pipeline — Flink processes and enriches events, while CrateDB stores and indexes them for sub-second querying.

Common patterns:

  • Use Flink for transformations and windowed aggregations
  • Store processed results in CrateDB for dashboards and AI models
  • Query enriched data using standard SQL in milliseconds
cr-quote-image

Change Data Capture (CDC)

CrateDB supports Change Data Capture (CDC) pipelines to keep your analytical layer in sync with operational databases.
Using connectors like Debezium, CrateDB continuously ingests inserts, updates, and deletes,  eliminating the need for batch synchronization or ETL jobs.

Why CDC matters:

  • Keep analytics continuously updated
  • Reduce latency between operational and analytical systems
  • Simplify architecture with real-time sync
cr-quote-image

MQTT and Edge connectivity

For IoT and edge deployments, CrateDB supports lightweight MQTT protocols, enabling millions of connected devices to stream telemetry data efficiently.
Combined with edge-friendly deployment options, this makes CrateDB ideal for industrial and sensor-based environments.

Use cases:

  • Real-time factory and sensor monitoring
  • Smart mobility and connected vehicles
  • Edge-to-cloud data integration
cr-quote-image

HTTP and REST APIs

CrateDB’s native HTTP endpoint provides a simple, flexible way to ingest data from custom applications, services, and microservices. This allows easy integration with any modern data producer, from web apps to serverless backends.

Highlights:

  • JSON over HTTP for easy data pushes
  • Works with any programming language
  • Ideal for microservices architectures
cr-quote-image

One database for all streams

Whether it’s Kafka, Flink, MQTT, CDC, or HTTP, CrateDB unifies all incoming streams into a single, real-time database.
You get one place to store, query, and analyze data from everywhere, instantly and at scale.

Without CrateDB With CrateDB
Separate systems for ingestion, processing, and analytics Unified ingestion and analytics engine
Complex synchronization and ETL jobs Continuous real-time streaming
Multiple tools to manage One database for all data streams
cr-quote-image

CrateDB architecture guide

This comprehensive guide covers all the key concepts you need to know about CrateDB's architecture. It will help you gain a deeper understanding of what makes it performant, scalable, flexible and easy to use. Armed with this knowledge, you will be better equipped to make informed decisions about when to leverage CrateDB for your data projects. 

CrateDB-Architecture-Guide-Cover

Want to learn more?