Load data into CrateDB¶
Data ingestion / loading / import methods for CrateDB at a glance.
CrateDB Server¶
CrateDB natively supports data import using its COPY FROM SQL statement. It can load data in CSV and JSONL (NDJSON) formats from the local filesystem or from remote sources (HTTP, FTP, Blob Storage).
CrateDB’s Foreign data wrappers subsystem makes data in remote database servers available as tables within CrateDB. You can then query these foreign tables like regular user tables.
CrateDB Cloud¶
CrateDB Cloud provides managed data loading from remote sources.
Supports file import in CSV, JSONL (NDJSON), and Parquet formats from HTTP and Blob Storage (AWS S3, Azure Storage, Google GCS).
The MongoDB CDC integration continuously ingests from MongoDB using Change Data Capture (CDC), providing near real-time synchronization of your data.
Integrations¶
CrateDB integrates with a range of applications and frameworks for one-shot and continuous / streaming data imports.
- Extract Transform Load (ETL):
Ingest data from many sources.
- Change Data Capture (CDC):
Integrate with change-data-capture (CDC) systems.
- Metrics, telemetry, and logs:
Ingest telemetry data—metrics, logs, and traces—from monitoring and sensor collector systems.