Kinesis

About

Amazon Kinesis Data Streams is a serverless streaming data service that simplifies the capture, processing, and storage of data streams at any scale, such as application logs, website clickstreams, and IoT telemetry data, for machine learning (ML), analytics, and other applications.

You can use Amazon Kinesis Data Streams to collect and process large data streams in real time. A typical application reads data from the stream as records.

Related

• DynamoDB

• Amazon DynamoDB Streams

Synopsis

uvx 'cratedb-toolkit[io-ingest]' load \
  "kinesis://?aws_access_key_id=${AWS_ACCESS_KEY_ID}&aws_secret_access_key=${AWS_SECRET_ACCESS_KEY}&region_name=eu-central-1&table=arn:aws:kinesis:eu-central-1:831394476016:stream/testdrive" \
  "crate://crate:crate@localhost:4200/testdrive/kinesis_demo"

Learn

Ingestr Table Loader

Relay Kinesis stream into CrateDB.

Amazon Kinesis

DynamoDB CDC Relay

Relay table change stream CDC events from DynamoDB into CrateDB, using Kinesis.

DynamoDB CDC Relay

See also

Blog: Replicating CDC events from DynamoDB to CrateDB