Aerospike Kafka sink (inbound) connector

The Aerospike Kafka sink (inbound) connector streams data from Apache Kafka to Aerospike. Streaming from Apache Kafka to Aerospike Database Enterprise Edition relies on Aerospike’s Kafka sink connector. This inbound connector allows you to stream messages from Kafka, translates each message to an Aerospike record, and performs the corresponding insert, update, or delete for that record in Aerospike.

The sink connector supports streaming data from one or more Kafka topics and persists the data in an Aerospike database. Each Kafka record is converted to an Aerospike record and persisted to an Aerospike cluster. You can even write custom code to manipulate Kafka records by performing operations on them that the connector does not support natively. An instance of a connector can persist data only to a single Aerospike cluster. Aerospike acknowledges records that have been written successfully.

Features

• Flexible Record Mapping: Maps Kafka topics to Aerospike namespaces, sets, and bins with YAML configuration 1.
• Secure Connectivity: Supports TLS, authentication modes, and IP mapping for secure deployments 2.
• High Throughput & Scalability: Designed for parallelism and distributed Kafka Connect deployments 3.
• Custom Transformations: Allows custom code to manipulate Kafka messages before writing to Aerospike 1.
• Reliable Delivery: Acknowledges successful writes and handles retries, with awareness of Kafka’s ordering limitations