Kafka APIs and Connect

Kafka-compatible out of the box with comprehensive API support and extensive connector ecosystem

Complete Kafka API Suite

Full compatibility with all Kafka APIs for seamless integration with your existing infrastructure and applications.

Producer API

Publish/write records to Kafka topics with high throughput and reliability

Consumer API

Subscribe/read records from topics with flexible consumption patterns

Streams API

Real-time stream processing with DSL + Processor API capabilities

Connect API

Integration with external systems using source/sink connectors

Admin API

Manage topics, brokers, configs, ACLs, and metadata operations

Metadata API

Retrieve cluster/topic/partition information and topology

Transactions API

Enable exactly-once semantics for producers with ACID guarantees

Interactive Queries

Query state in Kafka Streams applications for real-time insights

Comprehensive Connector Landscape

Connect to hundreds of data sources and sinks with our extensive connector ecosystem supporting all major databases, cloud services, and messaging systems.

CDC & Databases
  • Debezium connectors (Postgres, MySQL, SQL Server, Oracle, Db2, MongoDB)
  • JDBC Source & Sink (generic DB integration)
  • Apache Iceberg Sink (growing adoption)
  • Cassandra Connector (streaming into/out of Apache Cassandra)
Warehouses & Analytics
  • Snowflake (Snowpipe Streaming, Kafka connectors)
  • BigQuery (Kafka → BigQuery sink)
  • Redshift (via JDBC or AWS Firehose bridge)
  • ClickHouse (sink connectors + JDBC)
  • Databricks Delta Lake (paired with Iceberg)
Search & OLAP
  • Elasticsearch (classic Kafka sink)
  • OpenSearch (actively supported fork)
  • Apache Druid (real-time OLAP ingestion)
  • Apache Pinot (native Kafka source integration)
Object Storage & Data Lakes
  • Amazon S3 (Iceberg/Delta/Hudi compatible)
  • Google Cloud Storage (GCS)
  • Azure Blob Storage & Data Lake Storage (ADLS)
  • HDFS (traditional Hadoop lake sink)
Caches & Key-Value Stores
  • Redis (Kafka → Redis sink)
  • DynamoDB (AWS-native, supported by sinks)
  • Memcached (via custom connectors)
  • Aerospike (KV + document store)
Messaging & Event Systems
  • MQTT Source/Sink: Ingest IoT/device telemetry from brokers like Mosquitto or HiveMQ
  • NATS Source/Sink: Stream messages from NATS subjects into Kafka topics
  • ActiveMQ (JMS source/sink)
  • RabbitMQ (Kafka ↔ RabbitMQ bridges)
  • Pulsar (cross-pub/sub with Apache Pulsar)
  • Kafka-to-Kafka (MirrorMaker 2, Confluent Replicator)
Monitoring & Observability
  • Prometheus exporters
  • InfluxDB sinks
ML & Streaming Features
  • TensorFlow Serving (via custom connectors)
  • Feast (feature store, often Kafka-backed)
Generic Connectors
  • HTTP Source/Sink (REST push/pull)
  • File Pulse (local/remote file ingestion)

Superior Performance with Full Compatibility

Get all the benefits of Kafka compatibility with dramatically improved performance and reduced resource usage.

Drop-in Replacement: Zero Code Changes required

Performance Boost: 10x Faster than standard Kafka

Full API Support: 100% Compatible with Kafka ecosystem