Kafka

Apache Kafka is the distributed event streaming platform: it publishes, stores, and processes trillions of events per day with high-throughput and low-latency performance.

Kafka is your core nervous system for data: a distributed, fault-tolerant platform for real-time stream processing. It handles data ingestion and delivery at scale, moving millions of records per second across a cluster of brokers. We manage event streams via partitioned Topics, leveraging the core Producer and Consumer APIs for high-volume exchange. For complex ETL and microservices, the Kafka Connect and Kafka Streams APIs provide built-in tools for integration (e.g., Postgres, S3) and stateful processing (joins, aggregations). Over 80% of Fortune 100 companies trust Kafka for mission-critical, event-driven architectures.

https://kafka.apache.org