Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.
-
Updated
Jan 27, 2021 - Python
#
apache-kafka
Here are 234 public repositories matching this topic...
docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform
-
Updated
May 3, 2025 - Python
Kafka-based Job Queue for Python
python kafka python3 queueing kafka-consumer apache-kafka kafka-producer kafka-client job-queue producer-consumer worker-queue
-
Updated
Feb 4, 2022 - Python
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.
docker big-data cassandra apache-spark data-storage postgresql data-engineering apache-kafka data-processing data-pipeline real-time-analytics containerization apache-zookeeper apache-airflow etl-pipeline
-
Updated
Feb 14, 2025 - Python
Real-Time Financial Market Data Processing and Prediction application
python apache-spark mariadb pytorch neural-networks scrapy apache-kafka financial-data structured-streaming
-
Updated
Jul 23, 2023 - Python
Command Line Interface for the Strimzi Kafka Operator
kubernetes cli kafka openshift messaging command-line-tool apache-kafka hacktoberfest command-line-interface strimzi
-
Updated
Nov 6, 2024 - Python
The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and push it to an Apache Kafka topic.
kafka apache-kafka kafka-producer pyton aiven fake-data-generator fake-datasets aiven-cloud apache-kafka-producer fake-streaming
-
Updated
Apr 27, 2024 - Python
Astronomy Broker based on Apache Spark
-
Updated
May 2, 2025 - Python
Ecommerce Realtime Data Pipeline (Data Modeling, Workflow Orchestration, Change Data Capture, Analytical Database and Dashboarding)
python ecommerce docker-compose clickhouse grafana postgresql apache-kafka data-pipeline change-data-capture debezium realtime-dashboard database-modeling apache-airflow realtime-streaming
-
Updated
Mar 9, 2024 - Python
Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
python twitter kafka spark apache-spark sentiment-analysis twitter-api pyspark apache-kafka afinn twitter-sentiment-analysis spark-sql spark-structured-streaming pykafka twitter-topic
-
Updated
Dec 12, 2018 - Python
This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.
apache-spark yarn hive hadoop bigdata impala hbase pig apache-storm mapreduce flume oozie apache-kafka sqoop apache-solr hadoop-filesystem apache-ranger hiveql apache-atlas apache-knox
-
Updated
Jun 10, 2018 - Python
Open Source Computer Vision with TensorFlow, MiniFi, Apache NiFi, OpenCV, Apache Tika and Python For processing images from IoT devices like Raspberry Pis, NVidia Jetson TX1, NanoPi Duos and more which are equipped with attached cameras or external USB webcams, we use Python to interface via OpenCV and PiCamera. From there we run image processin…
-
Updated
Jun 16, 2018 - Python
Explore Apache Kafka data pipelines in Kubernetes.
react python kubernetes data-stream kafka-connect apache-kafka kafka-streams data-pipelines hacktoberfest
-
Updated
Feb 25, 2025 - Python
📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.
docker open-source aws big-data etl s3 data-visualization data-engineering minio apache-flink apache-kafka real-time-data data-pipeline trino streaming-analytics apache-superset apache-iceberg lakehouse sql-analytics
-
Updated
Jan 18, 2025 - Python
Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python
python data kafka analytics apache-flink apache-kafka kafka-streams streaming-data spark-structured-streaming kstreams
-
Updated
Dec 28, 2022 - Python
Counting Tweets Per User in Real-Time
-
Updated
Jul 28, 2017 - Python
Distributed Streaming with Apache Kafka and Python OpenCV
opencv streaming kafka realtime python3 distributed kafka-consumer apache-kafka kafka-producer live-streaming-videos camera-stream rtsp-stream
-
Updated
Feb 27, 2019 - Python
Fully Managed Apache Kafka Cluster with Ansible & Terraform.
aws ansible ansible-playbook kafka monitoring terraform apache newrelic cloudwatch-logs apache-kafka production-ready playbooks managed kafka-manager kafka-cluster newrelic-insights terraform-aws cmak consumer-metrics kafka-ansible
-
Updated
Apr 11, 2023 - Python
This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgres and Streamlit. The system is built using Docker Compose to easily spin up the required services in Docker containers.
apache-spark bigdata postgresql apache-kafka realtime-analytics streamlit-dashboard realtime-voting-system realtime-election
-
Updated
Dec 11, 2023 - Python
Security Analytics Engine - Anomaly Detection in Web Traffic
machine-learning big-data spark apache-spark grafana prometheus python3 apache-kafka isolation-forest security-analytics
-
Updated
Jun 11, 2024 - Python
Improve this page
Add a description, image, and links to the apache-kafka topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the apache-kafka topic, visit your repo's landing page and select "manage topics."