structured-streaming 开源项目推荐（211 个）

lw-lin /CoolplaySpark

酷玩 Spark: Spark 源代码解析、Spark 类库等

databricks /LearningSparkV2

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

japila-books /spark-structured-streaming-internals

The Internals of Spark Structured Streaming

Azure /azure-event-hubs-spark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

polomarcus /Spark-Structured-Streaming-Examples

Spark Structured Streaming / Kafka / Cassandra / Elastic

qubole /kinesis-sql

Kinesis Connector for Structured Streaming

streamnative /pulsar-spark

Spark Connector to read and write with Pulsar

radoslawkrolikowski /financial-market-data-analysis

Real-Time Financial Market Data Processing and Prediction application

chermenin /spark-states

Custom state store providers for Apache Spark

astrolabsoftware /fink-broker

Astronomy Broker based on Apache Spark

IBM /kafka-streaming-click-analysis

Use Kafka and Apache Spark streaming to perform click stream analytics

Klarrio /open-stream-processing-benchmark

This repository contains the code base for the Open Stream Processing Benchmark.

zaleslaw /Spark-Tutorial

How to build your first Spark application with MLlib, StructuredStreaming, GraphFrames, Datasets and so on? Answer is here!

HeartSaVioR /spark-sql-kafka-offset-committer

Kafka offset committer for structured streaming query

sankamuk /PysparkCheatsheet

PySpark Cheatsheet

HeartSaVioR /spark-state-tools

Spark Structured Streaming State Tools

aws-samples /iceberg-streaming-examples

This repo contains examples of high throughput ingestion using Apache Spark and Apache Iceberg. These examples cover IoT and CDC scenarios using best practices. The code can be deployed into any Spark compatible engine like Amazon EMR Serverless or AWS Glue. A fully local developer environment is also provided.

AndrewKuzmin /spark-structured-streaming-examples

Spark structured streaming examples with using of version 3.5.1

aamend /spark-gdelt

Binding the GDELT universe in a Spark environment

xiaogp /recsys_structured_streaming

kafka + structured streaming + phoenix + elasticsearch 基于行为日志实现热门推荐，用户偏好推荐，召回融合策略实现。