spark-streaming 开源项目推荐（1,391 个）

Angel-ML /angel

A Flexible and Powerful Parameter Server for large-scale machine learning

lw-lin /CoolplaySpark

酷玩 Spark: Spark 源代码解析、Spark 类库等

RayXBuilds /Movie_Recommend

历史学习项目：Spark 电影推荐、爬虫、Web 与后台。新版持续开发见 cinematch-recommender。

dotnet /spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

jacksu /utils4s

scala、spark使用过程中，各种测试用例以及相关资料整理

edp963 /wormhole

Wormhole is a SPaaS (Stream Processing as a Service) Platform

microsoft /Mobius

C# and F# language binding and extensions to Apache Spark

lw-lin /streaming-readings

Streaming System 相关的论文读物

Stratio /sparta

Real Time Analytics and Data Pipelines based on Spark Streaming

databrickslabs /dbldatagen

Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

databrickslabs /dqx

Databricks framework to validate Data Quality of pySpark DataFrames and Tables

spirom /LearningSpark

Scala examples for learning to use Spark

harbby /sylph

Stream computing platform for bigdata

microsoft /data-accelerator

Apache Spark 的 Data Accelerator 简化了大数据流的引导。它提供了丰富且易用的体验，帮助在 Azure HDInsights 或 Databricks 上创建、编辑和管理 Spark 作业，同时充分发挥 Spark 引擎的强大功能。

pathwaycom /pathway-benchmarks

Benchmarks for data processing systems: Pathway Live Data Framework, Spark, Flink, Kafka Streams

paypal /gimel

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Azure /azure-event-hubs-spark

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

mkuthan /example-spark

Spark, Spark Streaming and Spark SQL unit testing strategies

Chabane /bigdata-playground

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

spirom /spark-streaming-with-kafka

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.