hdinsight 开源项目推荐（51 个）

dotnet /spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

microsoft /data-accelerator

Apache Spark 的 Data Accelerator 简化了大数据流的引导。它提供了丰富且易用的体验，帮助在 Azure HDInsights 或 Databricks 上创建、编辑和管理 Spark 作业，同时充分发挥 Spark 引擎的强大功能。

microsoft /AzureSMR

AzureSMR is no longer being actively developed. For ongoing support of Azure in R, see: https://github.com/Azure/AzureR

hdinsight /hdinsight-kafka-tools

HDInsight Kafka Tools

caiomsouza /microsoft-big-data-scientist-and-ai

Microsoft Big Data, Data Scientist, and AI

UnoSD /SparkSharp

C# Livy client to submit Spark jobs to HDInsight and other Spark clusters

kcheeeung /hive-benchmark

Automated TPC-DS and TPC-H benchmark for Apache Hive LLAP

SyncfusionSuccinctlyE-Books /HDInsight-Succinctly

This is the companion repo for HDInsight Succinctly by James Beresford. Published by Syncfusion.

kojish /hdinsight-spark-livy-client

Java client for submitting a remote job to HDInsight Spark cluster via Livy.

syedhassaanahmed /azure-kafka-spark-adls

Azure ARM template to deploy Kafka and Spark clusters in same VNet with ADLS

angadsingh /airflow-hdinsight

HDInsight provider for Airflow

angadsingh /airflow-ditto

An airflow DAG transformation framework

hau-mal /articles

BigData Blog articles

AdamPaternostro /Azure-HDInsight-ARM-Template

Creates an HDInsight cluster that has an external Hive metastore and access to Azure Data Lake Store

AfonsoFeliciano /Azure-Data-Factory-for-Data-Engineers

Repositório do curso de Azure Data Factory for Data Engineers - Project Covid 19

AdamPaternostro /Azure-Databricks-HDInsight-Hive-Metastore

How to share an HDInsight Hive Metastore with Azure Databricks

kcm117 /jupyter_local_hdispark_config

Configure local jupyter with HDInsight Spark cluster

DivyanshCh39 /E-commerce_Data_Pipeline

A production-grade PySpark ETL/ELT pipeline that ingests, validates, cleanses, normalises, and enriches large-scale e-commerce transactional data — deployable on local Spark, Databricks, AWS EMR, Azure Synapse, and HDInsight

anirudhgupta22 /Microsoft-Azure-HDInsight

Short documentation on Microsoft's Azure HDInsight

kcheeeung /hive-testbench

TPC-DS benchmark for experimenting with Apache Hive at any data scale