hadoop-hdfs 开源项目推荐（362 个）

seaweedfs /seaweedfs

SeaweedFS 是一个用于对象存储（S3）、文件系统和 Iceberg 表的分布式存储系统，旨在以 O(1) 磁盘访问和轻松的横向扩展处理数十亿个文件。

OBenner /data-engineering-interview-questions

超过2000个数据工程师面试问题。

Morphl-AI /MorphL-Community-Edition

MorphL Community Edition uses big data and machine learning to predict user behaviors in digital products and services with the end goal of increasing KPIs (click-through rates, conversion rates, etc.) through personalization

linkedin /dynamometer

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

AhmetFurkanDEMIR /Data-Engineering-Project-with-HDFS-and-Kafka

使用 Hadoop HDFS 和 Kafka 的数据工程项目

groda /big_data

大数据必备：Hadoop、MapReduce、Spark。探索Jupyter笔记本中的教程和演示——大多数都是独立且实时的，随时可点击运行。

IBM /sparksql-for-hbase

Learn how to use Spark SQL and HSpark connector package to create / query data tables that reside in HBase region servers

vim89 /datapipelines-essentials-python

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

maniram-yadav /Big_DataHadoop_Projects

Big data projects implemented by Maniram yadav

jarlor /TravelWebsite_BigDataAnalysis

旅游网站(携程网部分数据)大数据分析-hadoop课程设计(本科课设级别)

Smart-Shaped /chaM3Leon

By Smart Shaped s.r.l. (https://www.smartshaped.com/)

hokstack /hok-helm

HokStack - Run Hadoop Stack on Kubernetes

hadoop-sandbox /hadoop-sandbox

A fully-functional Hadoop Yarn cluster as docker-compose deployment.

SepehrImanian /ansible-hadoop-hdfs

Ansible Playbook For Setup Hadoop HDFS

torqbit /databox

Open source data infrastructure platform. Designed for developers, built for speed.

pfisterer /apache-hadoop-helm

Helm chart for Apache Hadoop using multi-arch docker images

ds2-lab /LambdaFS

λFS: an elastic, high-performance, serverless-function-based metadata service for large-scale distributed file systems (ACM ASPLOS'23)

Ren294 /Log-Analysis-Project

This project builds a scalable log analytics pipeline use Lambda architecture for real-time and batch processing of NASA server logs.

PChou /marayarn

Marathon on yarn

lucas91batista /twitter-hashtag-graph

Twitter + Flume + Hadoop (HDFS, MapReduce) + Neo4j + Pyhton