This dbt package captures metadata, artifacts, and test results so you can detect anomalies, monitor data quality, and build metadata tables. It powers Elementary OSS and feeds the wider context layer used by Elementary Cloud’s full Data & AI Control Plane.
data-pipeline-monitoring 开源项目推荐(11 个)
data-pipeline-monitoring 话题在 GitHub 上没有填写简介,这里按 Star 数汇总最相关的热门仓库。
热门项目 全部 11
GitHub 共 11 个仓库,已全部展示Easiest way to monitor asynchronous data pipelines
Real-Time M-Pesa Transaction Streaming Pipeline built using modern data engineering technologies to ingest, process, stream, and analyze transaction data in real time. Demonstrates event-driven architecture, stream processing, data pipelines, and scalable analytics for fintech applications.
Building a next-generation hybrid data pipeline architecture that combines the power of Microsoft Fabric, Azure Cloud, and Power BI. This pipeline is engineered to tackle the challenges of real-time data ingestion, multi-layered processing, and analytics, delivering business-critical insights.
Logging for pandas
DataBridge Quality Control
This Project demonstrates the Technology shift in Automobile Firm to resolve the data engineering challenge of manual data ops. AWS Cloud Services implemented here as: S3 bucket for lake storage incoming batches, Lambda Python Script for automating the validation function call and Glue Crawler to generate relational table with successful testing.
The OpenWeatherMap Data Pipeline Engineering Project collects real-time weather data from multiple cities, processes it through a robust ETL pipeline, and generates insightful visualizations to reveal patterns and trends in temperature, humidity, and wind conditions
Every thing about designing installing and implementing data pipelines to include kafka zookeeper hadoop If you enjoy my content please consider supporting what I do Thank you.
Analyzed flight delay data using Python and Power BI to identify delay patterns across airlines and airports.
Pantomath — independent third-party profile of a public API surface, by API Evangelist. Pantomath is an AI-powered Data Operations Center that monitors, manages, and automatically resolves issues across an organization's entire data analytics ecosystem. The platform combines 24/7 automated data monitoring, cross-platform data lineage and impact ana
关于这个话题
- 清单取自 GitHub 话题页并按 Star 数排序,每次展示前 11 个项目;原始页面见 https://github.com/topics/data-pipeline-monitoring。
- 该话题在 GitHub 上共有 11 个仓库, 本站收录的是其中最热门的 11 个,不是全量列表。
- Star / Fork 每日自动刷新一次,实时数据以 GitHub 为准。
- 当前 11 个项目累计 669 Star,覆盖 5 种主要语言,数据更新于 2026-11-07。
- 中文介绍来自 GitHub 官方话题说明(github/explore)的机器翻译,可点「查看原文」对照;译文缺失时会先展示原文。