data-testing 开源项目推荐（78 个）

sodadata /soda-core

Data Contracts engine for the modern data stack. https://www.soda.io

re-data /re-data

re_data - fix data issues before your users & CEO would discover them 😊

posit-dev /pointblank

Data validation toolkit for assessing and monitoring data quality.

InfuseAI /piperider

Code review for data in dbt

LukaszLapaj /software-testing-resource-pack

Various files useful for manual testing and test automation etc.

fivetran /airflow-provider-great-expectations

Great Expectations Airflow operator

DataKitchen /data-observability-installer

Installer and quickstart for DataKitchen's open-source DataOps TestGen and DataOps Observability. Installs TestGen with Docker Compose or pip, Observability with Docker Compose.

re-data /dbt-re-data

re_data - fix data issues before your users & CEO would discover them 😊

akmalsoliev /Validoopsie

A simple and easy to use Data Validation library for Python.

data-catering /data-caterer

Test data management tool for any data source, batch or real-time. Generate, validate and clean up data all in one tool.

DataKitchen /dataops-testgen

Open-source data quality tool: profiles tables, generates data quality tests from the profiling results, and runs them on a schedule with freshness, volume, and schema monitoring. Web UI, REST API, and MCP server. 14 databases plus CSV, Parquet, and JSON files. Apache 2.0.

sodadata /soda-spark

Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes

sqlstack-io /sqlbuild

SQL transformation framework with custom compile-time checks, end-to-end testing and safe renames that keep your table history.

sodadata /soda-github-action

⚡ Prevent downstream data quality issues by integrating the Soda Library into your CI/CD pipeline.

shridhar1504 /Sales-Forecasting-Datascience-Project

Develop a data science project using historical sales data to build a regression model that accurately predicts future sales. Preprocess the dataset, conduct exploratory analysis, select relevant features, and employ regression algorithms for model development. Evaluate model performance, optimize hyperparameters, and provide actionable insights.

provero-org /provero

Declarative data quality engine. Define checks in YAML, run anywhere.

serialbandicoot /great-assertions

This library is inspired by the Great Expectations library. The library has made the various expectations found in Great Expectations available when using the inbuilt python unittest assertions.

jafeerr /spark-data-test

Spark Data Test - A PySpark-based automation testing utility to compare Spark DataFrames

andrjas /data_check

data and pipeline testing with and for SQL

DataBridgeTech /dbqctl

DataBridge Quality Control