Always know what to expect from your data.

⚡ Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io

Library for Semi-Automated Data Science

⚡ Prevent downstream data quality issues by integrating the Soda Library into your CI/CD pipeline.

This repository contains an ETL pipeline that collects monthly electricity price and demand data by region in Australia. The source files are in CSV format and contain energy price and demand data at 30-minute intervals.