Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.
-
Updated
Jul 16, 2024 - Go
Database replication platform that leverages change data capture. Stream production data from databases to your data warehouse (Snowflake, BigQuery, Redshift) in real-time.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
The open source high performance ELT framework powered by Apache Arrow
Flink CDC is a streaming data integration tool
Airbyte connectors (sources & destinations) + Airbyte CDK for JavaScript/TypeScript
SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
🧙 Build, run, and manage data pipelines for integrating and transforming data.
One framework to develop, deploy and operate data workflows with Python and SQL.
Python library designed to enhance the developer experience when working with AWS Glue ETL and Python Shell jobs. It reduces boilerplate code, increases type safety, and improves IDE auto-completion, making Glue development easier and more efficient.
Privacy and Security focused Segment-alternative, in Golang and React
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Data Reconnaissance - pull request review tool for dbt projects
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
Efficient data transformation and modeling framework that is backwards compatible with dbt.
Add a description, image, and links to the elt topic page so that developers can more easily learn about it.
To associate your repository with the elt topic, visit your repo's landing page and select "manage topics."