Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
-
Updated
Jul 16, 2024 - Jupyter Notebook
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.
The open source high performance ELT framework powered by Apache Arrow
The Frank!Framework is an easy-to-use, stateless integration framework which allows (transactional) messages to be modified and exchanged between different systems.
Global Biotic Interactions provides access to existing species interaction datasets
Logstash - transport and process your logs, events, or other data
The Data Integration Platform for Unstructured Data powered by Language Models
Professional portfolio of data science and analytics projects - 2024.
Stellar ETL will enable real-time analytics on the Stellar network
Documentation for the TriplyDB and TriplyETL products
Airflow DAGs for the Stellar ETL project
(Spatial) data harmonisation with hale»studio (formerly HUMBOLDT Alignment Editor)
I used the ETL pipeline to examine crowdfunding. I took a deeper look into how various factors impact the effectiveness of the campaign.
SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).
ETL (Extract, Transform and Load) library for .NET
DataForge helps data teams write functional transformation pipelines by leveraging software engineering principles
Composable Semantic Transformation Pipelines
Developed an Extract, Transform and Load (ETL) program to extract dataset from various types of sources, applied various transformation techniques and loaded to various destination types.
Add a description, image, and links to the etl-framework topic page so that developers can more easily learn about it.
To associate your repository with the etl-framework topic, visit your repo's landing page and select "manage topics."