Data Transfer Metadata. Object model for standardising the structure of metadata applicable to building data transfers.
-
Updated
Apr 12, 2023
Data Transfer Metadata. Object model for standardising the structure of metadata applicable to building data transfers.
Udacity project 4 - salary predictions based on census data
EDA ,data-Pipelines, Randamforest, ROC curve
A code-first way to define Ploomber pipelines
This is a repository to document the entire process and learning throughout the Coursera's IBM Data Engineering Professional Certificate program.
Добыча золота - предсказание коэффициента обогащения
Building Data Pipelines for a data warehouse with Airflow and AWS
Data Engineering portfolio projects, resources used to study data tools...
An example Pachyderm ML pipeline using Nervana Neon
Code for my Master Thesis: How to detect and address changes in machine learning based data pipelines
Udacity Data Engeneering Nanodegree Program - My Submission of Project: Data Pipelines
🔎 Versionamento de queries para o datalake (ELT) | https://rj-smtr.github.io/maestro-docs/infra/maestro-bq/
This project implements a real-time event streaming pipeline for a music streaming service, inspired by Spotify Wrapped and Billboard charts. The pipeline is powered by Apache Airflow, Apache Kafka, dbt, Docker, GCP, Spark-Streaming, and Terraform.
Demonstration of Apache Airflow as one of the data science tools
A set of plugins (mappers, sinks, etc.) for Numaflow pipelines
Learn the basics of Apache Kafka® from leaders in the Kafka community with these video courses covering the Kafka ecosystem and hands-on exercises.
Sense which / how many computers in a local area network (LAN) are on.
Data BootCamp Final Project - Data Streaming Platform
Add a description, image, and links to the data-pipelines topic page so that developers can more easily learn about it.
To associate your repository with the data-pipelines topic, visit your repo's landing page and select "manage topics."