Skip to content

opendatadiscovery/awesome-data-catalogs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

91 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Awesome Data Discovery and Observability Awesome

This repository contains a curated list of awesome data catalogs and observability platforms that help you discover, manage, and observe data in your organization.


Contents: Existing Data Discovery and Observability Solutions

OSS Data Catalogs Proprietary Monocloud DCs Proprietary Observability Tools Other Proprietary DCs
πŸ“™ Amundsen πŸ“’ Google DC πŸ” Monte Carlo πŸ“• Alation
πŸ“™ DataHub πŸ“’ Azure DC πŸ” Databand πŸ“• Atlan
πŸ“™ Marquez πŸ” Datafold πŸ“• Collibra
πŸ“™ Atlas πŸ” Ataccama πŸ“• DataGalaxy
πŸ“™ CKAN πŸ” DataKitchen Open Source Data Observability πŸ“• Informatica
πŸ“™ Magda πŸ“• Stemma
πŸ“™ OpenDataDiscovery πŸ“• Talend
πŸ“™ OpenMetadata πŸ“• Select Star
πŸ“™ Meta#Grid
πŸ“™ Grai

High-Level Feature Comparison

Tool Specification -Based Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observ- ability Column-level lineage Data collaboration
Alation ❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ❌ ❌
Amundsen ❌ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ ❌ ❌ ❌ ❌ ❌
Ataccama ❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ❌ ❌
Atlan ❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ βœ”οΈ βœ”οΈ
Atlas ❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ ❌ ❌ ❌ ❌ ❌
Azure DC ❌ βœ”οΈ ? βœ”οΈ ❌ ❌ ? ❌ ❌ ❌ ❌
CKAN ❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ❌ ❌ ❌ ❌
Collibra ❌ βœ”οΈ ? βœ”οΈ ❌ ❌ ? ❌ ❌ ❌ ❌
DataGalaxy ❌ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ ❌ βœ”οΈ βœ”οΈ ? ?
Databand ❌ ? ? ? ❌ ? ? ? βœ”οΈ ❌ ❌
Datafold ❌ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌
DataHub βœ”οΈ details βœ”οΈ βœ”οΈ βœ”οΈ βœ” βœ” βœ” βœ” ❌ βœ” ❌
Google DC ❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ ? ❌ ❌ ❌ ❌
Informatica ❌ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ? ❌
Magda ❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ❌ ❌ ❌ ❌
Marquez OpenLineage βœ”οΈ ❌ βœ”οΈ ? ❌ ❌ ❌ ❌ βœ”οΈ ❌
Monte Carlo ❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌
Select Star ❌ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ βœ”οΈ ❌ βœ”οΈ βœ”οΈ
OpenDataDiscovery ODD Specification βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ ❌ βœ”οΈ
OpenMetadata JSON Schema βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ ❌ βœ”οΈ βœ”οΈ
Stemma ❌ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ ? βœ”οΈ ❌ ❌ ❌
Talend ❌ βœ”οΈ ? βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ❌ ❌
Meta#Grid ❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ not yet ❌ ❌ ❌ βœ”οΈ
Grai Grai Schemas βœ”οΈ ❌ βœ”οΈ ❌ βœ”οΈ βœ”οΈ ❌ ❌ βœ”οΈ βœ”οΈ

Definitions:

  • Specification-based - uses an open standard for collecting metadata to allow efficient time-to-discovery and federating data catalogs
  • Search-based - allows to search for data assets
  • Network-based - provides rich context about data asset ownership
  • Lineage-based - provides lineage for all entities the solution operates
  • Federation - the ability to map multiple data catalogs into a single UI to avoid repeated data collection.
  • ML 1st citizen - operates ML entities on a high level - you can use them as any other data assets.
  • Data Quality - includes mature data quality assurance tools.
  • End-to-end lineage - data lineage that includes all data assets used in the organization across all its data catalogs and ML tools.
  • Column-level lineage - data lineage with column level granularity
  • Data collaboration - provides possibility to bring together data from various internal and external sources to unlock combined data insights

πŸ“™ Open-Source Data Catalogs

Amundsen

Website | GitHub Maintenance

A popular open-source data catalog for metadata management and data discovery originated from Lyft. Created by Amundsen maintainers, Stemma provides a managed version of an enterprise data catalog, inspired by Amundsen.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ ❌ ❌ ❌ ❌ ❌
More features
  • Strategy: Push
  • UX personalization: No
  • AI autowiring: No
  • Rich data profiling: No
  • Recommendations: Yes
  • Schemas, Description: Yes
  • Complex schemas: No
  • Data preview: Yes
  • Column statistics: Yes
  • Data owner: Yes
  • Top data users: Yes
  • Change notifications:No
  • Change feed: No
  • Deployment:
  • Supported data sources: Hive, Redshift, Druid, RDBMS, Presto, Snowflake

DataHub

Website | GitHub Maintenance

DataHub is an open-source data catalog enabling data discovery, data observability and federated governance that originated from LinkedIn and is commercially offered by Acryl Data as a cloud-hosted SaaS offering.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability
βœ”οΈ details βœ”οΈ βœ”οΈ βœ”οΈ βœ” βœ” βœ” βœ” ❌
More features
  • Strategy: Push, Pull
  • Customizable metadata model: Yes. The metadata model can be declared using the open-source Pegasus language, and is interoperable with JSONSchema and Avro
  • Rich data profiling: Yes
  • Recommendations: Yes
  • Schemas, Description: Yes
  • Complex schemas: Yes
  • Data preview: Yes
  • Column statistics: Yes
  • Data owner: Yes
  • Top data users: Yes
  • Lineage impact analysis: Yes
  • Change notifications: Yes
  • Change feed: No
  • Automation: Yes
  • UX personalization: No
  • Deployment: docker-compose / Kubernetes with Helm, or using Acryl Data's SaaS offering
  • Supported data sources:
    • Snowflake
    • BigQuery
    • Redshift
    • Hive
    • Athena
    • Postgres
    • MySQL
    • SQL server
    • Trino
    • Delta Lake
    • S3
    • Looker
    • PowerBI
    • Tableau
    • Mode
    • Metabase
    • Redash
    • Superset
    • Airflow
    • Great Expectation
    • dbt
    • Feast
    • SageMaker
    • Glue
    • Kafka
    • Nifi
    • Okta
    • LDAP
    • Slack
    • There's 50+ integrations - see the docs for the latest.

Marquez

Website | GitHub Maintenance

Marquez is an open-source data catalog for collection, aggregation, and visualization of a data ecosystem’s metadata originated from WeWork.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
OpenLineage βœ”οΈ ❌ βœ”οΈ ? ❌ ❌ ❌ ❌ βœ”οΈ ❌
More features
  • Strategy: Push
  • UX personalization: No
  • AI autowiring: No
  • Rich data profiling: No
  • Recommendations: No
  • Schemas, Description: Yes
  • Complex schemas: No
  • Data preview: Yes
  • Column statistics: No
  • Data owner: Yes
  • Top data users: ?
  • Change notifications: No
  • Change feed: No
  • Deployment:
  • Supported data sources: S3, Kafka

Atlas

Website | GitHub Maintenance

Apache Atlas is an open-source data catalog for metadata collection, governance, and data democratization.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ ❌ ❌ ❌ ❌ ❌
More features
  • Strategy: Push
  • UX personalization: No
  • AI autowiring: No
  • Rich data profiling: No
  • Recommendations: No
  • Schemas, Description: Yes
  • Complex schemas: No
  • Data preview: No
  • Column statistics: No
  • Data owner: No
  • Top data users: ?
  • Change notifications: Yes
  • Change feed: No
  • Deployment:
  • Supported data sources:HBase, Hive, Sqoop, Kafka, Storm

CKAN

Website | GitHub Maintenance

CKAN is an open-source data catalog for data management, powering data portals for govenments and enterprises.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ❌ ❌ ❌ ❌
More features
  • Strategy: Push
  • UX personalization: No
  • AI autowiring: No
  • Rich data profiling: No
  • Recommendations: ?
  • Schemas, Description: ?
  • Complex schemas: ?
  • Data preview: ?
  • Column statistics: ?
  • Data owner: ?
  • Top data users: ?
  • Change notifications: ?
  • Change feed: ?
  • Deployment:
  • Supported data sources:

Magda

Website | GitHub Maintenance

Magda is an open-source data catalog that features data discovery, metadata enrichment, and federation, focused on geodata.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ❌ ❌ ❌ ❌
More features
  • Strategy: Push via UI
  • UX personalization: No
  • AI autowiring: No
  • Rich data profiling: No
  • Recommendations: No
  • Schemas, Description: Yes
  • Complex schemas: No
  • Data preview: Yes
  • Column statistics: No
  • Data owner: Yes
  • Top data users: ?
  • Change notifications: No
  • Change feed: No
  • Deployment:
  • Supported data sources: Mostly geodata

OpenDataDiscovery

Website | GitHub Maintenance

First open-source data discovery and observability platform. ODD Platform is based on ODD Specification.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ ❌ βœ”οΈ
More features
  • Strategy: Push/Pull
  • UX personalization: No
  • Rich data profiling: Yes
  • Data collaboration: Yes
  • Schemas, Description: Yes
  • Complex schemas: Yes
  • Data preview: Yes
  • Column statistics: Yes
  • Data owner: Yes
  • Change notifications: Yes
  • Change feed: Yes
  • Metadata versioning: Yes
  • SaaS: Yes
  • Third-party integrations: Dbt, Great Expectations, and Prefect
  • Supported data sources: Airflow, Athena, AzureSQL, BigQuery, Clickhouse, Databricks, DeltaLake, Druid, DynamoDB, Fivetran, Glue, Hive, Kafka, Looker, MariaDB, MlFlow, MSSQL, MySQL, Oracle, Postgres, Presto, Redash, Redpanda, Redshift, Snowflake, Tableau, and Vertica

OpenMetadata

Website | GitHub Maintenance

OpenMetadata is the all-in-one platform for data collaboration, discovery, governance, lineage, and quality that lets you focus on building and analyzing.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ ❌ βœ”οΈ βœ”οΈ
More features
  • Strategy: Push/Pull
  • UX personalization: No
  • Rich data profiling: Yes
  • Data collaboration: Yes
  • Schemas, Description: Yes
  • Complex schemas: Yes
  • Data preview: Yes
  • Column statistics: Yes
  • Data owner: Yes
  • Change notifications: Yes
  • Change feed: Yes
  • Metadata versioning: Yes
  • SaaS: Yes
  • Third-party integrations: Dbt, Great Expectations, and Prefect
  • Supported data sources: Airbyte, Airflow, Athena, AzureSQL, BigQuery, Clickhouse, Dagster, Databricks, DB2, DeltaLake, Druid, DynamoDB, Fivetran, Glue, Glue, Hive, Kafka, Looker, MariaDB, Metabase, MlFlow, Mode, MSSQL, MySQL, NiFi, Oracle, Postgres, PowerBI, Presto, Redash, Redpanda, Redshift, Salesforce, SingleStore, Snowflake, Superset, Tableau, Trino, and Vertica

Meta#Grid

Website | GitHub | Docs Maintenance

Meta#Grid is an open source data catalog for metadata management. It is designed to help small and large organizations create an inventory of their data silos and connect between different technologies. Through a multi-client system, with granular permissions system, Meta#Grid can be used in consulting companies (with diverse clients and projects) as well as in data mesh organizations. It grows with the requirements of the demand.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ not yet ❌ ❌ ❌ βœ”οΈ
More features
  • Strategy: Push, Pull
  • UX personalization: No
  • AI autowiring: No
  • Rich data profiling: No
  • Recommendations: Yes
  • Schemas, Description: Yes
  • Complex schemas: Yes
  • Data preview: No
  • Column statistics: No
  • Data owner: Yes
  • Top data users: No
  • Change notifications: Yes
  • Change feed: Yes
  • Deployment:
  • Supported data sources: Hive, Redshift, Druid, RDBMS, Presto, Snowflake

Grai

Website | GitHub | Docs Maintenance

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
Grai Schemas βœ”οΈ ❌ βœ”οΈ ❌ βœ”οΈ βœ”οΈ ❌ ❌ βœ”οΈ βœ”οΈ
More features
  • Strategy: Push, Pull
  • Customizable metadata model: Yes. The metadata model can be flexibly extended or modified as needed.
  • Rich data profiling: No
  • Recommendations: No
  • Schemas, Description: Yes
  • Complex schemas: Yes
  • Data preview: No
  • Column statistics: No
  • Data owner: Yes
  • Top data users: No
  • CI Integration: Yes
  • Lineage impact analysis: Yes
  • Change notifications: Yes
  • Change feed: Yes
  • Automation: Yes
  • UX personalization: Yes
  • Deployment: docker-compose / Kubernetes with Helm, or using Grai SaaS offering
  • Supported data sources:
    • Snowflake
    • BigQuery
    • Redshift
    • Postgres
    • MySQL
    • dbt
    • Slack
    • ... many others see the docs for a full list.

πŸ“• Proprietary Data Catalogs

Collibra

Website | GitHub

Collibra is an enterprise data catalog that helps to discover and understand data that matters and drive impactful insights from it.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ? βœ”οΈ ❌ ❌ ? ❌ ❌ ❌ ❌
More features
  • Strategy: Push
  • UX personalization: Yes
  • AI autowiring: ?
  • Network-based: No
  • Rich data profiling: ?
  • Supported data sources:

Informatica

Website | GitHub

Informatica is an enterprise data catalog that provides AI-powered data discovery engine to scan and catalog data assets.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ? ❌
More features
  • Strategy: Push
  • UX personalization: ?
  • AI autowiring: ?
  • Network-based: Yes
  • Rich data profiling: Yes
  • Supported data sources:

Alation

Website | GitHub

Alation is a collaborative data catalog that helps companies to drive value and business impact from their data.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ❌ ❌
More features
  • Strategy: Push
  • UX personalization: Yes
  • AI autowiring: No
  • Network-based: No
  • Rich data profiling: No
  • Supported data sources:

Atlan

Website | GitHub

Atlan is a modern data catalog offering data discovery, data profiling, data quality, data lineage and data governance.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ βœ”οΈ βœ”οΈ
More features
  • Strategy: Pull
  • UX personalization: ?
  • AI autowiring: ?
  • Network-based: No
  • Rich data profiling: ?
  • Supported data sources: Presto, Deequ, Atlas, Airflow, Hudi

DataGalaxy

Website | GitHub

DataGalaxy is a modern data catalog offering data discovery, data profiling, data quality, data lineage and data governance.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ ❌ βœ”οΈ βœ”οΈ ? ?
More features

Stemma

Website

Stemma is a fully managed data catalog powered by the open-source data catalog Amundsen that helps data teams have total trust in their data.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ ? βœ”οΈ ❌ ❌ ❌
More features
  • Strategy: Push
  • UX personalization: No
  • AI autowiring: No
  • Network-based: No
  • Rich data profiling: No
  • Supported data sources:

Talend

Website | GitHub

Talend is a data catalog that helps enterprises power critical business descisions with trusted data.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ? βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ❌ ❌
More features
  • Strategy: Push
  • UX personalization: Yes
  • AI autowiring: ?
  • Network-based: ?
  • Rich data profiling: Yes
  • Supported data sources:

Select Star

Website

Select Star is an intelligent data discovery platform that automatically analyzes and documents your data. Select Star provides an easy to use data portal that everyone can use to find and understand data.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ βœ”οΈ ❌ βœ”οΈ βœ”οΈ
More features
  • Strategy: Pull
  • AI autowiring: Yes
  • Network-based: Yes
  • Rich data profiling: No
  • ER Diagram generation: Yes
  • Role & Policy based access control: Yes
  • Popularity & usage: Yes
  • Description & Tag propagation: Yes
  • Data preview: Yes
  • Data owners: Yes
  • Top data users: Yes
  • UX personalization: No
  • Supported data sources:
    • Snowflake
    • BigQuery
    • Redshift
    • Postgres
    • Looker
    • PowerBI
    • Tableau
    • Mode
    • Sigma
    • Sisense
    • Metabase
    • Looker Studio
    • DBT Cloud & Core
    • Slack

πŸ“’ Monocloud Data Catalogs

Google Cloud Data Catalog

Website | GitHub

Google Cloud Data Catalog is a fully managed, scalable metadata management service in Google Cloud's Data Analytics family of products.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ ? ❌ ❌ ❌ ❌
More features
  • Strategy: Pull
  • UX personalization: ?
  • AI autowiring: ?
  • Network-based: No
  • Rich data profiling: No
  • Supported data sources:

Azure Data Catalog

Website

Azure Data Catalog is a fully managed, enterprise-wide metadata catalog that makes data asset discovery straightforward.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ? βœ”οΈ ❌ ❌ ? ❌ ❌ ❌ ❌
More features
  • Strategy: Pull
  • UX personalization: ?
  • AI autowiring: ?
  • Network-based: ?
  • Rich data profiling: ?
  • Supported data sources:

πŸ” Data Observability Platforms

DataKitchen Open Source Data Observability

Website

DataKitchen's Open Source Data Observability Products are full featured with Apache 2.0 license. Data breaks. Servers break. Your toolchain breaks. Ensure your team is the first to know and the first to solve with visibility across and down your data estate. Save time with simple, fast data quality test generation and execution. Trust your data, tools, and systems end to end.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ βœ”οΈ ❌ βœ”οΈ
More features
  • Strategy: Full featured, with UI for singlue user. Enterprise version for teams
  • UX personalization: No
  • AI autowiring: DataOps TestGen data quality verification tool that does five main tasks: (1) data profiling, (2) new dataset screening and hygiene review, (3) AI/algorithmic generation of data quality validation tests, (4) ongoing production testing of new data refreshes and (5) continuous periodic monitoring of datasets for anomalies
  • Network-based: Data Journey based
  • Rich data profiling: 51 characteristics, with UI
  • Supported data sources: Snowflake, Redshift, Tableau, Synapse, Postgres, Tableau, PowerBI, Airflow, Fivetran, Databricks, dbt, Databricks Azure Data Factory, SSIS, Synapse Pipelines, ADF-managed Airflow, Google Composer, AWS S3, Qlik Sense, Amazon Managed Workflows for Apache Airflow, Talend Cloud, Azure Functions (via Event Hub), Azure ADLS/Blob Storage (via Event Hub)

Monte Carlo

Website

Monte Carlo is a data observability tool that helps to increase trust in data by eliminating or preventing data downtime.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌
More features
  • Strategy: Pull
  • UX personalization: ?
  • AI autowiring: ?
  • Network-based: ?
  • Rich data profiling: ?
  • Supported data sources: Snowflake, Hive, Kafka, Looker, Redshift, Tableau, Big Query, Airflow, Fivetran, Presto, Mode, Periscope, Databricks, Glue, dbt, Chartio, Spark, AWS, S3, data.world, Google Cloud Platform

Databand

Website | GitHub

Databand is an observability platform that helps data engineers identify and troubleshoot pipeline issues and data quality problems.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ ? ? ? ❌ ? ? ? βœ”οΈ ? ?
More features
  • Strategy: Push
  • UX personalization: ?
  • AI autowiring: ?
  • Network-based: ?
  • Rich data profiling: ?
  • Supported data sources:

Datafold

Website | GitHub

Datafold is a data monitoring and observability platform that gives you confidence in your data quality through diffs, profiling, and anomaly detection.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ βœ”οΈ βœ”οΈ ❌ ❌ βœ”οΈ ❌ βœ”οΈ ? ?
More features
  • Strategy: Push
  • UX personalization: ?
  • AI autowiring: ?
  • Network-based: ?
  • Rich data profiling: ?
  • Supported data sources:

Ataccama

Website | GitHub

Ataccama is an enterprise data catalog and observability tool featuring data profiling and data quality management, designed for data professionals.

Based on Open Standard Search-based Network-based Lineage-based Federation ML 1st Citizen Data Quality End-to-end Lineage Observability Column-level lineage Data collaboration
❌ βœ”οΈ ❌ βœ”οΈ ❌ ❌ βœ”οΈ ❌ ❌ ❌ ❌
More features
  • Strategy: Pull
  • UX personalization: Yes
  • AI autowiring: No
  • Network-based: No
  • Rich data profiling: Yes
  • Supported data sources:

Back to top