data-lineage-observer
Observe data pipelines through OpenLineage events and lineage catalogs (Marquez, DataHub, OpenMetadata) to answer where a dataset comes from, what depends on it and whether it is fresh. Reads RunEvents (START, COMPLETE, FAIL, facets schema, columnLineage, errorMessage, outputStatistics) emitted by Airflow, dbt, Spark, Flink or Dagster, walks the graph for impact and root cause, finds orphan datasets, traces personal data column by column and checks freshness SLAs from a JSONL export.
When to use
Use when the user asks to "what breaks if I change this table", "why is this dashboard stale", "where does this column come from", "set up OpenLineage for Airflow", "which datasets are orphaned", or when a data quality incident needs a producer and a timeline. In French "analyse d'impact sur une table", "lineage des donnees", "pourquoi la donnee est perimee".
Inputs and tools
The skill takes the request of the user in natural language: its frontmatter declares no argument. It declares no allowed-tools: the tools available are those of the agent that loads it, under the tool policy of the project.
Reference
| Field | Value |
|---|---|
| Name | data-lineage-observer |
| Category | Data |
| Version | Not declared |
| Licence | Not declared |
| Allowed tools | Not declared |
| Plugins | - |
| Source | catalog/navin/skills/data-lineage-observer/SKILL.md |
| Digest | sha256:19337139c5e8f16145225a8ea4dcbccc7ab042768b695f84a437a114ec035b46 |
skill_md_digest | sha256:8af91a5d86a028a15506f1d1f458ff99b3a2b9e5dd27d4d5848425e0123afa4a |
| Emoji | 🧬 |
Bundled files
| Path | Count |
|---|---|
catalog/navin/skills/data-lineage-observer/examples | 2 |
catalog/navin/skills/data-lineage-observer/references | 3 |
catalog/navin/skills/data-lineage-observer/scripts | 2 |
Frontmatter
Every field of the SKILL.md frontmatter, with the value of the source:
| Field | Value |
|---|---|
name | data-lineage-observer |
description | Observe data pipelines through OpenLineage events and lineage catalogs (Marquez, DataHub, OpenMetadata) to answer where a dataset comes from, what depends on it and whether it is fresh. Reads RunEvents (START, COMPLETE, FAIL, facets schema, columnLineage, errorMessage, outputStatistics) emitted by Airflow, dbt, Spark, Flink or Dagster, walks the graph for impact and root cause, finds orphan datasets, traces personal data column by column and checks freshness SLAs from a JSONL export. Use when the user asks to "what breaks if I change this table", "why is this dashboard stale", "where does this column come from", "set up OpenLineage for Airflow", "which datasets are orphaned", or when a data quality incident needs a producer and a timeline. In French "analyse d'impact sur une table", "lineage des donnees", "pourquoi la donnee est perimee". |
metadata.navin.emoji | 🧬 |
metadata.navin.category | data |