Skip to main content

What does Atlan crawl from Astronomer/OpenLineage?

Once you have integrated Astronomer/OpenLineage, you can use connector-specific filters for quick asset discovery. The following filters are currently supported:

  • Status filter - last run status for an asset
  • Duration filter - last run duration for an asset

Atlan maps the following assets and properties from Astronomer/OpenLineage. Asset lineage support depends on the list of operators supported by OpenLineage.

DAGs

Atlan maps DAGs (directed acyclic graphs) from Astronomer/OpenLineage to its AirflowDAG asset type.

Source propertyAtlan property
schedule_intervalairflowDagSchedule
timetableairflowDagScheduleDelta
tagsairflowTags
versionairflowRunVersion
openlineageAdapterVersionairflowRunOpenLineageVersion
runidairflowRunName
run_typeairflowRunType
eventTimeairflowRunStartTime
eventTimeairflowRunEndTime
eventTypeairflowRunOpenLineageState
queryairflowTaskSql
group_idairflowTaskGroupName

Tasks

Atlan maps tasks from Astronomer/OpenLineage to its AirflowTask asset type.

Source propertyAtlan property
retriesairflowTaskRetryNumber
poolairflowTaskPool
pool_slotsairflowTaskPoolSlots
queueairflowTaskQueue
priority_weightairflowTaskPriorityWeight
trigger_ruleairflowTaskTriggerRule
operator_classairflowTaskOperatorClass
dag_idairflowDagName
conn_id`airflowTaskConnectionId`
sqlairflowTaskSql
tagsairflowTags
versionairflowRunVersion
openlineageAdapterVersionairflowRunOpenLineageVersion
runidairflowRunName
run_typeairflowRunType
eventTimeairflowRunStartTime
eventTimeairflowRunEndTime
eventTypeairflowRunOpenLineageState