What does Atlan crawl from Hightouch?
Atlan crawls and maps the following assets and properties from Hightouch. Atlan establishes comprehensive lineage between your data warehouse sources and operational business tools by parsing Hightouch metadata.
- Hightouch models
- Hightouch syncs
- Column-level lineage between source and target systems
Atlan's Hightouch connectivity creates lineage flows that show how data moves from your warehouse through Hightouch models and syncs to operational business tools.
Models
Models define and organize the data that gets queried from source systems.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
name | name | asset profile and overview sidebar |
description | description | asset profile and overview sidebar |
createdAt | sourceCreatedAt | asset profile and properties sidebar |
updatedAt | sourceUpdatedAt | asset profile and properties sidebar |
Atlan supports two Hightouch model types:
- SQL Editor: Models defined with custom SQL queries. Atlan parses the SQL to establish upstream lineage to source tables and columns.
- Table Selector: Models that point directly to source tables. Atlan establishes lineage to the referenced table.
Syncs
Syncs define how queried results from models are mapped to destination systems.
| Source property | Atlan property | Where in Atlan |
|---|---|---|
name | name | asset profile and overview sidebar |
description | description | asset profile and overview sidebar |
status | flowStatus | asset filter and overview sidebar |
lastRunAt | flowRunId | overview sidebar |
createdAt | sourceCreatedAt | asset profile and properties sidebar |
updatedAt | sourceUpdatedAt | asset profile and properties sidebar |
Atlan focuses on Object-type syncs, which map model data to destination objects. Field mapping configurations establish column-level lineage between source and target fields.
Lineage establishment
Atlan establishes comprehensive lineage by parsing Hightouch metadata:
Upstream lineage (source to model)
- SQL Models: Parses SQL queries to identify referenced tables, views, and columns
- Table Models: Directly links to referenced source tables
- Column-level: Establishes source columns to model columns relationships where possible
Downstream lineage (model to destination)
- Field Mappings: Interprets sync configuration to link model columns to destination fields
- Standard Mapping: Direct field-to-field relationships
- Template Mapping: Parses Liquid templating to identify referenced source fields
See also
- Set up Hightouch: Configure authentication using Hightouch API key
- Crawl Hightouch: Configure and run the crawler to extract metadata from Hightouch