Apache Spark OpenLineage
TL;DR
Integrate, catalog, and visualize Apache Spark lineage in Atlan.
Your AI can read this via Docs MCPcurl -fsSL "https://docs.atlan.com/install-docs-mcp" | bashConnect
Discovery
Lineage
Browser Extension
Self-deployed Runtime
Enrichment
Popularity
Run status
Overview: Capture lineage from Apache Spark jobs in Atlan. Gain visibility into data transformations, dependencies, and governance for your Spark applications.
Get started
Follow these steps to connect and capture Apache Spark lineage in Atlan:
References
- What does Atlan crawl from Apache Spark?: Detailed list of Spark lineage metadata that Atlan can extract and visualize.
Troubleshooting
- Troubleshooting connectivity: Solutions for common issues encountered when connecting Atlan to Apache Spark, including permissions and network problems.