Apache Spark OpenLineage

Overview: Capture lineage from Apache Spark jobs in Atlan. Gain visibility into data transformations, dependencies, and governance for your Spark applications.

---

Get started

Follow these steps to connect and capture Apache Spark lineage in Atlan:

1. Integrate the connector

---

References

• What does Atlan crawl from Apache Spark?: Detailed list of Spark lineage metadata that Atlan can extract and visualize.

Troubleshooting

• Troubleshooting connectivity: Solutions for common issues encountered when connecting Atlan to Apache Spark, including permissions and network problems.