Atlan natively supports the Apache Hive metastore which allows you to seamlessly integrate your metadata with your Atlan Workspace.
You can set up a Hive integration with your Atlan workspace in 4 easy steps:
Select the Source aka Hive 😉
Provide your credentials ✍️
Set up your configuration 🗄️
Schedule automatic updates 🕑
Before you get started with integrating your Apache Hive with Atlan, you'll need some prerequisite information which will help establish a connection between Atlan and your Hive Account:
Hostname - Hostname is the IP address of the Hive server to which you are connecting.
Hive Server Port - is the number of the TCP port that the Hive server machine uses to listen for client connections. The default Hive server port is 10000
Hive Metastore Port - Server port used for accessing metadata about hive tables and partitions. The default Hive metastore port is 9083
AWS Access key & Secret Key - Access keys consist of an access key ID and a secret access key, which are used to sign programmatic requests that you make to AWS. Visit AWS documentation around Access keys to know more about access keys and how to create them.
Default Schema - The schema used to store the Hive table. If not sure, use
Once you have the prerequisite information listed in the section above, please follow the steps below to establish a connection and integrate Atlan with your Hive metastore.
Log into your Atlan Workspace
On the Home Screen, click on the "New Integration" button in the top right corner. You will see a Dialogue box with the list of sources available on your workspace
Select "Hive" from the list of options and click on "Next"
You will see an option to either select a pre-configured credential from the drop-down or to create a credential. To set up a new connection, click on the "Create Credential" button.
You will be required to fill in your Hive credentials. Below is an example of the credentials required: Hostname - 22.214.171.124 Hive server Port - 10000 Hive metastore port - 9083 Schema - default AWS Access key - AKIA5XXXXXXXXXXWIJUS AWS Secret key - R1xXXXXXXXXX5PEdHOUXXXXXXXX7Ooz47
Once you have filled in the details, click on "Next".
You will now be asked to fill in the details of your database and table. You can also choose the entire schema and table by selecting the checkbox. Below is an example - Add Schema - Sales Master Add Table - Daily Sales
Chose whether to run the crawler once or schedule it for a Daily, a Weekly, or a Monthly run. You would be asked to specify the time zone to trigger the run.
Click on "Create". Your connection is now created.
Congratulations, you have now integrated Atlan with your Hive metastore! 🎉
Once the integration setup is completed, you will be redirected to the Monitor tab for your Hive asset where you can monitor the progress.