Operations
Atlan crawls and manages the following data quality operations and results from Snowflake.
Once you have enabled data quality on your connection, Atlan can perform data quality operations and retrieve results from your Snowflake environment.
CUD operations for rules
When creating, updating, or deleting data quality rules:
Component | Details |
---|---|
Procedure | Atlan invokes the MANAGE_DMF stored procedure in Snowflake |
User | Atlan DQ User |
Role | atlan_dq_service_role |
Supported action types
Action | Description |
---|---|
ATTACH_DMF | Attach a data metric function to a table |
DETACH_DMF | Remove a data metric function from a table |
SUSPEND_DMF | Pause execution of a data metric function |
RESUME_DMF | Resume execution of a data metric function |
UPDATE_SCHEDULE | Modify the execution schedule |
CREATE_DMF | Create a new data metric function |
Procedure response
MANAGE_DMF
provides only an acknowledgment response indicating successful execution
Test SQL operations
For custom SQL rules, Atlan validates and tests SQL statements:
Component | Details |
---|---|
Procedure | Atlan triggers the MANAGE_DMF procedure for test SQL operations |
User | Atlan DQ User |
Role | atlan_dq_service_role |
Supported action types
Action | Description |
---|---|
EXECUTE_SQL | Run custom SQL for testing |
VALIDATE_SQL_PERMISSIONS | Verify SQL permissions |
Procedure responses
Action | Response |
---|---|
VALIDATE_SQL_PERMISSIONS | Returns acknowledgment confirming permission validity |
EXECUTE_SQL | Returns a scalar numeric result from executing the custom user-defined SQL statement, following rigorous validation |
Crawling
Atlan periodically crawls data from Snowflake to update rule results.
Target tables
Table | Purpose |
---|---|
ATLAN_DQ.STORE.DQ_RULE | Rule definitions |
ATLAN_DQ.STORE.DQ_RULE_RESULT | Execution results |
Outcome
- Crawled data populates Atlan's internal representation of rule execution results.