Skip to main content

Operations

Atlan crawls and manages the following data quality operations and results from Snowflake.

Once you have enabled data quality on your connection, Atlan can perform data quality operations and retrieve results from your Snowflake environment.

CUD operations for rules

When creating, updating, or deleting data quality rules:

ComponentDetails
ProcedureAtlan invokes the MANAGE_DMF stored procedure in Snowflake
UserAtlan DQ User
Roleatlan_dq_service_role

Supported action types

ActionDescription
ATTACH_DMFAttach a data metric function to a table
DETACH_DMFRemove a data metric function from a table
SUSPEND_DMFPause execution of a data metric function
RESUME_DMFResume execution of a data metric function
UPDATE_SCHEDULEModify the execution schedule
CREATE_DMFCreate a new data metric function

Procedure response

MANAGE_DMF provides only an acknowledgment response indicating successful execution

Test SQL operations

For custom SQL rules, Atlan validates and tests SQL statements:

ComponentDetails
ProcedureAtlan triggers the MANAGE_DMF procedure for test SQL operations
UserAtlan DQ User
Roleatlan_dq_service_role

Supported action types

ActionDescription
EXECUTE_SQLRun custom SQL for testing
VALIDATE_SQL_PERMISSIONSVerify SQL permissions

Procedure responses

ActionResponse
VALIDATE_SQL_PERMISSIONSReturns acknowledgment confirming permission validity
EXECUTE_SQLReturns a scalar numeric result from executing the custom user-defined SQL statement, following rigorous validation

Crawling

Atlan periodically crawls data from Snowflake to update rule results.

Target tables

TablePurpose
ATLAN_DQ.STORE.DQ_RULERule definitions
ATLAN_DQ.STORE.DQ_RULE_RESULTExecution results

Outcome

  • Crawled data populates Atlan's internal representation of rule execution results.