Skip to main content

DATA_QUALITY_DETAILS table

The DATA_QUALITY_DETAILS table contains details for all data quality assets in Atlan, including Atlan-native data quality rules and third-party entities such as AnomaloCheck, SodaCheck, and MCMonitor.

Source tables

This table consolidates data from the following entity types: AnomaloCheck, SodaCheck, MCMonitor, DataQualityRule, DataQualityRuleTemplate.

For complete entity type definitions and properties, refer to the Atlan Developer documentation.

Columns

The DATA_QUALITY_DETAILS table includes the following columns:

ColumnDescription
guidThe asset's globally-unique identifier
asset_typeThe type of asset (for example, AnomaloCheck, SodaCheck, MCMonitor)
statusThe asset's status (for example, ACTIVE, DELETED)
source_urlThe source URL for this data quality check
anomalo_check_typeType of Anomalo check
anomalo_check_category_typeCategory type of the Anomalo check
anomalo_check_priority_levelPriority level of the Anomalo check
anomalo_check_statusMost recent status of the Anomalo check
anomalo_check_last_run_completed_atTimestamp when the Anomalo check was last run
anomalo_check_linked_asset_qualified_nameQualified name of the asset associated with the Anomalo check
soda_check_idIdentifier of the check in Soda
soda_check_definitionDefinition of the Soda check
soda_check_evaluation_statusMost recent status of the Soda check
soda_check_last_scan_atTimestamp when the Soda check was last run
soda_check_columnsList of columns associated with the Soda check
soda_check_assetsList of assets associated with the Soda check
mc_monitor_idIdentifier of the check in Monte Carlo
mc_monitor_typeType of Monte Carlo monitor
mc_monitor_rule_typeRule type of the Monte Carlo monitor
mc_monitor_priorityPriority level of the Monte Carlo monitor
mc_monitor_statusMost recent status of the Monte Carlo monitor
mc_monitor_rule_last_execution_atTimestamp when the Monte Carlo monitor was last run
mc_monitor_assetsList of assets associated with the Monte Carlo monitor
dq_rule_base_dataset_qualified_nameQualified name of the base dataset the rule is applied to
dq_rule_base_column_qualified_nameQualified name of the column the rule is applied to
dq_rule_dimensionDimension of the data quality rule (for example, completeness, accuracy)
dq_rule_template_nameName of the data quality rule template used
dq_rule_latest_result_computed_atTime (epoch) at which the latest rule result was evaluated
dq_rule_latest_resultLatest result for the rule's most recent execution
dq_rule_alert_priorityData quality rule's alert priority (for example, LOW, NORMAL, URGENT)
dq_rule_template_dimensionName of the dimension the rule template belongs to
dq_rule_template_metric_value_typeType of metric value returned by the rule (absolute, percentage, time, etc.)
dq_rulesData quality rules the template is attached to

Sample queries

Get all active failed DQ checks

Returns all currently active DQ checks that have a failure result, across all sources (Atlan native, Soda, Monte Carlo, Anomalo).

SELECT
guid,
asset_type,
status,
-- Anomalo fields
anomalo_check_type,
anomalo_check_status,
anomalo_check_last_run_completed_at,
anomalo_check_linked_asset_qualified_name,
-- Soda fields
soda_check_id,
soda_check_evaluation_status,
soda_check_last_scan_at,
-- Monte Carlo fields
mc_monitor_id,
mc_monitor_type,
mc_monitor_status,
mc_monitor_rule_last_execution_at,
-- Atlan native DQ fields
dq_rule_dimension,
dq_rule_latest_result,
dq_rule_alert_priority
FROM gold.data_quality_details
WHERE status = 'ACTIVE'
AND (
anomalo_check_status = 'fail'
OR anomalo_check_status = 'errored'
OR soda_check_evaluation_status = 'fail'
OR mc_monitor_status = 'ERROR'
OR dq_rule_latest_result = 'FAIL'
)
ORDER BY mc_monitor_rule_last_execution_at DESC NULLS LAST;

Get failed DQ checks by source system

SELECT
asset_type AS source_system,
COUNT(*) AS failed_checks
FROM gold.data_quality_details
WHERE status = 'ACTIVE'
AND (
anomalo_check_status = 'fail'
OR anomalo_check_status = 'errored'
OR soda_check_evaluation_status = 'fail'
OR mc_monitor_status = 'ERROR'
OR dq_rule_latest_result = 'FAIL'
)
GROUP BY asset_type
ORDER BY failed_checks DESC;

Join Atlan-native DQ rules to asset details

Combines Atlan-native DQ rule results with the ASSETS table to show which data assets have failing rules, their owners, and certification status.

SELECT
a.asset_name,
a.asset_qualified_name,
a.connector_name,
a.certificate_status,
a.owner_users,
dq.asset_type AS dq_source,
dq.dq_rule_dimension,
dq.dq_rule_alert_priority,
dq.dq_rule_latest_result
FROM gold.assets a
JOIN gold.data_quality_details dq
ON a.asset_qualified_name = dq.dq_rule_base_dataset_qualified_name
WHERE a.status = 'ACTIVE'
AND dq.status = 'ACTIVE'
AND dq.asset_type = 'DataQualityRule'
AND dq.dq_rule_latest_result = 'FAIL'
ORDER BY dq.dq_rule_alert_priority DESC;
Joining other DQ source types

The join key depends on the DQ source. For Anomalo checks, use dq.anomalo_check_linked_asset_qualified_name. For Soda and Monte Carlo, the linked assets are stored in array columns (soda_check_assets, mc_monitor_assets) and require unnesting.

Active vs deleted rules

Both active and deleted DQ rules are present in the table (retained for historical traceability). Always filter on status = 'ACTIVE' to see only current state. Deleted rules appear with status = 'DELETED'.

See also