Enable most recent day scanning
Enable most recent day scanning to limit data quality rules to only the trailing 24 hours of data. This optimization makes monitoring faster and more efficient, especially for tables with years of historical data.
Prerequisites
- Data quality enabled on a Snowflake or Databricks connection
- A valid row creation timestamp column in your table
Enable most recent day scanning
-
Navigate to the table where you want to enable most recent day scanning.
-
Open the Data quality tab and select an existing rule, or create a new rule.
-
Expand the Advanced Settings section.
-
Enable the Run on the most recent day of data toggle.
-
In the Row creation timestamp dropdown that appears, select the column that indicates when rows were created.
Only columns with supported timestamp types appear in the dropdown.
-
Click Update to save the configuration.
The rule now scans only the most recent day of data based on the selected timestamp column.
See also
- Run on the most recent day of data: Reference guide for configuration options
- Most recent day scans: Understand how this optimization works
- Configure alerts: Set up notifications for rule failures