Check with formula
Function and purpose of the operation¶
The Check with formula operation allows you to use an SQL formula to run checks on the rows present in the dataset.
Operation behaviour¶
The following scenarios may occur during execution:
- Rows comply with the formula: the operation is successful.
- Rows do not comply with the formula: the operation returns a warning, the system displays in the audit the error message along with the details of the top 10 rows in the dataset that contain anomalies.
IMPORTANT: If the DTP is launched from the cockpit and anomalies are detected, the system generates a report file of the anomalies found. For further details see DTP Report.
If the Dataset to be checked is the following:
Dataset¶
| Category | Product | Price | Currency |
|---|---|---|---|
| Electronics | Smartphone | 699 | USD |
| Fashion | Sneakers | USD | |
| Home | Coffee Maker | 89 | USD |
| Toys | Puzzle Game | USD |
Example 1: check with formula that complies with the rows involved
Formula specified on the operation page¶
CURRENCY = 'USD'
The operation is successful, all rows have USD as currency and no anomaly.
Example 2: check with formula that does not comply with at least one row
Formula specified on the operation page¶
PRODUCT LIKE 'S%'
The operation flags rows that do not comply with the formula with anomaly.
The data processing ends with a warning highlighting in the audit the top 10 rows that do not comply with the formula:
| Category | Product | Price | Currency |
|---|---|---|---|
| Home | Coffee Maker | 89 | USD |
| Toys | Puzzle Game | USD |