Check missing keys
Function and purpose of the operation¶
The Check Missing Keys operation allows you to check whether the rows in a dataset have the same values as the source dataset on the columns indicated on the Matching Fields page.
To use this operation, the user must indicate at least one field relationship, or a condition column on which to run the check.
Note: If both source and target have a null value for a column used as a condition, the system treats them as two different rows. Therefore, the condition is not satisfied.
Operation behaviour¶
The following scenarios may occur during execution:
- No difference detected: the operation is completed successfully.
- Differences detected between datasets: the operation generates a warning. The system displays an error message in the audit and the detail of the top 10 rows present in the target dataset but not in the source dataset.
IMPORTANT: If the DTP is launched from the cockpit and there are differences, a report file of the anomalies found is created. For further details see DTP Report.
Example without differences
Dataset¶
| Category | Product | Price |
|---|---|---|
| Electronics | Laptop | 1329 |
| Home | Air Purifier | 199 |
| Books | Novel | 25 |
Matching Fields Table¶
| Target field | Source |
|---|---|
| Category | Category |
| Product | Product |
¶
Source Dataset¶
| Category | Product | Price |
|---|---|---|
| Electronics | Laptop | 1129 |
| Electronics | Bluetooth Speaker | 120 |
| Home | Air Purifier | 189 |
| Toys | Remote Control Car | 50 |
| Books | Novel | 18 |
If the operation is successfully completed, the system shows no differences.
Example with differences
Dataset¶
| Category | Product | Price |
|---|---|---|
| Electronics | Laptop | 1329 |
| Electronics | Smartphone | 800 |
| Toys | Puzzle Game | 15 |
| Home | Air Purifier | 199 |
| Books | Fantasy | 20 |
Matching Fields Table¶
| Target field | Source |
|---|---|
| Category | Category |
| Product | Product |
Source Dataset¶
| Category | Product | Price |
|---|---|---|
| Electronics | Laptop | 1129 |
| Electronics | Bluetooth Speaker | 120 |
| Toys | Puzzle Game | 20 |
| Toys | Remote Control Car | 50 |
| Books | Novel | 18 |
The data processing finds differences between the tables and ends with a warning highlighting the top 10 differences in the audit:
| Category | Product | Price |
|---|---|---|
| Electronics | Smartphone | 800 |
| Home | Air Purifier | 199 |
| Books | Fantasy | 20 |