Best practice
Appending the uploaded files’ original row numbers can help when manually reviewing or resolving validation errors.
It’s often easier to say ‘there’s a missing expiry date in row 17’, rather than ‘there’s a missing expiry date in policy number x,
certificate number y, transaction number z’.
To append the original row number to the data, add the following operations as the first items in the first stage.
-
Row Number
This writes a column of row numbers.
-
Remove Rows
Use ‘Rows with less than [n] columns’ to remove subtotals or metadata above/below the main data.
-
Detect Headers
Disable the ‘Ignore inputs with named headers option’, since the Row Number operation will introduce a named header.
-
Map Column Headers
When it comes to mapping it to the target schema, detect Headers will have discarded the header for the Row Number column and replaced it with the first row number remaining after Remove Rows.
For example, if there were no rows removed above the data, the header would be called ‘1’. Map this to the name ‘Original Row Number’ in Map Column Headers, so it's easier to interpret when you view the data.