The configuration of most operations can be copied and pasted all at once to another operation.
To copy: open an operation and with no fields selected click ctrl+c (Win) or cmd+c (Mac).
To paste: open an operation of the same type and click ctrl+v (Win) or cmd+v (Mac). This will add the copied config below any existing columns.
If you’ve built a long pipeline, or have a lot of data, it can take a few minutes to run. If you’re adding stages to the end of this pipeline, you probably just want to test the effect of changes to that stage without running the whole pipeline.
To do this, export the output from the previous stage to the Data Repo. Bring this output into a new pipeline and construct the new stage in there, allowing you to rapidly test changes to your configuration. When you’re done, copy the configuration back into the main pipeline.
A helpful trick to identifying how a value progresses without executing a pipeline is to add a Map Values operation in various stages of the pipeline. On larger datasets, Map Values may take a few moments to parse all possible values.
To refresh a reference dataset with new data, drag and drop the new data into the preview of the dataset.
If a reference dataset name is updated, the file name will update automatically across the system, wherever it is used.
Whenever a filterable data grid is shown, press ‘F’ to toggle between hiding and showing the filter bar.