Skip to main content

Test step overview

An optional step to validate your datasets before deploying to production.

Jon Tam avatar
Written by Jon Tam
Updated over 3 months ago

In this step, you may optionally run an end-to-end validation of your configured dataset to a test destination prior to activating your data product to production. This test can give you more confidence that you will receive your data in your production target destination.

Enable a test

If you would like to test data before deploying to production destinations, toggle on this option in this step. If you'd prefer to skip the test, you may click Skip to Destinations.

Create new test destination

If your organization has not run this test step before, click the Create Test Destination button to set up a new test destination. Follow the prompts in the Destination Connections guide to complete the setup of this test destination. Supported methods include Snowflake, BigQuery, GCS, S3, Azure Blob, SFTP and FTP.

Search connections

When at least one test destination is created, you can use the Select Existing Test Destination dropdown to quickly locate and select the correct test destination for this step.

Deploy to test

When a test destination is selected, you may click Deploy to Test to begin simulating production data with an end-to-end validation. When this begins, you will see that the test deployment is in progress and an event console to display the key steps that take place for this test.

Note that a successful test deployment means that your test pipeline run will occur when the next schedule runtime arrives (based on your configured schedule). When the run occurs and data is delivered to your test destination, you will see this status on the Health Dashboard for this dataset. In the future, we will show the test pipeline run statuses in the event console.

Next steps

After the test deployment is successful, click Next: Destinations to select your production destination(s) for your regular, active deliveries.

Did this answer your question?