As an Editor or Admin at your organization, you may need to create new source or destination connections as part of the data product onboarding process. Follow the steps below to set up a new connection and ensure it’s ready for use in your data products.
Steps to create a new Source or Destination connection
To create a new connection -- Source or Destination -- complete these steps:
Navigate to the Connections page: Click on Connections in the top header menu.
Add a new connection: Click the Add Connection button.
Specify connection type: Choose whether this will be a Source or Destination connection.
Name your connection: Provide a unique, easily identifiable name for the connection. This will help you locate it in the Connection Settings table later.
You can access the newly created Source connection in the Connect step in Crux Studio. Click on the Existing Connections tab to use the new source connected for the new data product.
In the Destinations step in Crux Studio, you can access the newly created Destination connection to indicate where processed data should be delivered.
Select the connection method:
Choose the appropriate connection method (e.g., FTP, SFTP, GCS, S3, Snowflake, etc.).
Based on your selection, relevant connection fields (such as access credentials, keys, and other configuration details) will appear.
Access documentation: You’ll see a Documentation link within the connection panel. Clicking it will expand the panel, providing detailed guidance on the connection settings and instructions to help you configure it properly.
Complete Connection parameters: Fill in all required fields, including credentials or security details necessary to establish the connection.
Validate and Save Your Connection:
Click Add Connection to validate and save the new connection.
Crux will automatically load a test file for destination connections to ensure successful data transfers for backfill and new data updates.
Your new connection is ready for usage!
Your connection is now securely saved and encrypted in the Crux platform. You can now use this connection in your data products, whether it’s a source or destination. All sensitive details, like access credentials, are securely encrypted and stored.