Crux

Build, test, and deploy model-ready data products instantly.

Introducing Sphere by Crux - Self Service

Chris Patiag

Start building data products with Sphere by Crux - Self Service

Self Service

Step-by-step guide to connect, profile, and deliver data to your target destinations with Crux.

Building your first data product

Supported data sources, file formats, and limitations for onboarding data with Crux.

Guidelines for supported sources, formats, and limitations

Learn about supported file formats and data processing available with Crux.

Supported file formats

File archive best practices: Keep it simple with single-Layer ZIP, TAR, and TAR.GZ files.

Supported archive file formats

Known issues and constraints as we continue to grow and improve the product.

Known Limitations

Automated declarative workflow generation for fast data onboarding.

Connect, analyze, and model remote data sources, generating Odin specifications in minutes.

Crux Studio

Establish a connection to your data source using a new or one of the available connections.

Connect step overview

Establish a connection to your data source using a new connection, custom connector, or available options.

Connect

Select files and file patterns for your data product.

Select data step overview

Establish a connection to your data source using a new connection, custom connector, or an exiting option.

Select data

Analyze and model selected data. Profile data, determine schema and other metadata; or skip profiling and deliver raw.

Model step overview

Learn about the steps involved in the modeling process.

Understanding the Model step

Learn how delimited normalization works in the data modeling process.

Normalization settings

Learn about how to onboard raw data formats

Deliver as raw

Model

Set up the schedule for ongoing data extractions to keep your data up-to-date.

Schedule step overview

Learn about the details of the dataset ingestion schedule.

Understanding Dataset Ingestion Schedule

Resolve issues associated with the dataset ingestion schedule or identifying supplier-declared schedule.

Troubleshooting Ingestion Schedule

Ensure data freshness with default deadlines, or customize your own to monitor data updates and receive alerts for missed or delayed deliveries.

Dataset deadlines

Set up the schedule for ongoing data extractions.

Schedule

An optional step to validate your datasets before deploying to production.

Test step overview

An optional step to validate your datasets before going live.

Test

Select one or more data destinations by creating new connections or connecting to existing options.

Destinations step overview

Set up production destinations for your data targets.

Destinations

Ensure smooth deployment by reviewing the final data product configurations and activating for regular deliveries.

Review & deploy

Final step before your dataset activation.

Review and deploy

Open Data Integration Nomenclature (ODIN) foundations.

Getting started with ODIN

Open Data Integration Nomenclature (ODIN)

ODIN

Install and begin using the cruxctl CLI utility.

Getting Started with cruxctl

Making updates and deploying datasets from the CLI tool

How to Validate and Deploy Datasets using cruxctl

Investigate logs to help root cause analyze your dataset issues

How to Retrieve Logs using cruxctl

cruxctl

Learn about the different types of connections and how to use them.

Connections overview

Connect with new data sources and data destinations.

Create new connections

Learn how to edit an existing source or destination connection.

Edit connections

Permanently delete connections to data sources and destinations.

Delete connections

Manage source and destination connections.

Connections

The raw data for your data product comes from a source. Connections to the source are required to obtain the data.

Source Connections

Follow our setup guide to connect your File Transfer Protocol (FTP) as a data source to Crux.

FTP Source Connection

Follow our setup guide to connect your SFTP connection as a data source to Crux.

SFTP Source Connection

Follow our setup guide to connect an Amazon S3 bucket as a data source for your Data Product.

S3 Source Connection

Follow our setup guide to connect a Google Cloud Storage (GCS) bucket as a data source for your Data Product.

GCS Source Connection

Connect to your data sources and manage your source connections

Sources

Once your data product is filtered, profiled, and scheduled for management, it is distributed to a destination for use.

Destination Connections

Follow our setup guide to connect your File Transfer Protocol (FTP) destination to Crux.

FTP Destination Connection

Follow our setup guide to connect an SSH File Transfer Protocol (SFTP) destination to Crux.

SFTP Destination Connection

Follow our setup guide to connect your Amazon S3 bucket to Crux.

S3 Destination Connection

Follow our setup guide to connect your Google Cloud Storage (GCS) bucket to Crux.

GCS Destination Connection

BigQuery is a managed, serverless data warehouse that enables scalable analysis over petabytes of data and supports querying using ANSI SQL.

BigQuery Destination Connection

Follow our setup guide to connect your Snowflake data warehouse to Crux.

Snowflake Destination Connection

Create and manage data destination connections

Find answers and get help from Intercom Support and Community Experts

This site employs cookies and other technologies that we and our third party vendors use to monitor and record personal information about you and your interactions with the site (including content viewed, cursor movements, screen recordings, and chat contents) for the purposes described in our Cookie Policy. By continuing to visit our site, you agree to our {websiteTermsLink}, {privacyPolicyLink} and {cookiePolicyLink}.

This site uses cookies and similar technologies ("cookies") as strictly necessary for site operation. We and our partners also would like to set additional cookies to enable site performance analytics, functionality, advertising and social media features. See our {cookiePolicyLink} for details. You can change your cookie preferences in our Cookie Settings.

We use cookies to make our site work and also for analytics and advertising purposes. You can enable or disable optional cookies as desired. See our {cookiePolicyLink} for more details.

Advertising cookies are set by our advertising partners to collect information about your use of the site, our communications, and other online services over time and with different browsers and devices. They use this information to show you ads online that they think will interest you and measure the ads' performance. Social media cookies are set by social media platforms to enable you to share content on those platforms, and are capable of tracking information about your activity across other online services for use as described in their privacy policies.

These cookies enable the website to provide enhanced functionality and personalisation. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies then some or all of these services may not function properly.

These cookies are necessary for the website to function and cannot be switched off in our systems.

These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site.

You have the right to opt out of the sale of your personal information. See our {cookiePolicyLink} for more details about how we use your data.

Your Privacy Choices

We use cookies to enhance your experience. You can customize your cookie preferences below. See our {cookiePolicyLink} for more details.

Cookie Settings

Empty Help Center

Uh oh. That page doesn’t exist.

Home

Search results

Disappointed

Neutral

Smiley

Thinking...

Searching through sources...

Analyzing...

Tickets submitted through the messenger or by a support agent in your conversation will appear here.