Welcome to Sphere by Crux - Self Service!

These documentation pages will help you build model-ready data products to reduce costs, minimize risks, and accelerate time to value.

Overview

Sphere by Crux - SelfService empowers modern data engineering teams to rapidly create, test, and deploy model-ready data products. Crux helps you connect to the remote data source, select file patterns, model and schedule data, configure test and production destinations, validate and deploy data pipelines for ongoing deliveries. Crux technology encompasses the ODIN dataset specifications, the Crux application, including the Crux Studio, the cruxctl Command Line Interface (CLI), and the Crux Control Plane. This tool suite provides flexible control to onboard, monitor, and manage external data that scales with your business.

Key benefits of Sphere by Crux - Self Service

ODIN

🎯 Standardized dataset specification.

ODIN is an easy-to-use standard for declarative data delivery developed by and natively supported by Crux.

ODIN, Open Data Integration Nomenclature, helps define declarative state of your datasets and speed up development.

Key capabilities

Declarative syntax in a YAML format
Easy to create, read and write by humans and machines
Provides a nomenclature for delivery
Drives industry-standard for GitOps practices
Cloud and workflow management - platform agnostic

Benefits

Helps teams build datasets faster
Reduces maintenance efforts with simple, fast roll-back
Supports flexible representation of complex datasets
Reduces configuration drift
Fosters collaboration

Using Crux Studio, you can connect, analyze, and model remote data sources, generating Odin specifications in minutes

Crux Studio

🚀 Rapid workflow generation

With Crux Studio, you can automate declarative workflow generation with an intuitive UX/UI.

Crux Studio, a guided data onboarding wizard, makes selecting, profiling, and defining new datasets effortless without writing a single line of code. With Crux Studio, you can design data products and declarative dataset specifications in minutes by following these steps:

Key capabilities

Guided experience to create Odin-compliant datasets
AI file pattern detector
Support a wide range of data, including raw
Custom normalization settings
AI profiler
AI schedule and deadline recommendations

Benefits

Accelerated data onboarding without manual intervention
Automated, error-free declarative workflow generation
Intuitive, Odin-compliant YAML output

cruxctl

🛠️ Precise control over data pipelines

cruxctl is a Command Line Interface (CLI) to quickly onboard and manage datasets from your terminal through the dataset lifecycle

cruxctl is a command line utility that manages and deploys Odin datasets to the Crux Control Plane.

Key capabilities

Manage datasets and their configurations
Access dataset logs, events, track reruns of DAGs and dispatches
Validate and manage Odin specs and YAML configurations
Manage delivery deadlines
Check and manage dataset processing and dispatch health records

Benefits

Improved dataset control
Enhanced monitoring
Reduced errors in dataset configurations
Simplified deadline management
Proactive health management
Reduced downstream delays/downtime

Crux Control Plane

📈 Improve reliability & compliance

Crux Control Plane removes errors and manual intervention with real-time oversight over the declarative state.

Crux Control Plane helps facilitate creation, execution, and oversight of complex data pipelines.

Key capabilities

Facilitate creation of complex data
Automate and schedule datasets
Real-time monitoring and alerts
Provide telemetry and logging
Enforce compliance with declarative state

Benefits

Streamline complex pipelines
Enhance dataset reliability
Scale with growing dataset needs
Reduce manual effort and human error

Your data

The Crux domain model helps you organize and customize your data to improve your business decisions and processes. Connect to external data sources and build model-ready data products that include one or more datasets, tables, and table schemas.