When it comes to external data integration, timely access to updated data is crucial for making informed decisions. Crux ensures its customers receive data with an efficient dataset ingestion schedule timed with the supplier's updates.
What is the dataset ingestion schedule?
The dataset ingestion schedule refers to the specific times at which Crux checks the supplier's sources for any updates to the datasets. This process involves:
Regular Intervals: Crux operates on a predefined schedule, systematically contacting data suppliers at regular intervals. Depending on the nature of the data and the supplier's update frequency, this could be intraday, daily, weekly, monthly, yearly, or custom.
Automated Processes: The entire ingestion process is automated to ensure consistency and minimize the risk of human error. Crux's advanced algorithms and systems scan the suppliers' sources for new or updated data, ensuring that any changes are promptly identified and ingested into the system.
Supplier Coordination: Crux closely collaborates with data suppliers to align the dataset ingestion schedule with their update cycles, maximizing up-to-date data capture. This feature requires a Sphere by Crux - Managed Service subscription.
Benefits
Timely Updates: By adhering to a regular ingestion schedule, Crux ensures you receive the most recent data without delays. This is particularly important for sectors where data freshness is critical.
Enhanced Data Quality: Regularly checking for updates ensures accurate and reliable data by identifying and correcting discrepancies and outdated information.
Operational Efficiency: Automating the ingestion process reduces the manual effort required for data collection. This allows Crux to scale its operations efficiently, handling large volumes of data from multiple suppliers with ease.
Conclusion
Crux's dataset ingestion schedule ensures a seamless and reliable data experience. Crux maintains high data quality and reliability standards through regular checks and coordination with data suppliers to provide you with the freshest and most accurate data.
Learn more
If you are onboarding a self-service data product, visit the Schedule step overview to learn how to configure the ingestion schedule.
If setting up the schedule fails or produces unexpected deliveries, refer to the Troubleshooting ingestion schedule.