For an optimal experience, provide your email below and one of our lifeguards will send you a link to start swimming in the lake!
The tech industry responded to the needs of data practitioners with various IDE solutions for developing code and presenting findings in a data science and machine learning context. One of the go-to solutions today is Jupyter Notebook, an open-source tool that has gained a lot of traction among data science folks and beyond. Although Jupyter …
Jupyter Notebook & 10 Alternatives: Data Notebook Review [2023] Read More »
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines. It’s the easiest way to transform any Python function into a unit of work that can be observed and orchestrated. Prefect offers several key components to help users build and run their data pipelines, including Tasks and Flows. With …
Prefect + lakeFS: How to Troubleshoot Data Pipelines and Reproduce Data Read More »
If you work with a smaller dataset or do one-off jobs, the way you manage backfills isn’t that crucial. But what if you face constantly growing datasets with billions to trillions of records? Your backfilling data strategy will have a much bigger impact. When dealing with modern data pipelines on such a scale, it’s key …
Backfilling Data: A Foolproof Guide to Managing Historical Data Read More »
Create a Dev/Test Environment for Data Pipelines Using Spark and Python in this LIVE WEBINAR -
Register here
Join our community of experts:
introduce yourself, share your knowledge and discover best practices from fellow peers
