Data Engineering
Filter by
One of the reasons behind the rise in data lakes’ adoption is their ability to handle massive amounts of data coming from diverse data sources,
- Iddo Avneri
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines. It’s the easiest way to transform any Python function
- Amit Kesarwani
There are several tools in the data version control space, all looking to solve similar problems. Two of the leaders are lakeFS and DVC. In
- Oz Katz
4 Metadata Management Challenges And How To Solve Them Modern data architectures support an increasing number and variety of business use cases. Product creation, tailored
- Einat Orr, PhD
In the real world, teams may have to deal with data that isn’t neatly organized into rows and columns. That’s especially true when you’re working
- Einat Orr, PhD
- Oz Katz
This post is a recap of a talk I gave at this year’s Data + AI Summit about why I believe the Rust Programming Language
- Oz Katz
- Idan Novogroder
Organizations need data governance for many reasons, not just to comply with a rising number of data privacy and protection rules, such as the GDPR
- Einat Orr, PhD
In the traditional setup, organizations had a centralized infrastructure team responsible for managing data ownership across domains. But product-led companies started to approach this matter
- Iddo Avneri
A step by step guide to the lakeFS Cloud playground environment In this document, you will learn the quickest way to get started with lakeFS,
- Iddo Avneri
lakeFS directly supports Apache Iceberg tables. Using straightforward table identifiers you can switch between branches when reading and writing data: lakeFS itself remains format agnostic,
- Robin Moffatt
