Data Engineering
Filter by
Data lineage tools make it easier for teams to track the transfer of data across several systems, databases, and applications. Ultimately, this translates into better
- Iddo Avneri
Key Takeaways DataOps is an approach that aims to enhance collaboration among teams involved in data operations, including data engineers, data scientists, and stakeholders. The
- Idan Novogroder
What kind of tooling can you use to make data mesh work? Should you go after open-source or commercial solutions? There’s no single answer to
- Idan Novogroder
Data engineers are easily the unsung heroes of modern business operations. Just think of all the people who create and maintain the data pipelines and
- Idan Novogroder
Choosing between Databricks and Snowflake can be challenging for organizations navigating a modern data infrastructure. While both platforms are powerful in their own right, they
- Iddo Avneri
Since 2021 we’ve been releasing the annual State of Data Engineering Report, a compilation of all the relevant categories that have a direct impact on
- Einat Orr, PhD
Many businesses are dealing with increasing volumes of data spread over several databases and repositories across on-premises systems, cloud services, and IoT technology. This complicates
- Idan Novogroder
ETL testing is critical in integrating and migrating your data to a new system. It acts as a safety net for your data, assuring completeness,
- Iddo Avneri
Despite data technology advancements, many organizations still struggle to access outdated mainframe data. Most of the time, you’re looking at siloed data architecture that just
- Einat Orr, PhD
Data is the lifeblood of any business. It drives decision-making, powers strategies, and boosts customer relationships. However, due to the enormous volume of data collected
- Idan Novogroder
TL;DR: DataOps complexity arises from unclear R&Rs, a lack of standardization in interfaces, distributed technology complexities, and difficulties in implementing engineering best practices. The solution
- Einat Orr, PhD
lakeFS is a powerful solution for data version control that enables data practitioners to manage data as code using Git-like operations and achieve reproducible, high-quality
- Iddo Avneri
