Webinar-Lottie.svg

lakeFS Acquires DVC, Uniting Data Version Control Pioneers to Accelerate AI-Ready Data

webcros.svg
lakeFS Named Cool Vendor™ in the 2026 Gartner® Coolest Vendor Innovations in Data Management

Data Engineering

Data Version Control – A Data Engineering Best Practice You Must Adopt

Imagine the software engineering world before distributed version control systems like Git became widespread. This is where the data world is currently at. The explosion

Git for Data – What, How and Why Now?

Git, the Source Control, aka Code Version Control When we wish for “Git for Data”, we already know what code version control is, and that

Data Reproducibility and other Data Lake Best Practices

Overview Data changes frequently, making the task of keeping track of its exact state over time difficult. Oftentimes, people maintain only one state of their

4 Ways to Reduce Cloud Data Storage Costs

In the past year, words like recession, business slowdown and monetary cuttings are being heard more and more often. Not just in the economic press

How to Develop Spark ETL Pipelines in Isolation

Table of Contents Developing ETL pipelines – what it looks like today Developing and testing ETL pipelines is very complicated. Since you typically don’t want

lakeFS with DynamoDB – How Key Value Store is Used by lakeFS

This blog discusses advanced topics within lakeFS. If you are new to lakeFS, or would like to expand your knowledge of how lakeFS works, make

EPCOR Implements Write-Audit-Publish Framework for Data Pipelines with lakeFS

It is no secret that modern businesses run on big data. If your business was a car, big data would be the engine that powers

Top Data Engineering Conferences & Events You Don’t Want to Miss in the Fall of 2022!

As the Covid-19 pandemic loosens its grip on the world, we’re all eager to start travelling and meeting in person again. The great news is

Data Manageability: The revolution that is turning Data Trust into the New North Star

A few weeks ago, I was looking at a dashboard in our internal BI system. It’s a simple system. Redash over PostgreSQL that has just

Data Mesh

Data Mesh: What is it and What Does it Mean for Data Engineers?

Organizations have practically always needed data analytics, and they jumped on the analytics bandwagon as soon as the first computers appeared on the scene. In

Data Products

What is a Data Product? Examples & How to Build It

Key Takeaways Definition of data products: A data product is a tool or application that processes data to generate insights, enabling better decision-making, unlike “data

box of chocolate

Data versioning as your ‘Get out of jail’ card – DVC vs. Git-LFS vs. dolt vs. lakeFS

Data Versioning at Scale: Solutions Overview Back when I was a 23-year-old student, I worked at an Israeli networking company as a BI analyst in

[hubspot type=form portal=8040338 id=9f5646ec-3e20-4568-9d6e-b82fca022065]