lakeFS Blog

Data Engineering

Data versioning as your ‘Get out of jail’ card – DVC vs. Git-LFS vs. dolt vs. lakeFS

Einat Orr, PhD.
July 31, 2022

Data Versioning at Scale: Solutions Overview Back when I was a 23-year-old student, I worked at an Israeli networking company as a BI analyst in the Operations department. My job revolved around modeling the company’s inventory which was quite costly and needed optimization.  At some point, I attended a meeting of the company’s management. When …

Data versioning as your ‘Get out of jail’ card – DVC vs. Git-LFS vs. dolt vs. lakeFS Read More »

Data Engineering Machine Learning

Data+AI Summit 2022 Recap: Top 6 Industry trends and 9 major announcements!

Vino SD
July 25, 2022

It was 27th June 2022. San Francisco was bustling with 5000+ data folks from around the world to attend the Data & AI summit live after two years. Four days packed with tons of information from Keynotes, Speakers, Panels, Expo booths and Databricks trainings. Flurry of new product announcements followed. lakeFS cloud launch, Delta lake …

Data+AI Summit 2022 Recap: Top 6 Industry trends and 9 major announcements! Read More »

Data Engineering

Proudly announcing lakeFS Cloud

Einat Orr, PhD., Oz Katz
June 27, 2022

What is lakeFS? As data practitioners, we use many different terms to talk about what we do – we call it business intelligence, analytics, data pipelines, or insights. But there’s one term that captures what we do really well: delivering products.  When we were leading a large R&D organization, we couldn’t help but wonder about …

Proudly announcing lakeFS Cloud Read More »

Data Engineering

LakeFS Introduces a New Approach to Data Manageability and Reliability

The lakeFS team
June 26, 2022

lakeFS Cloud provides a Git-like repository for data lakes in a hosted version available in AWS Marketplace NEW YORK and TEL AVIV, June 22, 2022–lakeFS, the technology that brings streamlined data lifecycle management and version control to data lakes, is announcing lakeFS Cloud, a fully managed SaaS version of its open-source technology. The new hosted …

LakeFS Introduces a New Approach to Data Manageability and Reliability Read More »

Data Engineering

7 Winning Habits of Effective Data Engineers  

The lakeFS team
June 14, 2022

As organizations develop new product offerings and data streams, data engineers deal with the largest and most complex datasets ever. Add growing teams and new data orchestration tools into the mix, and you got yourself a pretty complicated data landscape. As the global cloud storage market grows, so does the complexity of managing data. This …

7 Winning Habits of Effective Data Engineers   Read More »

Data Engineering

Towards Effective DataOps

Paul Singman
May 11, 2022

Gain the confidence to mess with your datawithout making a mess of your data. “If it hurts, do it more often.” is a wise piece of advice that DevOps engineers often repeat. Unless you are a masochist, following this advice will naturally lead you to finding ways to make the process being repeated less painful.  …

Towards Effective DataOps Read More »

Data Engineering

Clearing the mess – How to ensure data quality with versioning

The lakeFS team
May 11, 2022

The last decade saw an unprecedented rise in the number of organizations that base their decisions and operations on data. The number of digital products that collect and process data and use it to fuel decision-making algorithms for enhancing future services is also growing at a very fast pace. That’s why data and data quality …

Clearing the mess – How to ensure data quality with versioning Read More »

Data Engineering

5 Painful mistakes data engineers make, and how to avoid them

The lakeFS team
June 6, 2022

Modern data engineering practices lead more and more organizations to a broader use of object stores. This happens due to the rising scale and complexity of the data that they manage – along with the growing variety of use cases that these data warehouses need to cater: from machine learning and algorithm development, to analytics …

5 Painful mistakes data engineers make, and how to avoid them Read More »

LakeFS

  • Get Started
    Get Started
  • lakeFS Cloud is live!

    Read the announcement
    +

    lakeFS Cloud
    is live!

    annopp-img