DataOps Poland: Optimizing Object Stores For Data with lakeFS

DataOps Poland is an exchange place of experience, concepts, and ideas from Data Engineering world. We will talk about Open Source projects, commercial ones and frameworks that will help working with Data.

DataOps Poland: Optimizing Object Stores For Data with lakeFS

DataOps Poland is an exchange place of experience, concepts, and ideas from Data Engineering world. We will talk about Open Source projects, commercial ones and frameworks that will help working with Data.

Description

The first problem faced with big data was the feasibility of processing data at such a high scale. In solving the scale problem, people developed technologies we know today like Kafka, Spark, Presto, Snowflake, etc.

Now the problem people face is one of manageability. People no longer ask if they can handle a dataset but rather: How can I move faster when developing data-intensive applications? How do I utilize all of my data and ensure it is high-quality?

Learn how lakeFS simplifies managing a data lake by enabling git-like operations over files in object storage. Workflows around experimentation, reproducing datasets, and guaranteeing data quality are simplified with the primitives provided by data source control. The result is a developer experience that is optimized for modern data lakes.

This event already happened. Watch the recording here!

 

LakeFS

  • Get Started
    Get Started