Israeli startup Treeverse is developing dataset copy management and version control for data pipeline builders with its open-source Lakefs product. Analytics and AI/ML data supply pipelines depend upon consistent, repeatable and reliable delivery of clean data sets extracted from source data lakes. Such pipelines are equivalent to software programs and they take effort and time …

Lakefs brings Git-like version control to virtual dataset copies Read More »

Data is the backbone of every business organization today, and its importance will only grow in 2023. There have been a lot of discussions lately about adopting version control practices for data. Many engineers believe that data version control is the obvious next step that would transform data pipelines from something that organizations maintain to …

Data Version Control: The Enabler Of Data Engineering Best Practices Read More »

It might sound counterintuitive, but an economic downturn can be the best time to implement data engineering best practices. Investing in an initiative like this might be the last thing on your mind right now, but as customer acquisition teams face challenges in the next few quarters, retaining existing customers will become a priority for …

Implementing Data Engineering Best Practices Read More »

Data is a core asset for every organization, whether it already serves business decision-making or will do so in the future. This is why cost-efficient data collection and storage is a priority for companies looking to reap benefits from this asset in the future. But a lot needs to be done before managers act on …

Treat Your Data As You Would Treat Your Product Read More »

Einat Orr, Ph.D, Co-founder and CEO of lakeFS recalls an instance where she and her co-founder, Oz Katz, were leading the engineering for SimilarWeb (NYSE: SMWB). As part of the data development process of their big-data product, which relied on eight petabytes of data on S3, they were running periodic data retention that deleted data …

lakeFS Best Promising Big Data Solution Provider 2022 Read More »

All systems used for production must be versioned. A single location where users can access the most recent data. An audit trail must be created for any resource that is often modified, especially when numerous users are making changes at once. To ensure everyone on the team is on the same page, the version control …

Top Data Version Control Tools for Machine Learning Research in 2022 Read More »

As the value and volume of data continues to surge across industries, the need to improve the management and reliability of open-source data analytics solutions is critical. Developed at the request of its open-source users, lakeFS Cloud relieves users from assigning internal resources to maintain the infrastructure for their extensive technology stacks. Treeverse CEO and …

LakeFS Open Source – interview with Einat Orr, Co-founder and CEO Read More »

On June 27, the company announced general availability of their service, LakeFS Cloud. Teams will be able to use it to follow the evolution of various versions of their data just as they do with different versions of their code.

Startup Treeverse on Wednesday introduced its LakeFS Cloud service, a managed offering that will provide organizations with versioning capabilities for cloud data lakes. The service is expected to be generally available on June 27, the vendor said. With a cloud data lake, users can store different types of data, but there is usually little or …

Treeverse set to launch LakeFS cloud data lake service Read More »

The volume of data that organizations handle is growing faster than their engineering capabilities. On top of being resource-consuming and expensive, hiring more engineers doesn’t always solve the problem. In fact, it might make things worse — the more people in a team, the greater the risk of misunderstandings. Optimizing existing processes is a proven …

Unlock The Full Business Value Of Data With A Better Engineering Process Read More »