lakeFS Acquires DVC, Uniting Data Version Control Pioneers to Accelerate AI-Ready Data
Unless you’ve been living under a rock, you’ve probably heard of multimodal data and its integration, now a standard feature of modern data platforms. As systems ingest data ranging from structured tables to unstructured text, graphics, and streams, the difficulty shifts from data collection to data integration. What differentiates experimental pipelines from production-grade systems is […]
Scaling AI isn’t about building better models; it’s about building the system around them. Without consistency in data, workflows and governance, teams hit the same walls: A Center of Excellence (CoE) for Enterprise AI solves this by standardizing how AI is built, validated, and deployed – so teams can move faster without losing control. But
As AI adoption evolves and teams advance from scattered ML trial projects to running AI as a production system, they inevitably face the question of how to operate such a system reliably at scale. This is where an AI Center of Excellence (AI CoE) comes in. It’s an organizational and technical response to that shift:
Based on my presentation at PyData Global 2025 When we – engineers – hear the word “compliance,” we tend to roll our eyes. We want to build features, not fill out forms. But here’s good news: the exact same tools that help you debug your code can also keep you out of trouble. In this
2025 was a defining year for lakeFS. Across open source and Enterprise editions, we shipped major capabilities that expanded lakeFS from a powerful data versioning layer into a control plane for AI-Ready Data – spanning structured and unstructured data, multiple public and private clouds, and a growing ecosystem of analytics and ML engines. Here’s our
Sooner or later, every data team will reach a point where things stop working – whether it’s due to team growth, changing business requirements, or advancing pipeline complexity. When facing these issues, leaders start considering a different approach that perfectly balances centralized and decentralized organizational models. A Data Center of Excellence (DCoE) is a centralized
Apache Iceberg includes built-in table versioning to ensure that all changes to your data are logged, consistent, and recoverable. Instead of overwriting files or relying on task time, Iceberg saves each update as an immutable snapshot, ensuring that readers always see a consistent picture of the table, even during heavy writes. This boosts reliability by
It pays for organizations to treat their data like a product that works like a driving force behind innovation, efficiency, and competitiveness. While data quality is an important aspect, let’s not forget that companies operate in a rapidly changing environment – and their data needs to reflect this by quickly adapting. This is where data
When AWS Goes Down, Your Data Shouldn’t On October 20th, 2025, AWS experienced a significant outage centered in the us-east-1 region. What started as a DNS resolution issue affecting DynamoDB quickly cascaded into widespread failures across major services and applications. From gaming platforms like Fortnite and social apps like Snapchat to enterprise systems and IoT
Organizations looking to unlock the value from their data are bound to encounter the challenge of dealing with diverse datasets. This includes data in various formats, sources, structures, and semantics, such as structured databases and spreadsheets, as well as unstructured text, photos, and sensor outputs. Digital ecosystems will only become more complex, so the ability
Ask any data team, and you’ll quickly learn that nobody out there manages all the organization’s data in a single centralized location. Most teams operate across various clouds, locations, and platforms, facing increasingly fragmented, replicated, and decentralized data. This makes effective distributed data management an essential capability. Keep reading this article to explore the fundamental
TL;DR Software-only systems can be rerun from the source, but physics-bound workflows face a tougher challenge. Once a moment is gone, it’s gone. Sensor drift, hardware changes, and environmental uniqueness make it impossible to recreate the exact conditions. For audits, safety, and machine learning, you need full data provenance, including raw data, derived outputs, and
We use cookies to improve your experience and understand how our site is used.
Join our community of experts:
introduce yourself, share your knowledge and discover best practices from fellow peers
