Webinar-Lottie.svg

lakeFS Acquires DVC, Uniting Data Version Control Pioneers to Accelerate AI-Ready Data

webcros.svg
lakeFS Named Cool Vendor™ in the 2026 Gartner® Coolest Vendor Innovations in Data Management

Data Engineering

Databricks Workflows and dbt Cloud Jobs

How to Leverage Databricks Workflows to Implement dbt Cloud Jobs

In a previous article, we explored how dbt and Databricks work together. We will now review a specific feature of dbt Cloud – dbt Cloud

Data Engineering Predictions 2024

Data Engineering in 2024: Predictions

This article was originally published on Datanami and is republished here with permission. As we officially kick off 2024, I realized I have a few thoughts on

Hive Metastore - Did we replace it with a vendor lock?

Hive Metastore – Did We Replace It With A Vendor Lock?

A data lake is often implemented using object storage, and our data resides in objects (files) that we can access through the storage API. Data

Shallow copy data: what is it

Shallow Copy For Data: What Are Your Options?

In the past five years, we’ve seen many concepts and new tools in the data ecosystem contribute to implementing engineering best practices in data. This

Databricks Auto Loader

Databricks Autoloader: Ingesting Data with Ease and Efficiency

You can ingest data files from external sources using a variety of technologies, from Oracle and SQL Server to PostgreSQL and systems like SAP or

Introducing the lakeFS Python experience

Introducing The New lakeFS Python Experience

Since its inception, lakeFS shipped with a full featured Python SDK. For each new version of lakeFS, this SDK is automatically generated, relying on the

What is Databricks and How Does It Unify the Power of Data Science and Engineering?

What is Databricks and How Does It Unify the Power of Data Science and Engineering?

Data-driven decision-making has become the foundation of business operations across every type of company, no matter the size or industry. Large volumes of data flow

Unlocking Insights with Databricks Notebooks

Unlocking Data Insights with Databricks Notebooks

Databricks Notebooks are a popular tool for interacting with data using code and presenting findings across disciplines like data science, machine learning, and data engineering.

Tech note: Iceberg Data Diff

Tech Note: Iceberg Data Diff

Back in June we happily announced that lakeFS ♥️ Iceberg.  Since then our Iceberg support has been growing.  A new experimental feature now allows you

AWS Trino and lakeFS Integration

AWS Trino and lakeFS Integration

A Step-by-Step Configuration Tutorial Introduction In today’s data-driven world, organizations are grappling with an explosion in the volume of data, compelling them to shift away

Databricks Unity Catalog: A Comprehensive Guide to Streamlining Your Data Assets

Databricks Unity Catalog: A Comprehensive Guide to Streamlining Your Data Assets

As data quantities increase and data sources diversify, teams are under pressure to implement comprehensive data catalog solutions. Databricks Unity Catalog is a uniform governance

Jupyter Notebook & 10 Alternatives: Data Notebook Review for 2023

Jupyter Notebook & 15 Alternatives: Data Notebook Review [2026]

Key Takeaways The tech industry responded to the needs of data practitioners with various IDE solutions for developing code and presenting findings in a data

[hubspot type=form portal=8040338 id=9f5646ec-3e20-4568-9d6e-b82fca022065]