This post aims to cover our experience running Presto in a local environment with the ability to query Amazon S3 and other S3 Compatible Systems. We will: Describe the components needed and how to configure them. Provide a dockerized environment you could run. Show an example of running the provided environment and querying a publicly …
The Quick Guide for Running Presto Locally on S3 Read More »
Introducing the concept of metadata catalogs and explaining the benefits and pains of using Hive Metastore and AWS Glue
This tutorial aims to give you a fast start with lakeFS and use it’s git-like terminology in spark. It covers the following: Quick start to install lakeFS using Docker Compose. How to create a repository, add files to it, create a branch and make changes to the repository using spark jobs. How to review changes …
lakeFS is an open source platform that delivers resilience and manageability to your existing object-storage based data lake. With lakeFS you can build repeatable, atomic and versioned data lake operations – from complex ETL jobs to data science and analytics.
© Copyright 2022 | All Rights Reserved | Privacy Policy | Terms of Use
Design by hello.
