lakeFS is an open source project that provides the object storage a manageability layer with version control capabilities such as branching, committing, merging and using pre-commit and pre-merge hooks. This allows data engineers to manage the data lake securely, just like the code repository they manage. We are on a mission to simplify the lives of data engineers, data scientists and ML engineers who are transforming the world with data. We are a team of passionate data enthusiasts who love all things open source and aim to find creative solutions to big problems. Our biggest asset is our culture, which is based on open-minded team work as our top priority.
If you’re an experienced (5+ years) backend engineer who is passionate about building powerful dev tools that will disrupt the world of Data & AI – you belong with us.
What you'll do
BUILD OUR PRODUCT
We develop high end open-source solutions to the technical challenges we face when working to fulfill our mission. We work on everything from the infrastructure and the backend of a distributed system that lives in the cloud, through the user interface of the product, all the way to analyzing the feedback from customers and the market to build a product that fits our market.
We use a wide spectrum of languages: a backend written in Go, plugins for data engineering written in Scala, Python and in Java, a React GUI, multi cloud infrastructure like k8s, terraform and argocd. Wherever it makes sense we use existing technologies, including OpenAPI, RocksDB, and Apache Spark. And we also develop new technologies such as Graveler that differentiate our core platform. Our SaaS offering spreads on 3 Cloud Providers, offering the open-source core with paid features. It scales to billions of daily API calls while responding within milliseconds.
BUILD OUR TEAM
We are a trusted team. It is our responsibility to ensure you and others on the team all feel safe and trusted to do their jobs. This is a central value for us as the core developers of an open-source product.
Our job is to develop the system and also to maintain it in production, ensuring reliability, durability and performance so we can give our customers the best possible service.
- Proven experience (5 years) in backend development, preferably in a cloud-based environment
- Proficiency in at least one programming language such as Python, Go, Java, or similar
- Strong understanding of data structures, algorithms, and system design principles
- Familiarity with cloud platforms (AWS, Azure) and related services (S3, Blob Storage, etc.) is a plus
- Knowledge of containerization technologies (Docker, Kubernetes) is a plus
- Excellent problem-solving skills and a proactive approach to handling challenges
- Ability to work in an agile, fast-paced environment and collaborate effectively within a team
About the company
Treeverse is the company behind the open source project lakeFS. It was founded by data engineering professionals (Dr. Einat Orr and Oz Katz) with a long track record of innovating and delivering bleeding edge technology, and is backed by top tier investors (NVP, Zeev Ventures, Dell Technologies Capital).