Tiers in the Cloud: How lakeFS caches immutable data on local-disk
Introduction We recently released the first version of lakeFS supported by Pebble’s sstable library – RocksDB. The release introduced a new data model which is now much closer to Git. Instead of using a PostgreSQL server that quickly becomes a bottleneck, committed metadata now lives on the object store itself. Early on we realized that …
Tiers in the Cloud: How lakeFS caches immutable data on local-disk Read More »