Segcache: a memory-efficient and scalable in-memory key-value cache for small objects

This repo contains the code of Segcache described in the following paper:

• Segcache: a memory-efficient and scalable in-memory key-value cache for small objects.

Repository structure

• benchmarks: code for running the evaluation benchmarks
• src/storage/seg: implementation of Segcache
• other see Pelikan repo

Usage

Requirement

• platform: Mac OS X or Linux
• build tools: cmake (>=2.8)
• compiler: gcc (>=4.8) or clang (>=3.1)
• (optional) unit testing framework: check (>=0.10.0). See below.

Build

git clone https://github.com/Thesys-lab/Segcache.git
mkdir _build && cd _build
cmake ..
make -j

The executables can be found under _bin/ (under build directory)

To run all the tests, including those on ccommon, run:

make test

To skip building tests, replace the cmake step with the following:

cmake -DCHECK_WORKING=off ..

Run benchmarks

After building, you should have _build/bin/trace_replay_seg and _build/bin/trace_replay_slab which are the benchmarks for Segcache and Pelikan_twemcache. To run them, you can do

./trace_replay_slab trace_replay_slab.conf
./trace_replay_seg trace_replay_seg.conf

We provide example config to run the two benchmarks at benchmarks/config/examples/. Before using it, you need to change the options, specifically, you need to change trace_path to the path of your trace.

We release the five traces we use here. The traces are comparessed with zstd, you can use

zstd -d c.sbin.zst

to decompress, the raw traces are in binary format and can be directly consumed by the benchmark.

If you would like to use your traces, you can convert your trace into the following format, each request uses 20 bytes with the following format

struct request {
    uint32_t real_time, 
    uint64_t obj_id, 
    uint32_t key_size:8, 
    uint32_t val_size:24,
    uint32_t op:8,
    uint32_t ttl:24
}; 

License

This software is licensed under the Apache 2.0 license, see LICENSE for details.