benchmark

SealedFGA Benchmark

This directory contains the benchmark for SealedFGA as discussed in the paper.

Running the benchmark

For running the benchmark yourself, you can either use the provided image file or build the image yourself.

Using the provided image file

Due to GitHub's size constraints, the image file is only included in the Zenodo release here and could be outdated.

The docker image is provided in the current directory: sealedfga-benchmark_latest.image.tar

You can load it and make it available as sealedfga-benchmark:latest by running:

docker load -i sealedfga-benchmark_latest.image.tar

Building the image yourself

You can build the image yourself and make it available as sealedfga-benchmark:latest by running ./build-benchmark-container.sh in this directory.

Usage

Usage Examples:

1. Run runtime performance benchmark:

   docker run --rm sealedfga-benchmark:latest --operation=runtime-benchmark
   

2. Run compile-time performance benchmark:

   docker run --rm sealedfga-benchmark:latest --operation=compile-time-benchmark
   

3. Run complete benchmark suite:

   docker run --rm sealedfga-benchmark:latest --operation=full-benchmark
   

4. Export results to local directory:

   mkdir -p ./benchmark-results
   docker run --rm -v $(pwd)/benchmark-results:/output sealedfga-benchmark:latest --operation=export-results