PDX disk-version

[slhuang]

Is there any performance benchmark on PDX for disk-based setting?

[lkuffo]

Hi Silu,
Not yet! It is in our roadmap, but not our immediate focus.

Under this setting we would probably need some smarter approach to leverage RAM space as much as possible.

A quick thought would be to store only the vertical block in RAM (that's only 25% of the data that is already 8-bit per dimension) and the horizontal block in Disk (only accessed on the remaining candidates).

This is just an idea. Probably there is a better way. But we will eventually work on this.

If you have any other ideas we would be happy to hear or even collaborate in a project to implement/benchmark this! (Also on the filtering part of the story)

Best,
Leonardo K.

[slhuang]

Thanks, Leonardo!

We’ve just kicked off PDX. Once we have a deeper understanding and some hands-on results, we’ll circle back. We’d love to explore collaboration once we have concrete ideas!

Best,
Silu