Vollo SDK – low latency streaming inference of ML models on FPGA platforms(vollo.myrtle.ai)

1 pointsby unprovable2 mesi fa1 comments

vollo.myrtle.ai

Vollo SDK – low latency streaming inference of ML models on FPGA platforms

https://vollo.myrtle.ai/latest/introduction.html

1 comments

This seems to get impressive results cross compiling models from torch (with vollo-torch) into FPGA friendly formats. Speedups look quite impressive...