Vollo SDK – low latency streaming inference of ML models on FPGA platforms(vollo.myrtle.ai)
vollo.myrtle.ai
Vollo SDK – low latency streaming inference of ML models on FPGA platforms
https://vollo.myrtle.ai/latest/introduction.html
1 comments
This seems to get impressive results cross compiling models from torch (with vollo-torch) into FPGA friendly formats. Speedups look quite impressive...