Why LLMs will be always Terrible at Software Architecturedevforth.io3 points·by dotnot·vor 2 Monaten·0 comments
LLM Terminology explained simply: Weights, Inference, Effective sequence lengthdevforth.io5 points·by dotnot·vor 4 Monaten·1 comments
Real-world GPT-OSS-20B benchmark on L4, L40S and H100 (latency, tokens/SEC)devforth.io1 points·by dotnot·vor 5 Monaten·0 comments
dotnot·vor 4 Monaten·discussNice readme example, I would also like to see time of execution for these tasks, I mean how much time for handling filters adds comparing to non using it