Pipeline-parallel LLM inference across GPUs on separate machines(github.com)5 points·by ngaut·vor 23 Tagen·0 commentsgithub.comPipeline-parallel LLM inference across GPUs on separate machineshttps://github.com/leyten/shard0 commentsPost comment—