Pipeline-parallel LLM inference across GPUs on separate machines(github.com)5 points·by ngaut·23 dagen geleden·0 commentsgithub.comPipeline-parallel LLM inference across GPUs on separate machineshttps://github.com/leyten/shard0 commentsPost comment—