sherlockxu

9 miesięcy temudiscuss

Seems there’s still some confusion around what DeepSeek-OCR really does. Learn about the model, Contexts Optical Compression, and its impact on LLMs here: https://www.bentoml.com/blog/deepseek-ocr-contexts-optical-c...

sherlockxu

12 miesięcy temudiscuss

Thanks. We just added the example.

sherlockxu

12 miesięcy temudiscuss

Thanks. We have updated the image to make it more accurate.

sherlockxu

w zeszłym rokudiscuss

Hi everyone. I'm one of the maintainers of this project. We're both excited and humbled to see it on Hacker News!

We created this handbook to make LLM inference concepts more accessible, especially for developers building real-world LLM applications. The goal is to pull together scattered knowledge into something clear, practical, and easy to build on.

We’re continuing to improve it, so feedback is very welcome!

GitHub repo: https://github.com/bentoml/llm-inference-in-production

sherlockxu

Submissions

Open Source LLM Statistics and Trends (2026)

[untitled]

The Chinese finance whizz whose DeepSeek AI model stunned the world

Where to Buy or Rent GPUs for LLM Inference: The 2026 GPU Procurement Guide

What Is InferenceOps

How to Beat the GPU CAP theorem in AI Inference

Meta's benchmarks for its new AI models are a bit misleading

Kai Scheduler: Kubernetes Native scheduler for AI workloads at large scale

OpenAI study finds links between ChatGPT use and loneliness

Survey shows 65% of organizations are still establishing their AI foundations

comments