HackerTrans
TopNewTrendsCommentsPastAskShowJobs

juliensalinas

no profile record

Submissions

[untitled]

1 points·by juliensalinas·geçen yıl·0 comments

Comparing GenAI Inference Engines: TensorRT-LLM, VLLM, HF TGI, and LMDeploy

1 points·by juliensalinas·geçen yıl·1 comments

comments

juliensalinas
·geçen yıl·discuss
Relying on GenAI for support like that without a human in the loop is a huge mistake...
juliensalinas
·geçen yıl·discuss
You can read the full comparison here: https://nlpcloud.com/genai-inference-engines-tensorrt-llm-vs...
juliensalinas
·geçen yıl·discuss
Sounds very cool. I'm curious how you manage to monitor Linkedin though. The only tool that seems capable of monitoring Linkedin is https://kwatch.io , so if you manage to achieve that too it's impressive.
juliensalinas
·2 yıl önce·discuss
Social listening on HN, Reddit, X... I used https://kwatch.io and jumped into the relevant conversations to mention my product.
juliensalinas
·3 yıl önce·discuss
Totally agree. Actually a couple of months ago Sam Altman even admitted that they had a very hard time doing proper "engineering" (meaning that they had the right team to create a very good LLM but not the right team to productionize and their models and APIs). Many people are actually finding the OpenAI API very unstable and do not plan to rely on OpenAI for their production workloads.
juliensalinas
·3 yıl önce·discuss
NLP Cloud (especially the Dolphin and Fine-tuned GPT-NeoX 20B models)