HackerTrans
TopNewTrendsCommentsPastAskShowJobs

MMMercy2

no profile record

Submissions

Fastest JSON Decoding for Local LLMs with Compressed Finite State Machine

lmsys.org
2 points·by MMMercy2·2 ปีที่แล้ว·0 comments

Fast and Expressive LLM Inference with RadixAttention and SGLang

lmsys.org
11 points·by MMMercy2·2 ปีที่แล้ว·0 comments

Databricks picks up MosaicML, an OpenAI competitor, for $1.3B

techcrunch.com
3 points·by MMMercy2·3 ปีที่แล้ว·0 comments

Chatbot Arena Leaderboard: Introducing MT-Bench and Vicuna-33B

lmsys.org
8 points·by MMMercy2·3 ปีที่แล้ว·0 comments

Building a Truly "Open" OpenAI API Server with Open Models Locally

lmsys.org
2 points·by MMMercy2·3 ปีที่แล้ว·0 comments

Chatbot Arena Leaderboard: OpenAI GPT-4 and Anthropic Claude Take the Lead

twitter.com
2 points·by MMMercy2·3 ปีที่แล้ว·0 comments

Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings

lmsys.org
50 points·by MMMercy2·3 ปีที่แล้ว·7 comments

Chatbot Arena: side-by-side battles between open LLMs

chat.lmsys.org
8 points·by MMMercy2·3 ปีที่แล้ว·0 comments

[untitled]

1 points·by MMMercy2·3 ปีที่แล้ว·0 comments

comments

MMMercy2
·3 ปีที่แล้ว·discuss
You can try the smaller 7B version.
MMMercy2
·3 ปีที่แล้ว·discuss
You can use this command to apply the delta weights. (https://github.com/lm-sys/FastChat#vicuna-13b) The delta weights are hosted on huggingface and will be automatically downloaded.
MMMercy2
·3 ปีที่แล้ว·discuss
They are the parameters of this large language model. There are 13B fp16 numbers.
MMMercy2
·3 ปีที่แล้ว·discuss
There are certainly some effective language model benchmarks; however, they are not well-suited for evaluating a chat assistant. Some projects employ human evaluation, while this blog post explores an alternative approach based on GPT-4. Both methods have their advantages and disadvantages, making this blog post an intriguing case study that can inspire the future development of more comprehensive evaluations.
MMMercy2
·3 ปีที่แล้ว·discuss
I am a Vicuna developer. We plan to release the weights once we have addressed all concerns and have a low-resource version of the inference code ready. We released the demo first to get some early feedback on the model.
MMMercy2
·3 ปีที่แล้ว·discuss
This project fine-tunes LLaMA on ShareGPT and gets competitive performance compared to Google's Bard.

https://vicuna.lmsys.org/
MMMercy2
·3 ปีที่แล้ว·discuss
It can do some basic coding. The code syntax highlighting looks cool.

> Do a quick sort in python

> Here's an example of a quicksort implementation in Python:

def quicksort(array): if len(array) <= 1: return array pivot = array[0] less = [x for x in array[1:] if x <= pivot] greater = [x for x in array[1:] if x > pivot] return quicksort(less) + [pivot] + quicksort(greater)