HackerTrans
TopNewTrendsCommentsPastAskShowJobs

MMMercy2

no profile record

Submissions

Fastest JSON Decoding for Local LLMs with Compressed Finite State Machine

lmsys.org
2 points·by MMMercy2·hace 2 años·0 comments

Fast and Expressive LLM Inference with RadixAttention and SGLang

lmsys.org
11 points·by MMMercy2·hace 2 años·0 comments

Databricks picks up MosaicML, an OpenAI competitor, for $1.3B

techcrunch.com
3 points·by MMMercy2·hace 3 años·0 comments

Chatbot Arena Leaderboard: Introducing MT-Bench and Vicuna-33B

lmsys.org
8 points·by MMMercy2·hace 3 años·0 comments

Building a Truly "Open" OpenAI API Server with Open Models Locally

lmsys.org
2 points·by MMMercy2·hace 3 años·0 comments

Chatbot Arena Leaderboard: OpenAI GPT-4 and Anthropic Claude Take the Lead

twitter.com
2 points·by MMMercy2·hace 3 años·0 comments

Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings

lmsys.org
50 points·by MMMercy2·hace 3 años·7 comments

Chatbot Arena: side-by-side battles between open LLMs

chat.lmsys.org
8 points·by MMMercy2·hace 3 años·0 comments

[untitled]

1 points·by MMMercy2·hace 3 años·0 comments

comments

MMMercy2
·hace 3 años·discuss
You can try the smaller 7B version.
MMMercy2
·hace 3 años·discuss
You can use this command to apply the delta weights. (https://github.com/lm-sys/FastChat#vicuna-13b) The delta weights are hosted on huggingface and will be automatically downloaded.
MMMercy2
·hace 3 años·discuss
They are the parameters of this large language model. There are 13B fp16 numbers.
MMMercy2
·hace 3 años·discuss
There are certainly some effective language model benchmarks; however, they are not well-suited for evaluating a chat assistant. Some projects employ human evaluation, while this blog post explores an alternative approach based on GPT-4. Both methods have their advantages and disadvantages, making this blog post an intriguing case study that can inspire the future development of more comprehensive evaluations.
MMMercy2
·hace 3 años·discuss
I am a Vicuna developer. We plan to release the weights once we have addressed all concerns and have a low-resource version of the inference code ready. We released the demo first to get some early feedback on the model.
MMMercy2
·hace 3 años·discuss
This project fine-tunes LLaMA on ShareGPT and gets competitive performance compared to Google's Bard.

https://vicuna.lmsys.org/
MMMercy2
·hace 3 años·discuss
It can do some basic coding. The code syntax highlighting looks cool.

> Do a quick sort in python

> Here's an example of a quicksort implementation in Python:

def quicksort(array): if len(array) <= 1: return array pivot = array[0] less = [x for x in array[1:] if x <= pivot] greater = [x for x in array[1:] if x > pivot] return quicksort(less) + [pivot] + quicksort(greater)