Translationaut

6 ay öncediscuss

The idea of the ethical reasoning dataset is not to erase specific content. It is designed to present additional thinking traces with an ethical grounding. So far, it is only a fraction of the available data. This doesn't solve alignment, and unethical behaviour is still possible, but the model gets a profound ethical reasoning base.

Translationaut

6 ay öncediscuss

There is this ethical reasoning dataset to teach models stable and predictable values: https://huggingface.co/datasets/Bachstelze/ethical_coconot_6... An Olmo-3-7B-Think model is adapted with it. In theory, it should yield better alignment. Yet the empirical evaluation is still a work in progress.

Translationaut

2 yıl öncediscuss

The authors propose a novel approach where checklists are automatically generated to systematically assess and guide LLM outputs, ensuring more comprehensive and reliable evaluations by LLMs. E.g. it increases in the frequency of exact agreements between LLM judgements and human preferences from 46.4% to 52.2%.

From my perspective it would be neat if the benchmarks would support more model types and not only the predominat GPTs, which only showed that they can relatively easy be scaled up, though it was never stated that they can model language better with the same resources (AFAIK).

Translationaut

2 yıl öncediscuss

Why do we need vectors for search anyway? The results are often unrelated to the query. Aren't therefore exact matches better? One could also annotate the corpus with related tags and hypothetical questions, if we need more results.

Translationaut

2 yıl öncediscuss

E.g. adapters, inference optimization and more (multilingual) models like https://huggingface.co/CohereForAI/aya-101

Translationaut

2 yıl öncediscuss

What is the advantage of Ollama Python over huggingface?

Translationaut

2 yıl öncediscuss

What is the point in using Ollama over huggingface if you use Python? Also, REST endpoints can be provided with huggingface transformer.

Here with Go, it seems to make sense to use an abstraction. Though don't you lose a lot of flexibility?

Translationaut

2 yıl öncediscuss

This seems only to work cause large GPTs have redundant, undercomplex attentions. See this issue in BertViz about attention in Llama: https://github.com/jessevig/bertviz/issues/128

Translationaut

3 yıl öncediscuss

Those minified models are still equal or bigger compared to the initial "attention is all you need" transformer.

Translationaut

3 yıl öncediscuss

Have you also tried the bigger models? The smaller models are good for assisted generation: https://huggingface.co/blog/assisted-generation

Those models of LaMini-Flan-T5 are trained to follow instructions and not to recognize the truth content. You could train a transformer like Ernie or Vega (which lead superglue) on such challenging factual data. But don't expect mathematical correct results only from the model. Therefore you have langchain with other APIs.

comments