HackerTrans
TopNewTrendsCommentsPastAskShowJobs

s5ma6n

no profile record

comments

s5ma6n
·8 mesi fa·discuss
Thanks for sharing it, however I have an unrelated comment.

Maybe I am in minority here but just wanted to provide this feedback: The background animation of the blog page is really distracting and making it difficult to focus on the actual content.
s5ma6n
·anno scorso·discuss
I am also using conda and specifically mamba which has a really quick dependency solver.

However, sometimes repos require system level packages as well. Tried to run TRELLIS recently and gave up after 2h of tinkering around to get it to work in Windows.

Also, whenever I try to run some new repo locally, creating a new virtual environment takes a ton of disk space due to CUDA and PyTorch libraries. It adds up quickly to 100s of gigs since most projects use different versions of these libraries.

</rant> Sorry for the rant, can't help myself when it's Python package management...
s5ma6n
·anno scorso·discuss
Also relevant and useful single-file public domain libraries for C/C++

https://github.com/nothings/stb
s5ma6n
·2 anni fa·discuss
I did not know that cleanrooms have classes. Apparently they used a 10000 class cleanroom which is one of the "dirtiest" grade.

Surely an astroid sample return mission is scientifically one of the most important and difficult things to accomplish, and I wonder why they did not use a higher class cleanroom for this even though they mentioned "Researchers recommend enhanced contamination control procedures for future sample-return missions to prevent microbial colonization and ensure the integrity of extraterrestrial samples."
s5ma6n
·2 anni fa·discuss
Agreed on providing examples is definitely a useful insight vs fine-tuning.

While it is not very important for this toy case, it's good to keep in mind that each provided example in the input will increase the prediction time and cost compared to fine-tuning.
s5ma6n
·2 anni fa·discuss
To me it boils down to what is to be measured here. With logprobs we can measure both correctness and not attempted i.e. if LLM is guessing the response.

Similar to exams where both the progress to the solution and the final outcome/value of the calculations are part of the grade.

To have the cake and eat it too for chain-of-thought reasoning, one way is to ask for a "final answer" so the final response token logprobs can be evaluated https://chatgpt.com/share/67239d92-b24c-800a-af8c-40da7be1f5...

Another trick is using JSON mode to keep intermediate results and final response separate, so each can be graded accordingly.
s5ma6n
·2 anni fa·discuss
I am puzzled why they have "asked the model" about the confidence and have not used the logprobs of the output tokens to estimate the confidence in responses.

In my use case and tests, model itself is not capable of giving a reliable confidence value where logprobs almost always provide a better view on calibration.