Ask HN: Has anyone noticed how hard it is for ChatGPT to obey all instructions?
11 comments
You didn't specify whether you used GPT-4 or 3.5-turbo.
It's true that it often inserts placeholders.
You can try using the functions feature (via the API) and/or fine-tuning .
If it's relatively simple code then you could also look into Codellama or WizardCoder which you may also fine-tune.
To be fair, the instruction following capabilities of GPT-4 are absolutely incredible relative to what was available a few years ago.
Don't worry, it will only be a few more years before AI is able to completely replace you. Then you will be wishing you could go back to the time when you had to write an extra prompt to fill in the TODOs.
It's true that it often inserts placeholders.
You can try using the functions feature (via the API) and/or fine-tuning .
If it's relatively simple code then you could also look into Codellama or WizardCoder which you may also fine-tune.
To be fair, the instruction following capabilities of GPT-4 are absolutely incredible relative to what was available a few years ago.
Don't worry, it will only be a few more years before AI is able to completely replace you. Then you will be wishing you could go back to the time when you had to write an extra prompt to fill in the TODOs.
ChatGPT, for all its amazingness, _never_ follows instructions. It just appears to, as it generates likely text. This is incredibly important to understand — it isn't a generalized AI.
Larger and more sophisticated models will do the party trick more convincingly... but actually following instructions will require a different approach.
Larger and more sophisticated models will do the party trick more convincingly... but actually following instructions will require a different approach.
Its ridiculously annoying.
The other thing that I would really like to see is at least an option for deterministic responses. I like the creativity of ChatGPT constantly giving different responses but it is hugely problematic when you are trying to iterate and it keeps completely changing the thing you are iterating on.
The other thing that I would really like to see is at least an option for deterministic responses. I like the creativity of ChatGPT constantly giving different responses but it is hugely problematic when you are trying to iterate and it keeps completely changing the thing you are iterating on.
LLMs are a drunk guy at a party. A context machine, or a really good spell checker, maybe like a really outgoing, kinda drunk guy at a party. He can just walk right up to any group, hear someone say the words, "...thats why we never go on vacations anymore..." and he will just jump right in, "Me and the wife just got back from a great VACATION, we love going to Cabo, its out favorit vacation spot, last year we went..."
The guy has NO IDEA what the group was actually talking about but it doesn't matter anyway. You can give him more context but all he can do id further tailor his story to try and fit in better with the group discussion.
I think people get confused about what LLMs are doing because you CAN ask the drunk guy questions and he CAN kind of answer, or ask him to do a party trick and he can kinda do it, but all he is doing is continuing the context you give him, he IMMEDIATELY forgets anything you told him so he can't do the same exact thing twice.
The guy has NO IDEA what the group was actually talking about but it doesn't matter anyway. You can give him more context but all he can do id further tailor his story to try and fit in better with the group discussion.
I think people get confused about what LLMs are doing because you CAN ask the drunk guy questions and he CAN kind of answer, or ask him to do a party trick and he can kinda do it, but all he is doing is continuing the context you give him, he IMMEDIATELY forgets anything you told him so he can't do the same exact thing twice.
Use the API and specify temperature 0. It will be as close to determinist as the underlying system allows.
> ChatGPT, for all its amazingness, _never_ follows instructions.
Yes it can, with robust system prompts.
The webapp is a misleading representation of ChatGPT's capabilities.
Yes it can, with robust system prompts.
The webapp is a misleading representation of ChatGPT's capabilities.
This is new thing, like last few weeks. My best guess is cost optimization to save prediction time (GPU).
Not happy about it either.
Not happy about it either.
[deleted]
Use the OpenAI Playground and system prompts.
Seems to be asking me for payment even though I pay for ChatGPT.
It is a different payment system (pay per token)
Will a day come when AI knows how to do what it is told?