Lately I am finding myself doing more and more of what I called "ambient coding" so that I am not directly using anymore all of those coding harnesses.
There is a lot of positive comments in this comments section that I don't mind being a bit rough.
I think we can do much better.
The workflow of copy to chatgpt and getting feedback is just the first step, and honestly not that useful.
What I would love to see is a tool that makes my writing and thinking clearer.
Does this sentence makes sense? Does the conclusion I am reaching follows from what I am saying? Is this period useful or I am just repeating something I already said? Can I re-arrange my wording to make my point clear? Are my wording actually clear? Or am I not making sense?
Can I re-arrange my essay so that it is simpler to follow?
I just made an app that read GitHub issues. If they have a specific tag, the agent in the background creates a plan.
If they have another tag, the agent in the server creates a PR considering the whole issue conversation as context (with the idea that you used the plan above - but technically you don't have to.)
If you comment in the PR the agent start again loading your comment as context and trying to address it.
Everything is already in git and GitHub, so it automatically pick up your CI.
It seems simpler, but I am sure I missed something.
Often code is seen as an artifact, that it is valuable by itself. This was an incomplete view before, and it is now a completely wrong view.
What is valuable is how code encode the knowledge of the organization building it.
But what it is even more valuable, is that knowledge itself. Embedded into the people of the organization.
Which is why continuos and automatic improvement of a codebase is so important. We all know that code rot with time/features requests.
But at the same time, abruptly change the whole codebase architecture destroys the mental model of the people in the organization.
What I believe will work, is a slow stream of small improvements - stream that can be digested by the people in the organization.
In this context I find more useful to mix and control deterministic execution with a sprinkle of intelligence on top.
So a deterministic system that figure out what is wrong - with whatever definition of wrong that makes sense.
And then LLMs to actually fix the problem, when necessary.
The perspective from an educator is quite concerning indeed.
Students are very simply NOT doing the work that is require to learn.
Before LLMs, homeworks were a great way to force students to approach the material. Students did not have any other way to get an answer, so they were forced to study and come up with an answer to the homeworks. They could always copy from classmates, but that was considered quite negatively.
LLMs change this completely. Any kind of homework you could assign undergraduates classes are now completed in less than 1 second, for free, by LLMs.
We start to see PERFECT homeworks submitted by students who could not get a 50% grade in classes. Overall grades went down.
This is a common pattern with all the educators I have been talking with. Not a single one has a different experience.
And, I do understand students. They are busy, they may not feel engaged by all the classes, and LLMs are a way too fast solution for getting homeworks done and free up some time.
But it is not helping them.
Solutions like this are to force students to put the correct amount of work in their education.
And I would love if all of this would not be necessary. But it is.
I come from an engineering school in Europe - we simply did not have homework. We had frontal classes and one big final exams. Courses in which only 10% of the class would pass were not uncommon.
But today education, especially in the US, is different.
This is not forcing student to use LLMs. We are trying to force student to think and do the right thing for them.
And I know it sounds very paternalistic - but if you have better ideas, I am open.
I created something similar, but instead of final oral examination, we do homework.
The student is supposed to submit a whole conversation with an LLMs.
The LLM is prompted to answer a question or resolve a problem, and the LLM is there to assist.
The LLM is instructed to never reveal the answer.
More interesting is the concept that the whole conversation is available to the instructor for grading.
So if the LLMs makes mistake, or give away the solution, or if the student prompt engineer around it. It is all there and the instructor can take the necessary corrective measures.
87% of the students quite liked it, and we are looking forward to doubling the students that will be using it next quarter.
Overall, we are looking for more instructor to use it. So if you are interested in it please get in touch.
I will be crucified by this, but I think you are doing it wrong.
I would split it in 2 steps.
First, just move it to svelte, maintain the same functionality and ideally wrap it into some tests. As mentioned you want something that can be used as pass/no-pass filter. As in yes, the code did not change the functionality.
Then, apply another pass from Svelte bad quality to Svelte good quality.
Here the trick is that "good quality" is quite different and subjective. I found the models not quite able to grasp what "good quality" means in a codebase.
For the second pass, ideally you would feed an example of good modules in your codebase to follow and a description of what you think it is important.
With my partner we have been working to invert the overall model.
She started grading conversation than the students have with LLMs.
From the question that the students ask, it is obvious who knows the material and who is struggling.
We do have a custom setup, so that she creates an homework. There is a custom prompt to avoid the LLM answering the homework question. But thats pretty much it.
The results seems promising, with students spending 30m or so going back and forth with the LLMs.
If any educator wants to Ty or is interested in more information, let me know and we can see how we collaborate.
Do you have any example?