I made an AI specifically for teachers(assignly.app)
assignly.app
I made an AI specifically for teachers
https://assignly.app/
9 comments
Not OP, but I work on AI in higher ed at a major university.
I get the concerns about AI grading. The solution isn't to have AI grade entire assignments at once. Instead, break down the assessment into smaller, discrete tasks and develop a grading rubric around those. The idea is to limit how the AI can respond - usually to simple binary choices like completed/not completed, true/false, etc. (Also, the models have been RLHF’d to generally put a positive spin on things, so if anything they’re likely to be overly generous in assessment.)
From there, provide the AI with the answer key, student response, rubric, and any other necessary context then use the Structured Outputs API to force consistent responses for each discrete task. I've had the most success using boolean values or simple enums (like "Correct", "Partially Correct", "Incorrect"). You can include a field for reasoning, then chain AI calls to get a second assessment as verification.
That's the high-level gist of it, though I'm skipping a lot of details. I have a basic demo of how this works on my site if you're interested: https://www.markokrkeljas.com/projects/real-time-task-tracki...
I get the concerns about AI grading. The solution isn't to have AI grade entire assignments at once. Instead, break down the assessment into smaller, discrete tasks and develop a grading rubric around those. The idea is to limit how the AI can respond - usually to simple binary choices like completed/not completed, true/false, etc. (Also, the models have been RLHF’d to generally put a positive spin on things, so if anything they’re likely to be overly generous in assessment.)
From there, provide the AI with the answer key, student response, rubric, and any other necessary context then use the Structured Outputs API to force consistent responses for each discrete task. I've had the most success using boolean values or simple enums (like "Correct", "Partially Correct", "Incorrect"). You can include a field for reasoning, then chain AI calls to get a second assessment as verification.
That's the high-level gist of it, though I'm skipping a lot of details. I have a basic demo of how this works on my site if you're interested: https://www.markokrkeljas.com/projects/real-time-task-tracki...
I really hate to rain on people's parade or discourage them, but honestly - this is not only incredibly low-effort AI slop but dangerous low-effort AI slop.
It appears you did little or possibly no research into existing tools, talked to no actual teachers about their needs, or even put any thought into it. An AI slop generater itself generated by AI, with no reference to market needs ... and you expect people to use it to educate children?
Please, just take this down.
It appears you did little or possibly no research into existing tools, talked to no actual teachers about their needs, or even put any thought into it. An AI slop generater itself generated by AI, with no reference to market needs ... and you expect people to use it to educate children?
Please, just take this down.
Seriously, how are you gonna teach a lesson you didn't write.
Oh that happens all the time. Right up front, I would not have gotten through my first year teaching if I had to write all my own lessons. My whole first semester I just copied lock step what the other subject teacher was doing. If I didn't have her, I would not have survived.
To be clear, though, that doesn't change by adding AI. If I only had AI, I would also have drowned and failed miserably. And that's despite knowing my content forward, backwards, and sideways.
The few times I've tried generating lessons from AI, they've been boring and uninspired. With lessons, it works best in reverse, taking a human-generated lesson and stuffing it into a easier-to-share and easier-to-tweak lesson plan format.
To be clear, though, that doesn't change by adding AI. If I only had AI, I would also have drowned and failed miserably. And that's despite knowing my content forward, backwards, and sideways.
The few times I've tried generating lessons from AI, they've been boring and uninspired. With lessons, it works best in reverse, taking a human-generated lesson and stuffing it into a easier-to-share and easier-to-tweak lesson plan format.
Yet another "AI sign up with Google web site with its pricing page" that will fuck up young people. I’m fed up with this. Flagged. Go away. Sorry for the rant.
> product creation grind
You’re the new SEO spammer that we had ten years ago except it’s AI this time.
> product creation grind
You’re the new SEO spammer that we had ten years ago except it’s AI this time.
EricWM(2)
This next bit is going to sound a bit harsh or confrontational, but trust I'm coming at it with a good heart of hope. I'm a bit on edge about pushing AI for grading. Teachers are... not technically literate folk. They won't understand the nuance of AI and using it to grade student work seems like heartache and disaster in the making. Are you doing anything to somehow subvert the fundamental nature of LLMs to make it suitable for grading?