HackerTrans
TopNewTrendsCommentsPastAskShowJobs

leroman

917 karmajoined قبل 10 سنوات
https://romansky.dev

Submissions

Show HN: Sandbox AI-app lifecycle, from build to run

capakit.com
6 points·by leroman·الشهر الماضي·1 comments

[untitled]

1 points·by leroman·الشهر الماضي·0 comments

[untitled]

1 points·by leroman·الشهر الماضي·0 comments

comments

leroman
·قبل 19 يومًا·discuss
The token-economics for closed source models are different, they are optimizing for 200 USD tokens worth of software engineer monthly usage, they will increase per token price as models or harnesses are more optimized.
leroman
·قبل 7 أشهر·discuss
Interesting, thanks!
leroman
·قبل 7 أشهر·discuss
What model are you working with where you still get good results at 25k?

To your q, I make huge effort in making my prompts as small as possible (to get the best quality output), I go as far as removing imports from source files, writing interfaces and types to use in context instead of fat impl code, write task specific project / feature documentation.. (I automate some of these with a library I use to generate prompts from code and other files - think templating language with extra flags). And still for some tasks my prompt size reaches 10k tokens, where I find the output quality not good enough
leroman
·قبل 7 أشهر·discuss
The biggest challenge an agent will face with tasks like these is the diminishing quality in relation to the size of the input, specifically I find input of above say 10k tokens dramatically reduced quality of generated output.

This specific case worked well, I suspect, since LLMs have a LOT of previous knowledge with HTML, and saw multiple impl and parsing of HTML in the training.

Thus I suspect that in real world attempts of similar projects and any non well domain will fail miserably.