I wrote a small amount of JS and CSS to give this page: https://thelibrarian.cc an old UI look and animate it in the same style as typical 90s UIs I have seen during my childhood in La Femme Nikita, Unreal Tournament, Starcraft and The Matrix.
It's a landing page for a book I wrote.
What can I do to make it more interesting?
An option I am considering is allowing user interaction after the main animation finishes. So one can explore and browse the files of other subjects and learn more about the corporation. Would you like something like this?
However if one wants to run something like this in production, it would make more sense to use a server with at least an A10, which has better performance per power consumption.
I'm running everything on my own PC. With a 3060 12 GB at under $300, it's very cheap to build a system capable of running inference with smaller models.
But even bigger models (13B or 30B) can be handled with a dual GPU setup (24 GB total memory at < $600), with quantization.
The Discord bot works as a client (outgoing connection to the Discord public server), so it can run from behind NAT.
I'm working on an LLM-based tool to assist with fiction writing. The goal is to help writers get unstuck in case of writer's block, not to do autonomous writing.
One has to enter some abstract of what they want to write, and some text they have so far, and the tool generates possible continuations.
It requires quite a bit of editing, maybe 3-4 attempts for each completion if one wants to generate decent text. Feedback was mostly positive from a dozen or so professional writers who tried it out for a day.
I feel that it generates more naturally looking text than ChatGPT with the typical prompts.
See my profile if you want to try it out. You can use the demo without registration.