Could this be done better with one of those dog button mats? The concept is interesting, but, it mostly just seems like an AI trying to interpret keyspam.
Perhaps a combination of the two? Maybe standard drag-and-drop works as usual, but if you drag the item to some deadzone (like the side of the screen?), it will stick and you're free to scroll to where you want to put it.
Not too hopeful with accessibility, as it isn't pleasant to use at all with reduced motion enabled. They flicker when added and linger around when swiped away.
Wireless keyboards (like the one linked) typically use ZMK instead to my knowledge. It's similar to QMK—so much of the knowledge still applies—but it isn't 1:1.
I understand that a GUI is complex, which is why I'm confused about the performance benefit as HTML5 already acts like a GUI. Even if it's a terminal program, it would still need to calculate the layout and handle the DOM to remain compliant, no? A website can be as intensive as Word.
My logic with it being an additional layer is that instead of the browser rendering text to the screen, it would have to speak with the terminal for the terminal to instead render text to the screen. Same goes for rendering graphics. Besides a headless system I don't see much of a benefit to it.
Wouldn't you still be as sluggish as the GUIs you mention since it's HTML5? Is the benefit from only rendering a subset or something? I'm struggling understanding how rendering a page into a terminal is faster than just rendering to a regular window. It just seems like another layer between the browser and the GPU.