LLM Chat via SSH(github.com)
github.com
LLM Chat via SSH
https://github.com/ccbikai/ssh-ai-chat
24 comments
Many CLI applications are now using Ink to write their UIs.
I suspect React will eventually standardize all UI writing approaches.
I suspect React will eventually standardize all UI writing approaches.
I'd rather apt-get install something.
But that seems not a possibility in the modern days of software distribution, especially with GPU-dependent stuff like LLMs.
So yeah, I get why this exists.
But that seems not a possibility in the modern days of software distribution, especially with GPU-dependent stuff like LLMs.
So yeah, I get why this exists.
What is the complaint here? There are plenty of binaries you can invoke through your cli that will query a remote llm api
We made this a while ago on the web:
https://terminal.odai.chat
https://terminal.odai.chat
Wow, that produced a flashback to using TinyFugue in the 90s.
https://tinyfugue.sourceforge.net/
https://en.wikipedia.org/wiki/List_of_MUD_clients
https://tinyfugue.sourceforge.net/
https://en.wikipedia.org/wiki/List_of_MUD_clients
Using React to render a CLI tool is something. I'm not sure how I feel about that. It feels like like 90% of the code is handling issues with rendering.
I mean, it's a thin wrapper around LLM APIs, so it's not surprising that most of the code is rendering. I'm not sure what you're referring to by "handling issues with rendering", though—it looks like a pretty bog standard React app. Am I missing something?
Is this doing local inference? If so, what inference engine is it using?
No, it's a thin wrapper around an API, probably OpenRouter or similar:
https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/in...
https://github.com/ccbikai/ssh-ai-chat/blob/master/src/ai/in...
Currently using the OpenAI API to access multiple models. You can use ollama to access local inference models
this is neat.... whose anthropic credits am i using, though? sonnet-4 isn't cheap! would i hit a rate-limit if i used this for daily work?
I am the author, thank you for your support.
Welcome to help maintain it with me
Welcome to help maintain it with me
Why not telnet?
Previously discussions of Ink:
July 2017 (129 points, 42 comments): https://news.ycombinator.com/item?id=14831961
May 2023 (588 points, 178 comments): https://news.ycombinator.com/item?id=35863837
Nov 2024 (164 points, 106 comments): https://news.ycombinator.com/item?id=42016639