HackerTrans
TopNewTrendsCommentsPastAskShowJobs

RHab

no profile record

Submissions

Structured Output for LM Studio 0.3.5, OpenAI, Anthropic and Gemini

github.com
2 points·by RHab·2 years ago·1 comments

Show HN: Fantasy Tribe Game: LLM backed interactive text-based strategy game

github.com
1 points·by RHab·2 years ago·1 comments

comments

RHab
·last month·discuss
I wanted something like this for my knowledge wiki, nexidion: https://github.com/HabermannR/Nexidion Will look how hard it is to combine next week, thanks!
RHab
·2 months ago·discuss
I am working on something similar. I was also not aware Obsidian is not open source. Something never clicked for me with Obsidian. Will check out your code later. My repo: https://github.com/HabermannR/Nexidion
RHab
·6 months ago·discuss
I just ended my contract with them. I could not reach my own raspberry pi Homepage which uses cloudflare. They called me and asked why I ended the contract, I told them about cloudflare, but that my cancellation is final, and magically my Homepage now works again!
RHab
·2 years ago·discuss
A llm backend fantasy game. It uses structured output and supports Openai, Anthropic and LM Studio. Gemini support is ending, at the moment it is not working reliable. https://github.com/HabermannR/Fantasy-Tribe-Game
RHab
·2 years ago·discuss
I am trying to understand structured output from LLMs, and as training I am building a text game.

OpenAI is using pydantic to create objects directly in its beta branch, it's quite nice. Anthropic is a bit more involved, as you need to involve tool calling.

LM Studio 0.3.5 introduced a bug for structured output when using pydantic and enums or literals, I created a workaround.

Also Gemini is not using Pydantic at all, instead TypedDict to create the json scheme.

And Gemini does not have a system message.

I am quite proud to have everything working, if you want to check out my code please take a look: https://github.com/HabermannR/Fantasy-Tribe-Game

Here is the backend: https://github.com/HabermannR/Fantasy-Tribe-Game/blob/main/L...

For example, this is how I call Gemini:

completion = model.generate_content(

messages[0]['content'] + ": " + messages[1]['content'],

generation_config=genai.GenerationConfig(

response_mime_type="application/json", response_schema=response_types.typed_dict

),

)

result = response_types.pydantic_model.model_validate_json(completion.text)

Happy for any feedback!
RHab
·2 years ago·discuss
Hi, I am programming as a hobby since I am seven, and I always wanted to program a game, but never finished anything. I am super fascinated by LLMs, and made a small interactive text-based strategy game, where the player can choice a tribe and then gets presented 3 choices, which will shape the development of the tribe from humble beginnings to god like ascension. Everything is done procedurally by an LLM using structured output. I support OpenAI, Anthropic, and local LLM, tested with LM Studio. Please take a look and give me some feedback, thanks! https://github.com/HabermannR/Fantasy-Tribe-Game
RHab
·2 years ago·discuss
Abaqus for example is by core, I am severly limited, for me this makes totally sense.
RHab
·2 years ago·discuss
Würselen! The world is small :D