Guardrails AI wants to crowdsource fixes for GenAI model problems(techcrunch.com)
techcrunch.com
Guardrails AI wants to crowdsource fixes for GenAI model problems
https://techcrunch.com/2024/02/15/guardrails-ai-builds-hub-for-genai-model-mitigations/
3 comments
Pretty interesting to go from a world of deterministic code, to LLMs which can do incredible things, but unreliably. In a world of LLMs, I could imagine guardrails being a table-stakes part of engineering an ML system, just like unit tests, and CI/CD would be for traditional software.
Hi everyone, the CEO of Guardrails AI here! We're stoked to launch Guardrails Hub as an open source framework to solve AI reliability.
Check out the hub here -> https://hub.guardrailsai.com/
Check out the hub here -> https://hub.guardrailsai.com/
Don’t cram too much in a single prompt though. Prompt structures like guard rails naturally carry high cognitive load for the LLM, which leads to biased outputs. I found the best practice is to alleviate it by using multiple prompts and using a guard rail as an end-step rather than one big prompt for the LLM. (https://arxiv.org/abs/2402.01740)