manapause

no profile record

comments

hace 18 díasdiscuss

It depends what your goals are and what you are using it for. This space is fluid and my answer last week would be different than my answer today! That said there’s no substitute for hard work, here are some resource to get you up to up to speed:

https://carteakey.dev/blog/local-inference/local-llm-optimiz...

https://botmonster.com/ai/self-hosted-ai-agent-frameworks-20...

Personally I find myself swapping models depending if I am engaged in “trad-development” vs building agentic probes or apps involving imagery. Tailscale the LLM to your deployments and ta-da!

hace 18 díasdiscuss

What about at the device level?

“You must be this tall to ride this ride”

“ you must be 18 to own an iPhone 18+ “

I apologize for the drive-by question, and I appreciate your takes!

hace 18 díasdiscuss

Can confirm, my experience in “loop engineering” was “this is neat” for 45 minutes until a daily ration of tokens was evaporated. The quadratic cost trap is prohibitive to experimentation.

As a localLLM evangelist, I am hopeful this will bring more attention to the joys of rolling your own sovereign AI.

hace 18 díasdiscuss

The irony in AI triggering societal collapse due to gross economic malfeasance is just fun to think about.

If AI was around in the early 2000s Countrywide.ai would have been a thing.

hace 23 díasdiscuss

The more sensational the headline the less I believe that the authors were present in technology 15-20+ years ago. People forget that Reddit used to be 2 parts programmer-humor 1 part snuff.

Show me an abliterated frontier model that is able to breakthrough the surrounding supporting models and actually hold state to produce contraband and I’ll gladly supply my personal image making making a silly face in a compromising position if it wouldn’t make the testers feel better.

Do they need to be tested like this? Yes. But it would take the carbon footprint of a commuter air terminal and the land rights of am small town in the high Sierras …. all converted settlers of Catan style into tokens …. just to lobotomize a fine tuned model to get close.

That said I appreciate the work you’re doing

hace 23 díasdiscuss

20 or so years ago while working for a Startup in the Home-Health EMR Space - it was my job to develop and integrate the proper processing of incoming visit forms. After an outage, I performed an audit of our incoming forms and noticed some anomalies in the billing patterns of doctors belonging to one clinic. In other words, these doctors either had the highest concentration of extremely sick patients - or they were committing Medicare fraud.

At the end of the post mortum with the CMO, as I was getting ready to leave I decided to bring this to his attention. I’ll never forget the change of mood preceding the dressing down I received: “do not ever put yourself in a position to make clinical decisions.”

3 months later, the charting anomalies were so egregious that the CMO’s spot-checks led him to sit the medical director of that physicians clinic down for a chat. They were good doctors, but they were over-billing. A year and a half later their practice goes under pre-payment review, and four years after I wrote a script that noticed an anomaly - the head MD of the practice was sent to prison for 4 years after collecting millions of dollars in over-billed house calls.

I loved working in healthcare, and I still miss it to this day. I don’t know where I am going with this, but right now I believe there is a diagnostic technology out there that is being used in veterinary science or piloted in some other country that could save a statistic level of lives …. However, due to the fact that doctors practice medicine and we don’t, as a group they act as defacto gate-keepers (which they are entitled to be as clinicians), the best thing you can do is to incentivize them with money (like Obama did) with Medicare bonuses for using an EMR that logged CCRs and alerted the doc if the patient didn’t have certain vaccine information in the elderly.

If the first guy to wash his hands was seen as a lunatic, the first geriatric practitioner to give over an iota of their clinical practice to automate Rx dispersal while navigating poly pharmacology concerns will go to jail for a narcotics crimes or will be labeled to heretic until Medicare pays them all for it.

hace 2 mesesdiscuss

If your name is John Smith, and you prompt Gemini to act as a robust OSINT tool, you will experience the vicissitudes of Chaps firsthand as the tool normalizations of vector space yields an answer that will not only never get close to identifying you because it has lumped several John Smiths together like asking a dog to fetch your shoes and it comes back with a Footlocker in its mouth.

hace 2 mesesdiscuss

It’s a good question. That said unless there are compliance or fallback concerns i would prefer a service that burns my data on departure.

hace 3 mesesdiscuss

Correct me if I’m wrong, but from my experience in this space in order for a model to exercise judgment it must force itself to operate in a strict chain of thought mode. Since all LLMs are predictive creatures, I started to care a lot more about my judgment settings, the transparency of them, and the presence of a judgment loop in either the development or functionality of an application built these days.

Not exactly sure where I’m going with this, but my work with creating penetesting tools for LLMs, the way that I use judgment is critical to the core functionality of the application. I agree with your concern and I will just say that the more time I spent concerned with chain of though where now I will make multiple versions of the same app using a different judge set a different “temperaments” and I found it to be incredibly enlightening as to the diversity of applications and approaches that it creates.

  Even using BMAD or superpowers, I can make five versions of an app without judges involved and I feel like I’m just making the same app five times because the API begins to coalesce around the business problem you want to solve. The vicissitudes of prediction tools always want to take the safest bet for the greater good, but with the judge involved we can make the agent force itself to actually be hostile about what exactly we’re trying to do, which has produced interesting and fun results.

hace 3 mesesdiscuss

As an amateur sauna evangelist, I can say my experience sauna usage 1-2 times a week has greatly improved my life and quality of sleep!

hace 3 mesesdiscuss

If you give 100 monkeys 100 guns and room full of building materials, how long will it take before they build a house?

How long will it take before they rob a bank?

If they do either of those things will the results have been intentional from the simian’s POV?

hace 5 mesesdiscuss

Not notepad++! (Opens WhatsApp) OpenClawd express my discontent across all my channels and draft an email to send to IT tomorrow morning. Also turn off the lights off and go to bed. (Somewhere in china, all the lights go out)

hace 8 mesesdiscuss

There is capital “A” Active Listening, which is in a family of behavior modification techniques in which the interviewer can follow the aforementioned scripts to increase engagement…

And lowercase active listening, IMHO is genuinely being interested in the experiences of the person talking that your line of questioning disarms the subject into sharing stories that add personal, “cultural” context to their choices which could be considered taboo.

hace 9 mesesdiscuss

The tactic become normalized amongst the extremes of both sides. “ 5% of the wizards casting 85% of the spells.”

hace 10 mesesdiscuss

Beautifully said. I believe wholeheartedly that in real life, disagreements between two people hinge on an ability to disarm each other through charm and disposition. The less you know someone, and the more they appear to earnestly try to understand you - becoming heated and firing phasers just feels unbecoming; why would I perpetuate personal loneliness or ennui in a moment that is genuinely devoid of it?

hace 10 mesesdiscuss

In short, death by acquisition by dice.com