Announcing Tinker(thinkingmachines.ai)
thinkingmachines.ai
Announcing Tinker
https://thinkingmachines.ai/blog/announcing-tinker/
93 comments
But hey, it “empowers researchers and hackers to experiment with models by giving them control over the algorithms and data”.
PR and marketing will literally write anything they can get away with. Thanks for pointing out the TOS hole.
PR and marketing will literally write anything they can get away with. Thanks for pointing out the TOS hole.
>Absolutely unacceptable
Entitled much!? hold on to you pants.
They've clearly called out that organizations can contact them for their specific needs..
They've clearly called out that organizations can contact them for their specific needs..
My research group at Stanford has been alpha testing Tinker, it's both very useful and also really technically impressive in my opinion. It's a unified framework for post-training models and it abstracts almost all of the complexity of managing these jobs across resources. That it manages to do this while also allowing a lot of algorithmic flexibility is pretty unique.
Silly question: how is it different from, say, hf's transformers and similar libraries and APIs?
with hf transformers, you still need to manage GPUs
Interesting that their first product is an infrastructure play. Is it really so hard to set up a fine-tuning pipeline for yourself that a $12 billion startup with unlimited hype needs to be offering it? Maybe they have figured, whether correctly or not, that building AI tooling is going to be more lucrative than the AI itself.
The thing about this that’s interesting to me is that it can be used as a foundation for products they or other people make that combine real time RL rewards and fine tuning to improve the model. I see a lot of potential here compared to the standard paradigm of ChatGPT wrappers that involve tweaking the prompt or harness to improve it, which is a lot more constrained.
OpenAI has had a fine-tuning API since GPT-3.5, and a reinforcement fine-tuning API since last year.
"the Tinker API provides simple functions to compute gradients, update the weights, and sample outputs from the trained model"
It sure sounds like a PyTorch tutorial, but I believe it's yet another "AI training made slightly easier for you" start-up. But all of them seem to solve the easy problem of managing data and compute, while very few tackle the hard problem of generating good training data.
It sure sounds like a PyTorch tutorial, but I believe it's yet another "AI training made slightly easier for you" start-up. But all of them seem to solve the easy problem of managing data and compute, while very few tackle the hard problem of generating good training data.
Commonly attempting the "private beta with a waitlist" pseudo-release model (until they finally learned their lesson relatively recently) is a large part of how google fumbled the LLM ball to OpenAI and others.
This is great as we need more solutions that help people train and fine-tune models. There is a lot of open source and some companies behind some of the popular open source packages, like Unsloth, but the more the merrier, esp given that Thinking Machines has the expertise and resources to build something that last.
Yeah, I'm really curious about their stacked multi-tenant lora training at the same time. If this gets commoditised enough, it could be interesting to try "end of the day fine-tunes on daily conversations" and see where that leads. Or a targeted RL on "missed / rejected tasks" for an agent, after you get enough samples for a run, and so on.
1. Can someone help me articulate what Tinker can do that Vertex AI or many others can't? (I can see access to some primitives, which is nice)
2. and more broadly: Has anyone got real lift in business metrics through fine-tuning an open model over using the flagship models from say OpenAI or Anthropic?
2. and more broadly: Has anyone got real lift in business metrics through fine-tuning an open model over using the flagship models from say OpenAI or Anthropic?
Most managed finetuning offerings take your dataset, some hyperparameters, and spit out a model. Few support RL, and those that do have very limited support.
And I have gotten a real lift, in cost effectiveness and engagement (for creative writing)
And I have gotten a real lift, in cost effectiveness and engagement (for creative writing)
What are you doing that requires RL-ing creative writing for engagement?
I don't apply RL directly to engagement (and don't think it's really possible without some insane scale of feedback)
Instead there are mechanical mistakes models make that harm engagement and are trivially verifiable (overused phrases and concepts, hitting a given target reading level, etc.)
Improving those is what improves engagement.
Instead there are mechanical mistakes models make that harm engagement and are trivially verifiable (overused phrases and concepts, hitting a given target reading level, etc.)
Improving those is what improves engagement.
> Tinker is a flexible API for efficiently fine-tuning open source models with LoRA.
It would be great if they offered inference from the trained model as well. Ideally pay per token.
It would be great if they offered inference from the trained model as well. Ideally pay per token.
Funny timing that they are announcing their first product days after Matt Levine highlighted their lack of a public product or direction in the Money Stuff newsletter.
It's the first that came to mind when I saw the domain name but I'm sure he's not the first to point it out. So it probably is just inevitable that they'd be launching after someone has mentioned it during the last couple of hours/days.
Their lack of a public product has been widely discussed for at least a month now
There was a famous tech company in supercomputing and AI, called "Thinking Machines", worked at by people such as Danny Hillis and even Richard Feynman.
Does this new company have some connection to that, such as some of the same people?
https://en.wikipedia.org/wiki/Thinking_Machines_Corporation
Does this new company have some connection to that, such as some of the same people?
https://en.wikipedia.org/wiki/Thinking_Machines_Corporation
> Does this new company have some connection to that, such as some of the same people?
Really doubt it. This "Thinking Machines" seems like an on-trend SV AI software startup, that "Thinking Machines" was a Massachusetts-based hardware company that went bankrupt 30 years ago (and whatever's left is Oracle). That "Thinking Machines" people are retiring by now.
I wonder if Sun/Oracle let the trademark lapse, because if it's still active I'd imagine this startup's gonna get sued.
Really doubt it. This "Thinking Machines" seems like an on-trend SV AI software startup, that "Thinking Machines" was a Massachusetts-based hardware company that went bankrupt 30 years ago (and whatever's left is Oracle). That "Thinking Machines" people are retiring by now.
I wonder if Sun/Oracle let the trademark lapse, because if it's still active I'd imagine this startup's gonna get sued.
nope, this is Mira Murati's thinking machines. she used to be the CTO of OpenAI, but started her own thing once she [I think] realized that she was missing out on the gold rush by staying there.
They mention their "cookbooks" but I couldn't find them... Their blog was immensely interesting so I could see this being a good entrypoint
This company was most recently valued at $12 billion. Tell me there's not an AI bubble.
https://www.reuters.com/technology/mira-muratis-ai-startup-t...
https://www.reuters.com/technology/mira-muratis-ai-startup-t...
That's a fair valuation if they have a >10% chance of developing a frontier model. It's an excessive valuation if they just release tools to create LoRAs and such.
They seem to position themselves to commoditise renting shovels to use with your own data. Seems pretty bubble-safe to me.
Usually we want an announcement to come with more than a waitlist before doing a frontpage thread on HN, but I guess this company is high-profile enough that the post is relevant anyway?
[deleted]
[deleted]
A/B testing the python scripts
The name chosen is an antiquated ethnic slur in much of the Anglosphere.
I’ve never heard of this in my life. Isn’t tinker a verb meaning to fiddle or edit or modify in small increments? That seems like the perfect name given what the software they’re present. In any case I guess this is back to the debate: does it matter how a word is intended or does it matter how a word is received?
Never heard this before either.
I googled "Tinker Slur" and Gemini said this:
> The term "tinker" is a racial slur when used against Irish and Scottish Travellers and Romani people. Originally derived from the name of an itinerant profession, the word evolved into a derogatory ethnic insult with connotations of being dirty, dishonest, and criminal.
Further sources:
https://hatebase.org/vocabulary/tinker
https://www.threads.com/@yourlocaltj/post/DCbY6wMIJ7J?hl=en
TIL
Shame that people do this. It's been a salient word all my life, and it's a useful word too.
I'll keep calling myself a tinkerer.
I googled "Tinker Slur" and Gemini said this:
> The term "tinker" is a racial slur when used against Irish and Scottish Travellers and Romani people. Originally derived from the name of an itinerant profession, the word evolved into a derogatory ethnic insult with connotations of being dirty, dishonest, and criminal.
Further sources:
https://hatebase.org/vocabulary/tinker
https://www.threads.com/@yourlocaltj/post/DCbY6wMIJ7J?hl=en
TIL
Shame that people do this. It's been a salient word all my life, and it's a useful word too.
I'll keep calling myself a tinkerer.
I'm an American of Irish and Scottish descent with some travellers in my background. Never heard this word as a slur, only as "I like to tinker with machines." Tinker as a slur hasn't travelled off the islands of Great Britain apparently.
Edit: I'm not changing my usage of the word. I like to tinker.
Edit: I'm not changing my usage of the word. I like to tinker.
your usage is fine there too.
however, "the islands of Great Britain" is offensive to the Irish
however, "the islands of Great Britain" is offensive to the Irish
I suspect you're just not aware of how others consider the way you choose to speak: https://archive.is/WydpC
I'm very aware of how I speak which is why I have a good track record of not offending people. I change with the times e.g. I no longer refer to a car transmission as a tranny. So I know tinker as a slur is archaic. I've never heard anyone use it as a slur and think it would be counter productive to revive it as one.
You not hearing it doesn’t make it archaic. Tinker is still thrown at Travellers in Ireland, the UK, Australia, and elsewhere. Calling it “dead” just shows you your bubble, not reality.
Thinking Machines Lab and I are in Silicon Valley California. Are you suggesting that we should follow your provincial rules?
Read back your comment and apply it to an ethnic slur common in your locality.
Authored by William Safire [1], who also authored the "In Event of Moon Disaster" speech [2].
[1] https://en.wikipedia.org/wiki/William_Safire
[2] https://www.archives.gov/files/presidential-libraries/events...
[1] https://en.wikipedia.org/wiki/William_Safire
[2] https://www.archives.gov/files/presidential-libraries/events...
Interesting that you link to an article that has no issues with the word “tinker”.
Yes, it is, and 37 years later, it is no longer acceptable to use such terms.
On the contrary, it seems more acceptable now than 37 years ago - the “unacceptable” meaning that was already residual then (and not mentioned in the article at all!) is even more irrelevant today.
So you believe the slur is no longer used or something?
I think it's used less than 37 years ago in that sense - and it was not much of an issue back then (at least in the US, that article doesn't mention that tinker could be considered offensive while it talks about 'wetbacks').
You believe the slur is used now more than 37 years ago or something?
You believe the slur is used now more than 37 years ago or something?
Interesting, Robert Jordan basically directly lifts that term for the Romani-esque tinkers in Wheel of Time.
The ethnic slur predates (and is the etymology of) the meaning you're familiar with.
Meanings become obsolete. Calling someone "nice" used to mean they were stupid.
Do you have a source for this? I can't find any etymology dictionary that says it doesn't come from either "tin" as in the metal or "tink" as an onomatopoeia (or a verb that refers to mending things). To be fair, they say it's uncertain, but you seem very confident about your alternative etymology.
The formation etymology (whether from tin or onomatopoeia) is uncertain. The part that is certain is the semantic chronology. The noun tinker was used from at least the 13th century for an itinerant mender of pots, the Travellers. By the 16th century it became a slur for Travellers.
The verb to tinker doesn’t appear until the mid-17th century, first meaning to work as a tinker and only later coming to mean what you're familiar with.
So while the root word’s sound-shape is debated, the order of senses is clear: the Traveller sense comes first, the modern “casual repair” sense comes later and was derived from it. This is the etymological order given in all sources, eg https://www.merriam-webster.com/dictionary/tinker
The verb to tinker doesn’t appear until the mid-17th century, first meaning to work as a tinker and only later coming to mean what you're familiar with.
So while the root word’s sound-shape is debated, the order of senses is clear: the Traveller sense comes first, the modern “casual repair” sense comes later and was derived from it. This is the etymological order given in all sources, eg https://www.merriam-webster.com/dictionary/tinker
> eg https://www.merriam-webster.com/dictionary/tinker
Does this page show something different in your region? For me it doesn't say anything about what you're claiming it does outside of one "chiefly Ireland, sometimes offensive" definition. The etymology only says "Middle English tinkere", and the history explicitly states its first use as being the not-"chiefly Ireland, sometimes offensive" definition. The etymologies I was seeing show it going from "this is a word that describes a job" and branching to "this group of people does this job a lot, let's call them this word" and "fiddling with things to do anything is close enough".
I'm genuinely interested in this, I work in what's a relatively "woke" domain (education) and I've never heard a complaint about something being called "tinkerable", even from colleagues in the UK.
Does this page show something different in your region? For me it doesn't say anything about what you're claiming it does outside of one "chiefly Ireland, sometimes offensive" definition. The etymology only says "Middle English tinkere", and the history explicitly states its first use as being the not-"chiefly Ireland, sometimes offensive" definition. The etymologies I was seeing show it going from "this is a word that describes a job" and branching to "this group of people does this job a lot, let's call them this word" and "fiddling with things to do anything is close enough".
I'm genuinely interested in this, I work in what's a relatively "woke" domain (education) and I've never heard a complaint about something being called "tinkerable", even from colleagues in the UK.
You are misreading the definition, as the itinerant mender of household utensils are Travellers.
Let's say you're correct. If "the etymological order given in all sources" is yours, shouldn't you be able to provide an example of that instead of one that requires assuming you're correct and reading words that aren't in the definition, while ignoring the listed etymology?
I have, as have otgers.
> the order of senses is clear: the Traveller sense comes first, the modern “casual repair” sense comes later and was derived from it.
The order of the senses is clear but different:
The "mender of kettles, pots, pans, etc.," sense come first.
The “gipsy” sense comes later an is derived from it.
The “repair or put into shape rudely or temporarily" - and later "work imperfectly, work in an experimental or meddlesome manner; keep busy in a useless way" - sense also comes from the first one.
The order of the senses is clear but different:
The "mender of kettles, pots, pans, etc.," sense come first.
The “gipsy” sense comes later an is derived from it.
The “repair or put into shape rudely or temporarily" - and later "work imperfectly, work in an experimental or meddlesome manner; keep busy in a useless way" - sense also comes from the first one.
The "mender of kettles, pots, pans, etc.," refers to Travelers.
[…] is to be considered that genuine Gypsies have often been spoken of as "tinkers" (chaudronniers) on account of the occupation with which they have long been associated ; and that, although there is no known mention of "Gypsies" in the British Islands prior to the fifteenth century, there are many earlier references to "tinkers" or "tinklers," as they are called in Scotland. […] "Tinkler can be traced back to about the year 1200. Tinker and Tinkler were not uncommon titles at that time. […] All these seem to have had fixed abodes, and not to have been of the same itinerant class with which we now associate all tinkers, and which used to require the epithet 'wandering' to distinguish them." […] To the same purpose as the opinion expressed in this last sentence is Crofton's observation made elsewhere, that "all Gypsies may be pedlars, brasiers, or tinkers, but the reverse may not follow."
[ Scottish Gypsies under the Stewarts; David MacRitchie; 1894 ]
[ Scottish Gypsies under the Stewarts; David MacRitchie; 1894 ]
Right, so as per your quote, the term referred to Travellers exclusively for centuries before the verb came along.
You are going to great efforts to defend your use of a slur.
You are going to great efforts to defend your use of a slur.
>> The "mender of kettles, pots, pans, etc.," refers to Travelers.
> Right, so as per your quote, the term referred to Travellers exclusively for centuries
The quote supports what I wrote before:
1) The "mender of kettles, pots, pans, etc.," sense come first.
2) The “gipsy” sense comes later and is derived from it.
What the quote says:
- Tinker was not an uncommon title in the thirteenth century.
- It was used to refer to tin smiths - usually with fixed residence.
- Those tin smiths were not of the same itinerant class with which we now [nineteenth century at the time of the writing] associate the term.
- Tinker used to require the epithet "wandering" to distinguish the "Travellers" specifically.
I have no idea how you may read it as confirming that it never referred to the occupation before adopting by association the second meaning.
> Right, so as per your quote, the term referred to Travellers exclusively for centuries
The quote supports what I wrote before:
1) The "mender of kettles, pots, pans, etc.," sense come first.
2) The “gipsy” sense comes later and is derived from it.
What the quote says:
- Tinker was not an uncommon title in the thirteenth century.
- It was used to refer to tin smiths - usually with fixed residence.
- Those tin smiths were not of the same itinerant class with which we now [nineteenth century at the time of the writing] associate the term.
- Tinker used to require the epithet "wandering" to distinguish the "Travellers" specifically.
I have no idea how you may read it as confirming that it never referred to the occupation before adopting by association the second meaning.
> 1) The "mender of kettles, pots, pans, etc.," sense come first.
> 2) The “gipsy” sense comes later and is derived from it.
This is controversial, but even if accepted, that still leaves 4-6 centuries where the term referred exclusively to Travellers before the verb came about directly from that meaning.
> 2) The “gipsy” sense comes later and is derived from it.
This is controversial, but even if accepted, that still leaves 4-6 centuries where the term referred exclusively to Travellers before the verb came about directly from that meaning.
> does it matter how a word is intended or does it matter how a word is received?
If you apply that argument to an ethnic slur that's common where you live, you'll see that it wouldn't be a good product name in an international market.
If you apply that argument to an ethnic slur that's common where you live, you'll see that it wouldn't be a good product name in an international market.
Almost anything can be a slur in some context.
Back in the '90s, people would say "oh he's 'special'" as a slur.
That being said, in a world like we live in today, pretty much anything you say or do will offend someone for some obscure reason that you just can't reasonably anticipate.
It's in these contexts that I think the most appropriate response is "get a life."
Back in the '90s, people would say "oh he's 'special'" as a slur.
That being said, in a world like we live in today, pretty much anything you say or do will offend someone for some obscure reason that you just can't reasonably anticipate.
It's in these contexts that I think the most appropriate response is "get a life."
> Almost anything can be a slur in some context.
Eh, this is a very particular and long-standing racist term, and the meaning used by the authors is derived from the slur, so it's not incidental.
Eh, this is a very particular and long-standing racist term, and the meaning used by the authors is derived from the slur, so it's not incidental.
This does not look like a slur: https://en.wikipedia.org/wiki/Tinker https://www.dictionary.com/browse/tinker
There's also rather significant modern use of "tinker": https://en.wikipedia.org/wiki/Tinker_(disambiguation)
It appears that you're getting stuck on "tinkers", which is mentioned in the above disambiguation page:
> Tinkers, an alternate (and often pejorative) name
Anyway, language is malleable and changes. In this case, I will again emphasize "get a life."
There's also rather significant modern use of "tinker": https://en.wikipedia.org/wiki/Tinker_(disambiguation)
It appears that you're getting stuck on "tinkers", which is mentioned in the above disambiguation page:
> Tinkers, an alternate (and often pejorative) name
Anyway, language is malleable and changes. In this case, I will again emphasize "get a life."
Tinker was a Traveller slur long before the verb - denying that is just wilful ignorance itself. https://www.merriam-webster.com/dictionary/tinker
[deleted]
let's not sanction being niggardly when mooting intent
Good thing it's been forgotten enough that almost nobody knows that, or cares it's the name of this company.
I think if anyone is offended by a word that is not used by anyone in that context, they're probably due for some self-reflection on what offends their sensibilities.
I think if anyone is offended by a word that is not used by anyone in that context, they're probably due for some self-reflection on what offends their sensibilities.
It's definitely not forgotten? What makes you think that? Commonly used in Ireland, the UK, Australia, Canada, parts of the US.
> they're probably due for some self-reflection on what offends their sensibilities.
Or maybe what they're willing to accept?
> they're probably due for some self-reflection on what offends their sensibilities.
Or maybe what they're willing to accept?
You are going on a very weird crusade in this thread. Literally have never heard this in my life used as any kind of slur and here you are arguing with everyone about it.
It is. But honestly, fuck that. It has a colloquial meaning that carries none of that baggage. Instead of retiring the word, why not make the racist definition archaic?
The colloquial meaning carries all of that baggage. You just weren't aware.
> colloquial meaning carries all of that baggage. You just weren't aware
The baggage—hell, all meaning in language—is carried by awareness. We don’t consider the word hostile racist because we’re not ancient Romans facing the hostis.
Maybe there is a cause to censor the word tinker in British English. What there isn’t is censoring it in American or international English.
The baggage—hell, all meaning in language—is carried by awareness. We don’t consider the word hostile racist because we’re not ancient Romans facing the hostis.
Maybe there is a cause to censor the word tinker in British English. What there isn’t is censoring it in American or international English.
How much of the Anglosphere?
I wouldn't touch this until they get serious about having real assurances that they're not going to access customer data without a real, justifiable reason. If Amazon gave themselves free reign to read S3 data it would be outrageous, this is basically the same thing.