Open Euro LLM: Open LLMs for Transparent AI in Europe(openeurollm.eu)
openeurollm.eu
Open Euro LLM: Open LLMs for Transparent AI in Europe
https://openeurollm.eu/launch-press-release
285 comments
I can see that you're unfamiliar with how EU grants and how these project collections work, but I don't have much time to address this with great detail.
As a person who's in this type of projects for a long time, what I can say is "it works", because people do not compete with each other, but will build it together.
What I can say is, if they have came this far, there's already plans about what to do, and how to do, and none of the parties are inexperienced in these kinds of things.
As a person who's in this type of projects for a long time, what I can say is "it works", because people do not compete with each other, but will build it together.
What I can say is, if they have came this far, there's already plans about what to do, and how to do, and none of the parties are inexperienced in these kinds of things.
"It works!" is the only thing that will be visible on web page after hundreds of milions will be burned.
I’m observing few of such „unprecedented” cooperation projects from EU funds. A lot of meetings, a lot of managers, plenty of very unskilled people creating mess and few names doing presentations so companies will believe everybody know what are they doing.
Same from company side - they need being in those projects to comply with stupid EU rules about being eco.
Ball of mud.
Ball of mud.
Europe runs its space programme in this way and so far it has pretty good track record. There are more ways to build stuff than the worship of personality.
I don't think Ariane have a "pretty good track record".
Most expensive bug of all time that crashed a whole rocket, because of outdated and wrong software engineering practice.
They dont innovate, looked down on SpaceX, they have bet against Falcon, and lost the bet.
Now they are betting against the Starship.
> Honestly, I don’t think Starship will be a game-changer or a real competitor
-- ESA chief 2024
https://spacenews.com/europe-aims-to-end-space-access-crisis...
Meanwhile EU members are now launching their public project with SpaceX instead of ESA:
https://www.space.com/space-exploration/spacex-rocket-next-g...
https://apnews.com/article/nasa-spacex-launch-astronauts-pri...
https://www.esa.int/Applications/Observing_the_Earth/IRIDE_p...
Most expensive bug of all time that crashed a whole rocket, because of outdated and wrong software engineering practice.
They dont innovate, looked down on SpaceX, they have bet against Falcon, and lost the bet.
Now they are betting against the Starship.
> Honestly, I don’t think Starship will be a game-changer or a real competitor
-- ESA chief 2024
https://spacenews.com/europe-aims-to-end-space-access-crisis...
Meanwhile EU members are now launching their public project with SpaceX instead of ESA:
https://www.space.com/space-exploration/spacex-rocket-next-g...
https://apnews.com/article/nasa-spacex-launch-astronauts-pri...
https://www.esa.int/Applications/Observing_the_Earth/IRIDE_p...
If your metric of innovation is the amount of rockets exploded at debuts you shouldn't bring up SpaceX really.
The EU had committed to a number of deep space and scientific instrument programmes spanning decades and seen them through to success. It operates its own GNSS constellation. It is second only to NASA. Calling it a failure is ridiculous.
The EU had committed to a number of deep space and scientific instrument programmes spanning decades and seen them through to success. It operates its own GNSS constellation. It is second only to NASA. Calling it a failure is ridiculous.
I suspect the previous poster's metric of innovation was more along the lines of:
* developing the first meaningful fully-reusable first stage rocket, and continuing to develop it to the extent that no other launch systems are even in the same ballpark as regards cost, cadence, or mass to orbit
* developing, and continuing to develop, the only full-flow staged combustion rocket engine
* developing, and continuing to develop, a novel, completely-reusable, next-generation very-heavy-lift platform, before any of the competition have even caught with their previous generation
* (to your snarky point about explosions) demonstrating that moving fast, evolving designs quickly, and not being afraid to (be seen to) fail (in the short term, in the court of public opinion, etc.) in the pursuit of success is much better than the traditional conservative approach (e.g. NASA, Blue Origin, etc.)
I'm well aware that giving credit to anything related to Musk is increasingly difficult for some people at the moment, but let's give credit where it's due to SpaceX and its engineers.
* developing the first meaningful fully-reusable first stage rocket, and continuing to develop it to the extent that no other launch systems are even in the same ballpark as regards cost, cadence, or mass to orbit
* developing, and continuing to develop, the only full-flow staged combustion rocket engine
* developing, and continuing to develop, a novel, completely-reusable, next-generation very-heavy-lift platform, before any of the competition have even caught with their previous generation
* (to your snarky point about explosions) demonstrating that moving fast, evolving designs quickly, and not being afraid to (be seen to) fail (in the short term, in the court of public opinion, etc.) in the pursuit of success is much better than the traditional conservative approach (e.g. NASA, Blue Origin, etc.)
I'm well aware that giving credit to anything related to Musk is increasingly difficult for some people at the moment, but let's give credit where it's due to SpaceX and its engineers.
The snarky point of explosions wasn't mine, the poster I replied to brought it up.
The rest of your points is really one item, launch vehicles. It's where the USA clearly has the lead (above everyone else, not just ESA in particular). The question was whether the EU can successfully manage complex projects and it clearly can, suggesting otherwise is delirious.
The rest of your points is really one item, launch vehicles. It's where the USA clearly has the lead (above everyone else, not just ESA in particular). The question was whether the EU can successfully manage complex projects and it clearly can, suggesting otherwise is delirious.
I'm not following you.
The previous poster was basically supportive of SpaceX, talked about innovation, and didn't mention explosions at all. You wrote "If your metric of innovation is the amount of rockets exploded at debuts you shouldn't bring up SpaceX really." I interpreted this as a snarky reference to the fact the lots of SpaceX rockets have blown up - mostly due to their different approach to development.
The comment implying that SpaceX isn't innovative is what I was replying to - that looking at the work that SpaceX does (and not the whole pantheon of other space-related work it's not involved in) it's demonstrably innovative in a way that ESA just isn't (e.g. with Ariane).
The previous poster was basically supportive of SpaceX, talked about innovation, and didn't mention explosions at all. You wrote "If your metric of innovation is the amount of rockets exploded at debuts you shouldn't bring up SpaceX really." I interpreted this as a snarky reference to the fact the lots of SpaceX rockets have blown up - mostly due to their different approach to development.
The comment implying that SpaceX isn't innovative is what I was replying to - that looking at the work that SpaceX does (and not the whole pantheon of other space-related work it's not involved in) it's demonstrably innovative in a way that ESA just isn't (e.g. with Ariane).
The poster I replied to brought up Ariane 5 crash as the example of ESA dysfunction while being very positive about SpaceX. SpaceX had lost plenty launch vehicles both in testing and with live payloads, just ask Zuckerberg. I pointed out the contradiction there.
> developing the first meaningful fully-reusable first stage rocket, and continuing to develop it to the extent that no other launch systems are even in the same ballpark as regards cost, cadence, or mass to orbit.
The space shuttle solid boosters were reusable, the only part of the space shuttle program that wasn't, was the big orange tank.
https://en.m.wikipedia.org/wiki/Space_Shuttle_Solid_Rocket_B...
The space shuttle solid boosters were reusable, the only part of the space shuttle program that wasn't, was the big orange tank.
https://en.m.wikipedia.org/wiki/Space_Shuttle_Solid_Rocket_B...
Eh, I knew someone was going to nit-pick this point, which was why I wrote "first meaningful fully-reusable first stage rocket" but obviously this wasn't enough. :)
I too, was certain there would be a "he said meaningful" follow up. ;)
Ariane 5 exploded with 4 satellites because they copy pasted code of the Ariane 4: https://en.wikipedia.org/wiki/Ariane_flight_V88
It's the most expensive bug in history. On the other hand, you are bringing up explosions of empty rockets that are launched as test, that's bad faith.
Look at the launch history and the Falcon 9 is simply more reliable than the Ariane 5:
https://en.wikipedia.org/wiki/Falcon_9#Launch_outcomes
https://en.wikipedia.org/wiki/Ariane_5#Launch_statistics
I did not said it was a failure, I said, they do not have a "pretty good track record". ESA burn through EU money, and wont care to innovate as long as EU provide them unlimited money and dont pressure them. It's an ivory tower.
It's the most expensive bug in history. On the other hand, you are bringing up explosions of empty rockets that are launched as test, that's bad faith.
Look at the launch history and the Falcon 9 is simply more reliable than the Ariane 5:
https://en.wikipedia.org/wiki/Falcon_9#Launch_outcomes
https://en.wikipedia.org/wiki/Ariane_5#Launch_statistics
I did not said it was a failure, I said, they do not have a "pretty good track record". ESA burn through EU money, and wont care to innovate as long as EU provide them unlimited money and dont pressure them. It's an ivory tower.
> It operates its own GNSS constellation.
Only 33 years later and mostly launched on Russian rockets, behind GLONASS and BeiDou.
> It is second only to NASA. Calling it a failure is ridiculous.
In what respect? Space? Certainly not, far behind the US and Russia and questionably competitive with China.
Economically? Behind US and China.
R&D? Behind US and China.
Manufacturing? Behind US and China.
You are refusing to recognise reality.
Only 33 years later and mostly launched on Russian rockets, behind GLONASS and BeiDou.
> It is second only to NASA. Calling it a failure is ridiculous.
In what respect? Space? Certainly not, far behind the US and Russia and questionably competitive with China.
Economically? Behind US and China.
R&D? Behind US and China.
Manufacturing? Behind US and China.
You are refusing to recognise reality.
Russia had its last deep space mission (failed) in 1996. GLONASS did not operate until 2005.
Chinese contributions to scientific space missions had been very modest although am sure they may catch up later.
NASA has 3x the budget of ESA. The question was if the EU method of doing project works and it does in very unambiguous manner.
Chinese contributions to scientific space missions had been very modest although am sure they may catch up later.
NASA has 3x the budget of ESA. The question was if the EU method of doing project works and it does in very unambiguous manner.
> GLONASS did not operate until 2005.
Five years before Galileo.
> The question was if the EU method of doing project works and it does in very unambiguous manner.
As the EU falls economically and scientifically behinds what used to be our peers, it's obvious that it _doesn't_ work. Refusing to recognise that reality is a spectacular example of the Ostrich effect,
Five years before Galileo.
> The question was if the EU method of doing project works and it does in very unambiguous manner.
As the EU falls economically and scientifically behinds what used to be our peers, it's obvious that it _doesn't_ work. Refusing to recognise that reality is a spectacular example of the Ostrich effect,
It works as good as our energy policy.
Ah there are other well working policies in the EU like the migration of skilled workers.
All works well /S
Ah there are other well working policies in the EU like the migration of skilled workers.
All works well /S
It works great!
sadly the results are way behind it's peers, but method is great!
sadly the results are way behind it's peers, but method is great!
Yeah sure ESA lands a probe on bloody Titan while its peers crash land on the Moon but the results are "way behind". Delirious.
Are you talking about Huygens? That was launched on a Titan IV in 1997(!) and landed in 2005!
In 1997, the EU was a global economic and scientific powerhouse. We're talking about the ossification in the last 15-20 years that has not only allowed the US to leapfrog Europe as the largest economy, but China too.
You are bordering on delusional with these comments.
In 1997, the EU was a global economic and scientific powerhouse. We're talking about the ossification in the last 15-20 years that has not only allowed the US to leapfrog Europe as the largest economy, but China too.
You are bordering on delusional with these comments.
Was that literally you who complained that Galileo was too new? Is Huygens too old now? Well take your pick:
https://en.wikipedia.org/wiki/Category:European_Space_Agency...
https://en.wikipedia.org/wiki/Category:European_Space_Agency...
Not all satellite systems are equal:
https://www.bloomberg.com/news/articles/2023-09-20/russia-s-...
>The US constellation isn’t as accurate as the newer networks, said Roberts, the Sydney-based professor. “It used to be GPS was out in front,” he said. Now, though, the EU’s Galileo is in the lead, with China’s BeiDou close behind, he said.
It's basically Galileo > BeiDou > GPS >>> GLONASS.
https://www.bloomberg.com/news/articles/2023-09-20/russia-s-...
>The US constellation isn’t as accurate as the newer networks, said Roberts, the Sydney-based professor. “It used to be GPS was out in front,” he said. Now, though, the EU’s Galileo is in the lead, with China’s BeiDou close behind, he said.
It's basically Galileo > BeiDou > GPS >>> GLONASS.
That would be expected for a system launched 33 years later, but in Galileo and GPS are identical for civilian use (and obviously no-one knows the military capabilities of Block III satellites as that's undisclosed).
GPS+Gailleo is the current SOTA, but it's nonsense to say Galileo is "best".
GPS+Gailleo is the current SOTA, but it's nonsense to say Galileo is "best".
And frankly accuracy does not matter.
for navigation using Code method GPS-tier is basically good enough.
for precise measurement you use phase measurement of the signal, and what you care about is good(low) DoP of constellation and amount of satellites within sight-line - not from which system they come(to oversimplfy it a bit)
for navigation using Code method GPS-tier is basically good enough.
for precise measurement you use phase measurement of the signal, and what you care about is good(low) DoP of constellation and amount of satellites within sight-line - not from which system they come(to oversimplfy it a bit)
> It operates its own GNSS constellation.
Galileo did not start as an EU programme. China used to be member!
What other EU programmes did you have in mind? The EU's efforts not even seem comparable to the European Space Agency (which is not part of the EU) let alone NASA.
Galileo did not start as an EU programme. China used to be member!
What other EU programmes did you have in mind? The EU's efforts not even seem comparable to the European Space Agency (which is not part of the EU) let alone NASA.
> most expensive bug of all time that crashed a whole rocket
being valued at $ 370 million in 1996 that bug was recently dwarved by crowd strikes multi-billion-dollar disaster in 2024
being valued at $ 370 million in 1996 that bug was recently dwarved by crowd strikes multi-billion-dollar disaster in 2024
> Europe runs its space programme
Different Europe. The ESA is is not an EU agency so it runs by its own rules, its members include several non-EU countries, it has a non-European "cooperating state" and its funding is direct from member states.
https://www.esa.int/About_Us/Corporate_news/Member_States_Co...
Different Europe. The ESA is is not an EU agency so it runs by its own rules, its members include several non-EU countries, it has a non-European "cooperating state" and its funding is direct from member states.
https://www.esa.int/About_Us/Corporate_news/Member_States_Co...
Which are the non-member states still? Is that post Brexit UK and Norway (the EEA member)?
Full details here: https://www.esa.int/About_Us/Corporate_news/Member_States_Co...
Also, not all EU states are ESA member states.
Canada is on the ESA governing council, and takes part in projects.
In the context of Eu grants being discussed in this thread, its financing arrangements are very different from those, so its irrelevant to discussing the effectiveness or not of those.
Also, not all EU states are ESA member states.
Canada is on the ESA governing council, and takes part in projects.
In the context of Eu grants being discussed in this thread, its financing arrangements are very different from those, so its irrelevant to discussing the effectiveness or not of those.
The only thing the European space program has consistently done right is using the metric system (https://en.wikipedia.org/wiki/Mars_Climate_Orbiter)
Europe honestly had pretty... mid track record for space program.
should i bring up Galileo and how many years it took?
should i bring up Galileo and how many years it took?
As someone who has lived through Eurostar and Horizon 2020, and who has participated as both a researcher and corporate partner, I can say: it does not work.
Unless by work you mean "successfully passed the post-project review by non-experts based on a bunch of slides"
Point at a single project of this sort that had any tangible output that's still in use.
Unless by work you mean "successfully passed the post-project review by non-experts based on a bunch of slides"
Point at a single project of this sort that had any tangible output that's still in use.
I once registered as an "expert" on those EU related websites in the hope to be invited to an event where I could network.
Next thing I know one of those Horizon 2020 project send me 20 proposals to evaluate and select by next week. Each of them was 50-100 pages long, mostly BS.
I couldn't really do any real due diligence and I don't believe anybody did any on me. So just create register fake domain names to get a fake corporate email addresses, create a fake LinkedIn profiles and you can have a significant weight in the selection process for grants. It is that simple.
I remember it made me feel sick in my stomach to think that the money that would be given through my evaluation was most likely equivalent to one year of tax revenue from a random honest small business.
Next thing I know one of those Horizon 2020 project send me 20 proposals to evaluate and select by next week. Each of them was 50-100 pages long, mostly BS.
I couldn't really do any real due diligence and I don't believe anybody did any on me. So just create register fake domain names to get a fake corporate email addresses, create a fake LinkedIn profiles and you can have a significant weight in the selection process for grants. It is that simple.
I remember it made me feel sick in my stomach to think that the money that would be given through my evaluation was most likely equivalent to one year of tax revenue from a random honest small business.
Where did you register yourself as an expert? Asking for a friend.
Oh man hard to remember. I can just tell you it was not on the official EU website. It was on a thematic one that probably doesn't exist anymore, something like "The coalition for the development of X in Europe".
What I also discovered is often let's say the EU wants to give 10M to 10 projects in a particular domain. Then a there are companies specialised in applying as a project and saying: our project is actually to subdivide this 1M into 8 times 100K and we keep 200K as a fee (I am simplifying but that was the idea).
What I also discovered is often let's say the EU wants to give 10M to 10 projects in a particular domain. Then a there are companies specialised in applying as a project and saying: our project is actually to subdivide this 1M into 8 times 100K and we keep 200K as a fee (I am simplifying but that was the idea).
> Point at a single project of this sort that had any tangible output that's still in use.
Not sure what is your limiting factor (just universities + industry consortiums or explicit IT projects?).
Graphene Flagship might be an example, with their research on Graphene they contributed to the foundation of more efficient batteries and solar panels, innovation in automotive and commercial products and so on.
Clean Sky Joint Undertaking (CSJU) also had quite some impact on the industry (I think it was part of EU's Horizon 2020). They worked on technologies to reduce CO2 emissions and noise of Aircrafts and contributed quite a bit to the European industry (Rotor engine innovations, advanced greener materials, etc.)
And I think the discovery of the Higgs boson was also the result of a European Research consortium with CERN...
So yeah, Europe is surely not the center of all innovation and economic efficiency, but I wouldn't demonize every attempt to change that...
Not sure what is your limiting factor (just universities + industry consortiums or explicit IT projects?).
Graphene Flagship might be an example, with their research on Graphene they contributed to the foundation of more efficient batteries and solar panels, innovation in automotive and commercial products and so on.
Clean Sky Joint Undertaking (CSJU) also had quite some impact on the industry (I think it was part of EU's Horizon 2020). They worked on technologies to reduce CO2 emissions and noise of Aircrafts and contributed quite a bit to the European industry (Rotor engine innovations, advanced greener materials, etc.)
And I think the discovery of the Higgs boson was also the result of a European Research consortium with CERN...
So yeah, Europe is surely not the center of all innovation and economic efficiency, but I wouldn't demonize every attempt to change that...
Graphene Flagship was an irredeemable disaster. €1 B pumped into research and commercialisation and the result is a DOA graphene industry in the EU, left in the dust by China and the US.
Clean Sky Joint Undertaking was also a disaster that missed all its targets.
As stated elsewhere, CERN is a cautionary tale - the LHC is a vestige of a time when Europe was an economic and scientific powerhouse. If the last 15-20 years we have become an also-ran to the US and China.
There's an endless list of these soft failed Horizon projects:
* Human Brain Project * European Processor Initiative * Innovative Medicines Initiative * LIGHTest * The Once-Only Principle Project * OpenAIRE * Quantum Flagship
And on and on. No results. No ROI.
Clean Sky Joint Undertaking was also a disaster that missed all its targets.
As stated elsewhere, CERN is a cautionary tale - the LHC is a vestige of a time when Europe was an economic and scientific powerhouse. If the last 15-20 years we have become an also-ran to the US and China.
There's an endless list of these soft failed Horizon projects:
* Human Brain Project * European Processor Initiative * Innovative Medicines Initiative * LIGHTest * The Once-Only Principle Project * OpenAIRE * Quantum Flagship
And on and on. No results. No ROI.
> Graphene Flagship was an irredeemable disaster
According to whom, based on which metric?
This is foundational material and chemistry research, with UK, Germany and Spain at the forefront for an industry which will probably need another 10 years to fully unfold.
For sure other China and US were able to invest more, but should the EU have not invested at all?
> Clean Sky Joint Undertaking was also a disaster
Also here, based on which metric?
The cost was split in half among the EU and industry players, and those companies (i.e. Airbus, Saab, Rolls-Royce, Safran, Liebherr, Thales) are all still at the forefront of their respective industries, despite competition from much larger markets. It's a sensible strategy to support them while steering aspects of their R&D towards a specific set of common goals for the EU.
Yeah, among others they had a goal of achieving a 50% cut in CO2 emissions just by improving fuel efficiency, a quite ambitious goal they didn't reach. But they set and co-funded the direction and achieved a 30% reduction.
They also had a goal of achieving 50% noise reduction for aircrafts, and ultimately developed concepts with up to 70% lower noise-production. Without such funding I doubt that such research would have even been conducted.
--
So yes, there's a much larger list of failed Horizon projects, fully agree. And many of them shouldn't even exist in hindsight. But it's research, it's supposed to be an uncertain field with uncertain commercial value. I rather have the EU fund 5 moonshots with 3 of them questionable than decide to not fund any research in Europe unless the commercial value is first proven by someone else.
There are areas I don't know how they would even be funded by a for-profit market without such initiatives, like the Rail Joint Undertaking which aims to develop and harmonize the European rail system across borders of EU countries.
According to whom, based on which metric?
This is foundational material and chemistry research, with UK, Germany and Spain at the forefront for an industry which will probably need another 10 years to fully unfold.
For sure other China and US were able to invest more, but should the EU have not invested at all?
> Clean Sky Joint Undertaking was also a disaster
Also here, based on which metric?
The cost was split in half among the EU and industry players, and those companies (i.e. Airbus, Saab, Rolls-Royce, Safran, Liebherr, Thales) are all still at the forefront of their respective industries, despite competition from much larger markets. It's a sensible strategy to support them while steering aspects of their R&D towards a specific set of common goals for the EU.
Yeah, among others they had a goal of achieving a 50% cut in CO2 emissions just by improving fuel efficiency, a quite ambitious goal they didn't reach. But they set and co-funded the direction and achieved a 30% reduction.
They also had a goal of achieving 50% noise reduction for aircrafts, and ultimately developed concepts with up to 70% lower noise-production. Without such funding I doubt that such research would have even been conducted.
--
So yes, there's a much larger list of failed Horizon projects, fully agree. And many of them shouldn't even exist in hindsight. But it's research, it's supposed to be an uncertain field with uncertain commercial value. I rather have the EU fund 5 moonshots with 3 of them questionable than decide to not fund any research in Europe unless the commercial value is first proven by someone else.
There are areas I don't know how they would even be funded by a for-profit market without such initiatives, like the Rail Joint Undertaking which aims to develop and harmonize the European rail system across borders of EU countries.
My experience from these projects is the opposite. The projects are always secondary priorities for participants, and the difficulty of coordinating some dozen entirely separate organisations towards something actually productive is immense. In practice each participant independently spends the money they get on something lightly relevant, and the occasional coordination meetings are spent on planning how to fulfill the reporting requirements of the grant.
Business and research are difficult enough even when done by tightly knit teams and constantly tested against real world systems and customer feedback. The idea that a hodgepodge of organisations can achieve poorly defined yet aspirational goals on a low budget is massively misguided.
Business and research are difficult enough even when done by tightly knit teams and constantly tested against real world systems and customer feedback. The idea that a hodgepodge of organisations can achieve poorly defined yet aspirational goals on a low budget is massively misguided.
> I can see that you're unfamiliar with how EU grants and how these project collections work, but I don't have much time to address this with great detail.
This is a take that can only come from someone who is dependent on Horizon, because I don't think any independent observer could look at Horizon projects and say they just work.
This is a take that can only come from someone who is dependent on Horizon, because I don't think any independent observer could look at Horizon projects and say they just work.
> This is a take that can only come from someone who is dependent on Horizon.
No, I'm not dependent on Horizon Programme. I just look at what we did, the outcomes, and talk from that point.
Maybe our sphere is one of the ones which deliver. I can't see the whole thing, it's too big to observe. Even if we're in the 5% which delivers, which is same with the startup scene, which is loudly applauded because it's an incredibly well working system.
No, I'm not dependent on Horizon Programme. I just look at what we did, the outcomes, and talk from that point.
Maybe our sphere is one of the ones which deliver. I can't see the whole thing, it's too big to observe. Even if we're in the 5% which delivers, which is same with the startup scene, which is loudly applauded because it's an incredibly well working system.
You are maybe in 0.005%. If project has even a presentation at the end it’s already being considered successful. And I thought it’s maybe Poland only, but Germant and France is the same (I’ve seen this myself, not heard from 3rd party)
It's not only Poland. I've had the misfortune of suffering through a couple Horizon projects, with partners from many European countries. Same experience as you had. "These are not serious people" sums it up.
Start-ups deliver something much more complicated/different than these research projects.
If the whole research project at the end actually delivers a somewhat coherent prototype, it's seen as a huge success.
Most start-ups start with a proof-of-concept prototype to transform it into an economically viable product.
So, comparing these success rates does not make sense. Multiple research groups can deliver rough prototypes at the end and celebrate their "huge success". In most fields, there can be only a few economically surviving startups...
If the whole research project at the end actually delivers a somewhat coherent prototype, it's seen as a huge success.
Most start-ups start with a proof-of-concept prototype to transform it into an economically viable product.
So, comparing these success rates does not make sense. Multiple research groups can deliver rough prototypes at the end and celebrate their "huge success". In most fields, there can be only a few economically surviving startups...
What did you actually deliver in which project? Not really expecting a real answer here as far as I have seen all Horizon Programms are just trash that has no commercial use.
[deleted]
Having worked on an FP7 programme myself and having a family member involved in project audits, I’d say some skepticism is warranted—particularly regarding the incentives that attract private sector partners and the talent they actually allocate once funds are secured.
Funding is tied to employee qualifications and effectively subsidises salaries, which creates room for misalignment. No-shows of allocated employees were not uncommon, since a company willing to accept lower-quality deliverables can assign junior employees to do the work at a fraction of the cost, while the salary difference for their PhDs simply becomes added margin.
Funding is tied to employee qualifications and effectively subsidises salaries, which creates room for misalignment. No-shows of allocated employees were not uncommon, since a company willing to accept lower-quality deliverables can assign junior employees to do the work at a fraction of the cost, while the salary difference for their PhDs simply becomes added margin.
Can you tell me please what you worked on and where I can see the output? I’ve been adjacent to these kind of efforts and the only thing I can say is that I’m highly skeptical of your claims.
In the case of Quaero [1] "it did not work". Sure, all involved parties were praising the project and by constantly shifting goalposts they could label it a success, but in the end it was a huge waste of money, sucked in by the usual suspects.
[1] https://en.wikipedia.org/wiki/Quaero
[1] https://en.wikipedia.org/wiki/Quaero
> it was a huge waste of money, sucked in by the usual suspects
other example: https://en.wikipedia.org/wiki/Gaia-X
other example: https://en.wikipedia.org/wiki/Gaia-X
While I do think EU grants are a good thing, I'm sceptic about these too-big-to-fail multi-national projects. I still remember the Human Brain Project.
I largely see this type of collaboration as a very inefficient form of a distributed company (team) where members of that team do not have other incentive but to (mostly) collect points on research papers. There is no incentive to actually build a product in such a setting and there is no incentive to remain competitive since you cannot be fired, or penalized in some other form. And generally speaking, as an individual you don't care about the industry (market) competition since you mostly care about remaining relevant within your very narrow scope of your research topic. So, this is why this doesn't work. There is no coherent mass toward the same goal. Seemingly there is but there isn't.
This is a Horizon grant, meaning:
I'm in many European projects of this kind for close to two decades. These projects do not result in papers. They result in deliverables (documents and what you are intending to build), and they deliver. While I can't go into details, the atmosphere is never an "academic" one, but it's connected to real world. We sometimes work with commercial entities to improve their know-how and abilities, too. Many of the projects have commercial partners which commercialize these technologies, esp in earth/ecosystem observation.
Sometimes we support them for free, because they need to do the research to be able to show what they are doing for an initial grant. It's not about money, fame, having a corner office with free flowing grant money or travel.
People do this to improve the world around them and make an impact, and we don't fight over wins. We drink coffee and work hard to deliver what we promised.
Lastly, I don't get the grant money. It's just deposited to institution account. I have no monetary or material gain from this.
- There's continuous reporting, and money is not guaranteed.
- You can be removed from the project by not meeting project goals on time.
- (In this case) There are corporations which are planning to commercialize this thing.
- There's a concrete and sound roadmap, and it's evaluated in a competition by an independent body and got selected.
- Without a sound landscape survey, you can't get this type of grant, so free market forces are included.
- ...and more (I'm trying to be concise).
I'm in many European projects of this kind for close to two decades. These projects do not result in papers. They result in deliverables (documents and what you are intending to build), and they deliver. While I can't go into details, the atmosphere is never an "academic" one, but it's connected to real world. We sometimes work with commercial entities to improve their know-how and abilities, too. Many of the projects have commercial partners which commercialize these technologies, esp in earth/ecosystem observation.
Sometimes we support them for free, because they need to do the research to be able to show what they are doing for an initial grant. It's not about money, fame, having a corner office with free flowing grant money or travel.
People do this to improve the world around them and make an impact, and we don't fight over wins. We drink coffee and work hard to deliver what we promised.
Lastly, I don't get the grant money. It's just deposited to institution account. I have no monetary or material gain from this.
> IOW, these kinds of projects are not parades for free money.
No, they are subsidies for uncompetitive R&D teams. They are spectacularly inefficient, for all the reasons you mention. Teams specialise in Horizon funding, not actual progress.
> Lastly, I don't get the grant money. It's just deposited to institution account. I have no monetary or material gain from this.
Aha, so your team is funded by Horizon. What's the old saying about people and understanding where their paycheques come from?
No, they are subsidies for uncompetitive R&D teams. They are spectacularly inefficient, for all the reasons you mention. Teams specialise in Horizon funding, not actual progress.
> Lastly, I don't get the grant money. It's just deposited to institution account. I have no monetary or material gain from this.
Aha, so your team is funded by Horizon. What's the old saying about people and understanding where their paycheques come from?
"Yeah uh you don't understand how this works. I don't have the time to tell you why, just believe me, it works. Oh also they give us money."
I'm not entirely convinced...
I'm not entirely convinced...
Lot of comments here and in other topics are also just vague hot takes. But somehow you need to be served.
Sorry, you know, I have work to do, so I can't spend an hour and write a blog post for you here.
Plus, I'm not here to convince anybody. I'm just sharing my own experience. It's up to you to dig further if you're so interested in this thing.
Have a nice day.
Plus, I'm not here to convince anybody. I'm just sharing my own experience. It's up to you to dig further if you're so interested in this thing.
Have a nice day.
That would have been a somewhat reasonable (although unconvincing) reply if you didn't also write 7 other lengthy comments in this thread that were 3 hours apart
> Plus, I'm not here to convince anybody.
Well, I think it's safe to say mission accomplished.
Your comments here are why entities have media policies. Probably thousands of peoples will have read your comments and the responses to them and many will have formed their first impression of Horizon from this thread.
Well, I think it's safe to say mission accomplished.
Your comments here are why entities have media policies. Probably thousands of peoples will have read your comments and the responses to them and many will have formed their first impression of Horizon from this thread.
The criticism here is the system, not the people. And you seem to defend the system which has been proved to be inefficient and shady. You also seem to take this personally which you really shouldn't. People here are also sharing their views and experience and you have to acknowledge that it doesn't have to necessarily reflect yours.
Of course, people don't have to agree with me, and I didn't take the issue personally, except that particular comment because of its tone and language.
There are other criticisms for the system, and I didn't either answer them, or answered more broadly. Again, what I have seen is the system was working for the parts I was in, and may not be working for the others, and I'm not defending the contrary.
Every coin has at least two sides, and I'm not a god. I can only comment on what I can see and experience.
There are other criticisms for the system, and I didn't either answer them, or answered more broadly. Again, what I have seen is the system was working for the parts I was in, and may not be working for the others, and I'm not defending the contrary.
Every coin has at least two sides, and I'm not a god. I can only comment on what I can see and experience.
I am familiar with Horizon and EU grant funds and how these projects are managed - basically a big waste of time and money without concrete results with plenty of bureaucracy crawling the project ideas and resources to the halt. I am not saying that because I think people are not hard working, I am just saying that the process as it is is not fit to produce something (market) competitive. Process is there to serve its own purpose.
You mention deliverables as document specs? Those are not the deliverables. The deliverables are products that gain traction and see success on the market or research topics that gain traction in the academia because of their groundbreaking methods. That in sufficiently short period of time because otherwise you cannot remain competetive. Leaving "commercialization" on the table while we figure out something is also what is wrong with the system. The world does not wait for EU to commercialize the idea that has been put into a document 5 years ago.
I can give concrete examples of many large EU companies and institutions, because they are just that and they have a lot of power, getting millions of EURs just to produce BIG nothing. Innovation is not at the heart of these projects. Mostly subpar engineers with no deep science research.
Can you list me few examples of successful projects you have in mind? Why, for example, Mistral AI isn't among them?
You mention deliverables as document specs? Those are not the deliverables. The deliverables are products that gain traction and see success on the market or research topics that gain traction in the academia because of their groundbreaking methods. That in sufficiently short period of time because otherwise you cannot remain competetive. Leaving "commercialization" on the table while we figure out something is also what is wrong with the system. The world does not wait for EU to commercialize the idea that has been put into a document 5 years ago.
I can give concrete examples of many large EU companies and institutions, because they are just that and they have a lot of power, getting millions of EURs just to produce BIG nothing. Innovation is not at the heart of these projects. Mostly subpar engineers with no deep science research.
Can you list me few examples of successful projects you have in mind? Why, for example, Mistral AI isn't among them?
>Can you list me few examples of successful projects you have in mind? Why, for example, Mistral AI isn't among them?
Yeah, I was surprised too. I would expect Mistral to jump on the band wagon if only to get some easy EU funding.
Yeah, I was surprised too. I would expect Mistral to jump on the band wagon if only to get some easy EU funding.
"They result in deliverables"
I had a _so_ different experience after being involved in two of them...
I had a _so_ different experience after being involved in two of them...
> There is no incentive to actually build a product in such a setting and there is no incentive to remain competitive since you cannot be fired, or penalized in some other form
That sounds horrible and stressful to be honest.
That sounds horrible and stressful to be honest.
I won't disagree but it's the most effective way of getting an edge over the competition. Without the "reward and punishment" system in place, how else do you get that extra mile from your engineers? How else do you find an incentive to reduce the fat in the management structure? USA companies know how to do this very well and you cannot remain competitive unless you're willing to do the same or find some other similar system.
When has it ever worked?
Remember the EU Search Engine project, Quaero, and its equally failed successor, Theseus? No? I thought so.
Remember the EU Search Engine project, Quaero, and its equally failed successor, Theseus? No? I thought so.
Can you tell us about a project like this that worked?
The Large Hadron Collider clearly works and is infinitely more complex than yet another language model.
The LHC is comparably complex to LLMs and CERN is a cautionary tale. The web was invented there and yet the vast majority of the subsequent innovation and economic benefit coalesced in the US because the European countries were culturally unable to capitalise on it.
Also in Germany, their leading solar energy technology became unprofitable in the global market and was sold to China (see what happened to Q-Cells [1]). The EU can publicly finance research all they want, but if the results of which gets profited by private interests of any nationality not necessarily EU countries how does that help the EU catch up?
But this does seem different since they plan on building open-source models which would benefit everyone equally (and no one in particular), it would just level the playing field more I guess?
I think this and things like MCP [2] are fantastic, they would make the LLM just one interchangeable piece you can buy from anywhere or host yourself.
[1] https://en.wikipedia.org/wiki/Qcells
[2] https://modelcontextprotocol.io/introduction
But this does seem different since they plan on building open-source models which would benefit everyone equally (and no one in particular), it would just level the playing field more I guess?
I think this and things like MCP [2] are fantastic, they would make the LLM just one interchangeable piece you can buy from anywhere or host yourself.
[1] https://en.wikipedia.org/wiki/Qcells
[2] https://modelcontextprotocol.io/introduction
LLMs are not "comparably complex" to LHC, they are perhaps 0.1% of the complexity from engineering POV. By any metric, from system design to physical infrastructure to run them.
Yeah the bar to entry for LLM is far far lower.
CERN is a scientific marvel.
CERN is a scientific marvel.
They had to design a reference standard quality nanovoltmeter because HP/Agilent could not keep up with volume & cost. And it was only one among scores of side quests.
https://hackaday.com/2021/02/26/homebrew-metrology-the-cern-...
https://hackaday.com/2021/02/26/homebrew-metrology-the-cern-...
The fallout from CERN is incredible. It really shows what's possible with these kinds of multiple decade projects.
Reminds me of the Civilisation Wonders you could build.
Reminds me of the Civilisation Wonders you could build.
The LHC indeed works, as a device. But what was it's purpose and did it do "meaningful" stuff over its lifetime? LHC is a yet another collider which basically can be boiled to the simple idea:
Some scientists invent hypotheses with no basis in reality, and say that they can be proven with a big and expensive collider. When that collider is being built and fail to find the requisite particles, those same scientists say they need a bigger and more expensive collider. GoTo 01.
A lot of these scientists fail to explain what will happen when their hypotheses won't find the requisite particles, essentially generating meaningless papers which are blind stabs at reality. It's like saying that leprechauns exist, but to see them we need a 100 billion euro device. And if we do build it fail to see it, then whoops, it wasn't enough.
tl;dr: LHC is not a particularly good example of proper scientific achievement. More like an achievement in PR and budget grants. Per positive scientific discovery produced there.
Some scientists invent hypotheses with no basis in reality, and say that they can be proven with a big and expensive collider. When that collider is being built and fail to find the requisite particles, those same scientists say they need a bigger and more expensive collider. GoTo 01.
A lot of these scientists fail to explain what will happen when their hypotheses won't find the requisite particles, essentially generating meaningless papers which are blind stabs at reality. It's like saying that leprechauns exist, but to see them we need a 100 billion euro device. And if we do build it fail to see it, then whoops, it wasn't enough.
tl;dr: LHC is not a particularly good example of proper scientific achievement. More like an achievement in PR and budget grants. Per positive scientific discovery produced there.
LHC had confirmed the existence of Higgs boson, essentially validating then-hypothetical mechanism for emergence of mass. It also had ruled out a very popular, theoretically beautiful but as it turned out invalid direction of physics studies. You can argue whether it was worth the cost but it was a genuine, significant experimental achievement.
It was also certainly not a PR stunt as it was truly an insanely complex piece of engineering. It is one of humanity's largest technological undertakings ever. Projects of this scale are still beyond the means even of the world's richest oligarchs. But it is a fine example of the things you can achieve in an enormous but well functioning multi-national bureaucracy.
It was also certainly not a PR stunt as it was truly an insanely complex piece of engineering. It is one of humanity's largest technological undertakings ever. Projects of this scale are still beyond the means even of the world's richest oligarchs. But it is a fine example of the things you can achieve in an enormous but well functioning multi-national bureaucracy.
They are not hard to find: The EU literally gives you access to all their projects in the CORDIS database:
https://cordis.europa.eu/
https://cordis.europa.eu/
All talk. No show. That's EU.
I'll believe it works after they finally have one success
I'll believe it works after they finally have one success
Would you consider for example Firefox' completely-local translations a success?
Directly funded by Horizon, made by a consortium of 4 European universities, now a part of Firefox?
Directly funded by Horizon, made by a consortium of 4 European universities, now a part of Firefox?
7 languages and a feature nobody to a rounding error uses? No, I don't consider that to be a research, economic, or technical success.
Honestly, I'm not sure if you posted this is support of Horizon or against? The Horizon budget for 2021-2027 is €95.5 billion or ~€15 billion per annum. If a headline "success" is an unfinished implementation of translation in Firefox of a translation engine (Marian) built by the Microsoft Translator team, then it's safe to say Horizon is an unqualified failure.
Honestly, I'm not sure if you posted this is support of Horizon or against? The Horizon budget for 2021-2027 is €95.5 billion or ~€15 billion per annum. If a headline "success" is an unfinished implementation of translation in Firefox of a translation engine (Marian) built by the Microsoft Translator team, then it's safe to say Horizon is an unqualified failure.
I don't have the numbers at hand or know if they're even public somewhere, but telemetry shows that Firefox Translations is used a lot. Definitely on the list of successful new Firefox features.
(I'm a Mozilla employee, but I have not worked on Firefox Translations.)
(I'm a Mozilla employee, but I have not worked on Firefox Translations.)
>I don't have the numbers at hand
Is this it?
https://glam.telemetry.mozilla.org/fog/probe/translations_re...*
Is this it?
https://glam.telemetry.mozilla.org/fog/probe/translations_re...*
Hmm, I'm not sure, but I'm not sure how to read that page either. That graph has a lot more variability than I'd expect though.
What is a lot?
Before integration, it had ~490 users as an extension, vs ~800,000 for To Google Translate, the number one option.
Offline translation has to be manually enabled per language in Settings.
Frankly I don't believe there's any meaningful usage until I see the numbers.
Before integration, it had ~490 users as an extension, vs ~800,000 for To Google Translate, the number one option.
Offline translation has to be manually enabled per language in Settings.
Frankly I don't believe there's any meaningful usage until I see the numbers.
>enabled per language in Settings.
Do they? I tried opening a French government site[1] and received the Firefox pop-up offering to translate the page. I did not have to enable anything in settings neither is the French language model downloaded. It seems translations are enabled by default.
[1]: https://www.elysee.fr/
Do they? I tried opening a French government site[1] and received the Firefox pop-up offering to translate the page. I did not have to enable anything in settings neither is the French language model downloaded. It seems translations are enabled by default.
[1]: https://www.elysee.fr/
I stand corrected on this point, the language packs now auto-download.
It's still a niche feature only partially built by a Horizon project (it was almost entirely built by commercial entities - MS and Mozilla) in a niche browser.
It's an indictment of the Horizon programme that this is considered the pre-eminent success story.
It's still a niche feature only partially built by a Horizon project (it was almost entirely built by commercial entities - MS and Mozilla) in a niche browser.
It's an indictment of the Horizon programme that this is considered the pre-eminent success story.
Its actually helped me a twice the last two weeks and I would browse mostly English language sites and I imagine it would be great if English wasn't your first language.
I didn't even know it was a new Firefox feature but I thought it was cool.
Well done EU.
I didn't even know it was a new Firefox feature but I thought it was cool.
Well done EU.
You really can't win with some people.
If the EU invests into research and development of a feature that a US tech company already offers (as a proprietary, closed-source service), it's needless duplication and a futile effort in catching up.
Yet if it doesn't, that's admitting defeat in the face of competitors and the wrong move as well.
If the EU invests into research and development of a feature that a US tech company already offers (as a proprietary, closed-source service), it's needless duplication and a futile effort in catching up.
Yet if it doesn't, that's admitting defeat in the face of competitors and the wrong move as well.
> If the EU invests into research and development of a feature that a US tech company already offers (as a proprietary, closed-source service), it's needless duplication and a futile effort in catching up.
The example we're talking about is powered by a Marian, developed and open-sourced by a US multinational, Microsoft.
The Horizon project was to use that to create a Firefox plugin, which they did.
Another US multinational, Mozilla, later integrated into Firefox.
Firefox has 4.55% market share in Europe.
> Yet if it doesn't, that's admitting defeat in the face of competitors and the wrong move as well.
You are presenting a false and frankly bad faith dichotomy.
The example we're talking about is powered by a Marian, developed and open-sourced by a US multinational, Microsoft.
The Horizon project was to use that to create a Firefox plugin, which they did.
Another US multinational, Mozilla, later integrated into Firefox.
Firefox has 4.55% market share in Europe.
> Yet if it doesn't, that's admitting defeat in the face of competitors and the wrong move as well.
You are presenting a false and frankly bad faith dichotomy.
I believe to the order of millions of translations per day, but again, I don't remember where to view this, so might not be correct. But it's definitely orders of magnitude larger than 100s of users.
(And indeed, as a sibling comment points out, the feature is suggested to users in context, which of course massively helps with discoverability, so it's no surprise to me that it's used way more often than the extension.)
(And indeed, as a sibling comment points out, the feature is suggested to users in context, which of course massively helps with discoverability, so it's no surprise to me that it's used way more often than the extension.)
Can you, please, share a source for the claims you make about Marian? Specifically, "developed and open-sourced by a US multinational, Microsoft" and "funded by MS" (from two other comments by you)?
It does look like Microsoft is (was) funding the project, and employs one of the authors as head of research at Microsoft Translator, which is great, but all the "seed" funding and actual research happened in EU. Microsoft hired the author only in 2018 [1], while the earliest EU grant was allocated in 2015 [2], and the main paper they published says "it has mainly been developed at the Adam Mickiewicz University in Poznan and at the University of Edinburgh" [3].
[1] https://www.linkedin.com/in/junczys/
[2] https://github.com/marian-nmt/marian#acknowledgements
[3] https://aclanthology.org/P18-4020.pdf
It does look like Microsoft is (was) funding the project, and employs one of the authors as head of research at Microsoft Translator, which is great, but all the "seed" funding and actual research happened in EU. Microsoft hired the author only in 2018 [1], while the earliest EU grant was allocated in 2015 [2], and the main paper they published says "it has mainly been developed at the Adam Mickiewicz University in Poznan and at the University of Edinburgh" [3].
[1] https://www.linkedin.com/in/junczys/
[2] https://github.com/marian-nmt/marian#acknowledgements
[3] https://aclanthology.org/P18-4020.pdf
Where did you get 7 languages from? It's like 30 right now, with new ones being added regularly.
What's unfinished about it?
And Marian also received 6 grants via Horizon, in cooperation with the exact same universities (the one in Edinburgh being the main one), so I'm not sure what's your point?
And did I try to list every success or one tangible example, as the parent asked?
What's unfinished about it?
And Marian also received 6 grants via Horizon, in cooperation with the exact same universities (the one in Edinburgh being the main one), so I'm not sure what's your point?
And did I try to list every success or one tangible example, as the parent asked?
> Where did you get 7 languages from?
The Horizon/Bergamot project ended with seven languages. Anything thereafter was added separately.
> What's unfinished about it?
The project ended with an unfinished implementation.
> And Marian was also funded by Horizon, also in cooperation with the exact same universities, so I'm not sure what's your point?
No, Marian was funded by MS.
You are revising history extraordinarily to make the most unimpressive project appear better than it was. If Bergamot achieved all its goals and was the exemplar of Horizon, Horizon would be a complete failure.
As it was, the project limped over the line unfinished to be picked up by Mozilla.
The Horizon/Bergamot project ended with seven languages. Anything thereafter was added separately.
> What's unfinished about it?
The project ended with an unfinished implementation.
> And Marian was also funded by Horizon, also in cooperation with the exact same universities, so I'm not sure what's your point?
No, Marian was funded by MS.
You are revising history extraordinarily to make the most unimpressive project appear better than it was. If Bergamot achieved all its goals and was the exemplar of Horizon, Horizon would be a complete failure.
As it was, the project limped over the line unfinished to be picked up by Mozilla.
Huh? Most Firefox users presumably use it, and anyway it's obviously essential and extremely useful functionality.
And the really important languages for EU/US audiences are, in order, English, Chinese, Spanish, Japanese, Portuguese, German, Italian, which is, guess what, 7 languages...
And the really important languages for EU/US audiences are, in order, English, Chinese, Spanish, Japanese, Portuguese, German, Italian, which is, guess what, 7 languages...
> Huh? Most Firefox users presumably use it, and anyway it's obviously essential and extremely useful functionality.
~~Only Firefox users who explicitly enable offline translation per langauge in Settings use this feature~~, which will be a tiny minority of users in a browser with a tiny (~2.5%) market share.
I'm wrong, the language packs now auto-download.
> And the really important languages for EU/US audiences are, in order, English, Chinese, Spanish, Japanese, Portuguese, German, Italian, which is, guess what, 7 languages...
Well, those weren't the seven languages supported by the Bergamot project when it ended. Only two of your seven were supported: Bulgarian, Czech, English, Estonian, French, Polish, and Spanish.
~~Only Firefox users who explicitly enable offline translation per langauge in Settings use this feature~~, which will be a tiny minority of users in a browser with a tiny (~2.5%) market share.
I'm wrong, the language packs now auto-download.
> And the really important languages for EU/US audiences are, in order, English, Chinese, Spanish, Japanese, Portuguese, German, Italian, which is, guess what, 7 languages...
Well, those weren't the seven languages supported by the Bergamot project when it ended. Only two of your seven were supported: Bulgarian, Czech, English, Estonian, French, Polish, and Spanish.
They paid three million euros to integrate existing open source software into Firefox?!
No, EU funded Bergamot and HPLT projects. Integration came much later, but again as a part of Bergamot project.
[0]: https://browser.mt/
[1]: https://hplt-project.org/
[2]: https://github.com/mozilla/translations?tab=readme-ov-file#a...
[0]: https://browser.mt/
[1]: https://hplt-project.org/
[2]: https://github.com/mozilla/translations?tab=readme-ov-file#a...
Very grateful for those translations. Use them a lot!
Depends on how much money has been spent.
Also money will be better spent with one common language instead of wasting so much time, resources and inconveniencing people with so many languages in this area.
Also money will be better spent with one common language instead of wasting so much time, resources and inconveniencing people with so many languages in this area.
[deleted]
Ah, so you’ve been an academic before, then.
The problem is academic culture is corrupt, and it’s very hard to reverse the decay.
Simple example: one Russell Group UK university (like many others) was admitting students who couldn’t speak English. A lecturer on a technical subject found they were struggling to understand his course, in part due to the language barrier. Come the exam, most of the students failed. He was told to make the exam easier so they would pass. The lecturer involved is a well meaning kindly man who would consider himself very ethical. But he did what he was told and the students passed.
In such a system it’s hard to see how an individual can fix it. If he had protested, he’d have been gently moved aside and the exam would have been rewritten by someone else.
Research is similarly corrupt. Grants are written to match a call, and they promise the earth. Friends review them and score highly. Pals on the grant committee favour their friends. And it’s implicitly agreed that the outcomes don’t have to be achieved. You go back to doing your original research, or not doing much at all, or more likely figuring out how to get some papers published and writing more grant proposals.
The idealistic, actually interested in progressing the field, leave or are squeezed out, looked over for lectureships in favour of folks who bring in grants via bs and politics.
Choose a topic you know about. Go on the EPSRC website. Look at grants ten years ago and see what their promised outcomes were.
My only answer is that a project like this must be done by people hired from outside of academia, which at this point is probably corrupt beyond repair. I look back at previous generations and wonder how the hell so much advancement was achieved.
The problem is academic culture is corrupt, and it’s very hard to reverse the decay.
Simple example: one Russell Group UK university (like many others) was admitting students who couldn’t speak English. A lecturer on a technical subject found they were struggling to understand his course, in part due to the language barrier. Come the exam, most of the students failed. He was told to make the exam easier so they would pass. The lecturer involved is a well meaning kindly man who would consider himself very ethical. But he did what he was told and the students passed.
In such a system it’s hard to see how an individual can fix it. If he had protested, he’d have been gently moved aside and the exam would have been rewritten by someone else.
Research is similarly corrupt. Grants are written to match a call, and they promise the earth. Friends review them and score highly. Pals on the grant committee favour their friends. And it’s implicitly agreed that the outcomes don’t have to be achieved. You go back to doing your original research, or not doing much at all, or more likely figuring out how to get some papers published and writing more grant proposals.
The idealistic, actually interested in progressing the field, leave or are squeezed out, looked over for lectureships in favour of folks who bring in grants via bs and politics.
Choose a topic you know about. Go on the EPSRC website. Look at grants ten years ago and see what their promised outcomes were.
My only answer is that a project like this must be done by people hired from outside of academia, which at this point is probably corrupt beyond repair. I look back at previous generations and wonder how the hell so much advancement was achieved.
” The models will be developed within Europe's robust regulatory framework, ensuring alignment with European values while maintaining technological excellence.”
They may release something, but i doubt it will be more useful than what already exists.
They may release something, but i doubt it will be more useful than what already exists.
> They may release something, but i doubt it will be more useful than what already exists.
I wouldn't put such prejudice in this thing. I'm not implying that you're wrong, but I'm highly skeptical that the model will be incompetent or inferior.
Also, don't forget. They'll open source it end to end. From data to training/testing code and everything in between.
I wouldn't put such prejudice in this thing. I'm not implying that you're wrong, but I'm highly skeptical that the model will be incompetent or inferior.
Also, don't forget. They'll open source it end to end. From data to training/testing code and everything in between.
The model itself might be useful in the end. But it's terrible industrial policy to kill your startups with regulation and then the state needs to step in, because private companies no longer want to work with you, or no new companies are created.
[deleted]
As someone who worked in several Eurescom research projects back in the early 90s and watched it all get steamrolled by actual pragmatic work done in telcos and US manufacturers, I have zero faith in this even as a political/independence gesture.
There are loads of people who think "there is no moat and Europe can do this" (including the Portuguese government, which announced a Portuguese LLM at WebSummit--which, hilariously, is being trained on a research "supercomputer" in Spain), and they have no idea how far (politically, economically and pragmatically) Europe's tech scene is from the US. Other than Mistral, of course.
There are loads of people who think "there is no moat and Europe can do this" (including the Portuguese government, which announced a Portuguese LLM at WebSummit--which, hilariously, is being trained on a research "supercomputer" in Spain), and they have no idea how far (politically, economically and pragmatically) Europe's tech scene is from the US. Other than Mistral, of course.
> Death by committee.
This is how the EU works. It's the reason the EU has very little innovation compared to the USA.
This is how the EU works. It's the reason the EU has very little innovation compared to the USA.
> The academics will love it, because they get money.
Nice way to frame this.
Nice way to frame this.
I'm involved with IMI-BIGPICTURE, a similarly sized EU initiative (~70M funding). It's not that bad. Things will take a while to start moving but as long as all the players stay on the same page shit will get done. 10x slower than with a small team but some things can't be done in small teams
> The project aims to create a repository of digital copies of around 3 million slides covering a range of disease areas. This repository will then be used to develop artificial intelligence tools that could aid in the analysis of slides.
€70 MM to get the digital copies of 3 million slides. Speaks for itself.
€70 MM to get the digital copies of 3 million slides. Speaks for itself.
Can't talk specifics but I worked with a perpetually failing startup that spun out of a very prestigious university. The company was lined with way too many professors. Their burn rate must have been incredible, based on the huge investments they got. Their product was already "meh" before the AI boom made it utterly obsolete. They made huge promises but delivered poor results (in an area where 90% accuracy was basically useless). They never seemed to iterate on the product. Suddenly (like almost overnight) we got word that they were out of money and were likely to cease operating. At the 11th hour some idiot bailed them out, likely because of their academic credentials. (Certainly not because of their IP, product or output capability). Or maybe it was sunken cost fallacy. Idk.
Anyway, they're still failing along, burning through a seemingly infinite runway. Academia FTW!
Anyway, they're still failing along, burning through a seemingly infinite runway. Academia FTW!
You just described all EU tech subsidies.
As someone who is in general skeptical of programs like this (and an European) there are 2 remarkable / timely things about this:
- This project doesn't just allocate money to universities or one large company, but includes top research institutions as well as startups and GPU time on supercomputing clusters. The participants are very well connected (e.g. also supported by HF, Together and the likes with European roots) - Deepseek has just shown that you probably can't beat the big labs with these resources, but you can stay sufficient close to the frontier to make a dent.
Europe needs to try this. Will this close the Gap to the US/China? Probably not. But it could be a catalyst for competitive Open source models and partially revitalize AI in Europe. let's see..
PS: on Twitter there was a screenshot yesterday that in a new EU draft, "accelerate" was used six times. Maybe times are changing a little bit.
Disclaimer: Our company is part of this project, so I might be biased.
- This project doesn't just allocate money to universities or one large company, but includes top research institutions as well as startups and GPU time on supercomputing clusters. The participants are very well connected (e.g. also supported by HF, Together and the likes with European roots) - Deepseek has just shown that you probably can't beat the big labs with these resources, but you can stay sufficient close to the frontier to make a dent.
Europe needs to try this. Will this close the Gap to the US/China? Probably not. But it could be a catalyst for competitive Open source models and partially revitalize AI in Europe. let's see..
PS: on Twitter there was a screenshot yesterday that in a new EU draft, "accelerate" was used six times. Maybe times are changing a little bit.
Disclaimer: Our company is part of this project, so I might be biased.
I wish you the best of luck. However, this is basically a still just a European joint research project (admittedly compatibly well funded) with similar partners that have been also connected before in other research projects. To really compete in the space it will require new ideas, great talent and good leadership towards a common goal. I have myself been part of many EU funded projects and know the difficulty of realizing this within such a project. Public funding sadly has adversarial effects sometimes.
As for computing cost: as EuroHPC gives resources to research for free there can be more budget for computing. The EuroHPC joint undertaking has just decided to invest hundreds of millions of Euro in new AI clusters and supporting services. So this can come on top. Actually projects like this are much needed to also make good use of the money.
Disclaimer: my lab is involved in one of the new AI Factories.
As for computing cost: as EuroHPC gives resources to research for free there can be more budget for computing. The EuroHPC joint undertaking has just decided to invest hundreds of millions of Euro in new AI clusters and supporting services. So this can come on top. Actually projects like this are much needed to also make good use of the money.
Disclaimer: my lab is involved in one of the new AI Factories.
So, if one has a well thought-through idea, what is the process of getting the resources ($$$) from OpenEuroLLM and the compute from EuroHPC? How do I become a partner as a long-standing engineer with plenty of industry practice in research and development?
I am asking this because I never really understood how EU funds are working, they always seemed to me as there's a lot of gate keeping.
I am asking this because I never really understood how EU funds are working, they always seemed to me as there's a lot of gate keeping.
There definitely is - but that we, as a startup that is barely a year old and not widely known outside our niche in AI dev circles and on Huggingface, are part of this is already a sign that times are changing.
To be fair: We probably couldn't have handled the paperwork without LLM´s - but due to this technology, the process was still long and involved but manageable.
(BTW: We´re hiring, if you really want to work on this ;-). As a freelancer/solo entrepreneur this will be difficult though..)
To be fair: We probably couldn't have handled the paperwork without LLM´s - but due to this technology, the process was still long and involved but manageable.
(BTW: We´re hiring, if you really want to work on this ;-). As a freelancer/solo entrepreneur this will be difficult though..)
If I had a startup where would I apply to get into this program? Where did your company apply to?
Applying for EC Projects is a complicated game. For SMEs there is typically Open Calls like this: https://www.ffplus-project.eu/
Regarding compute simply file an application here: https://eurohpc-ju.europa.eu/access-our-supercomputers/euroh...
The data analytics and AI call is currently not open but the AI factories will start in April, so there will be compute.
If you have questions don't hesitate to contact me as I will have to do commuty management for HammerHAI
Regarding compute simply file an application here: https://eurohpc-ju.europa.eu/access-our-supercomputers/euroh...
The data analytics and AI call is currently not open but the AI factories will start in April, so there will be compute.
If you have questions don't hesitate to contact me as I will have to do commuty management for HammerHAI
The problem is that:
- These are not really super computing cluster in LLM terms. Leonardo is a 250 PFlops cluster. That is really not much at all.
- If people in charge of this project actually believe R1 costs $5.5M to build from scratch, it's already over.
I think no one believes that R1 costs $5.5m from scratch.
People in this project (most, not all) are very aware of the realities in training and are very well connected in the US as well. Besides Leonardo there are JUWELS, LUMI & other which can be used for ablations and so on.
This will never compete with what the frontier labs have (+ are building) but might be just enough for something, that is close enough to be a useful alternative :).
PS: Huge fan of Latent Space :)
This will never compete with what the frontier labs have (+ are building) but might be just enough for something, that is close enough to be a useful alternative :).
PS: Huge fan of Latent Space :)
what are you all talking about? most people in the industry do believe the publicly stated numbers for dsv3
> If people in charge of this project actually believe R1 costs $5.5M to build from scratch, it's already over.
wdym?
wdym?
The money doesn’t matter.
The goals don’t matter.
The people don’t matter.
The only thing that matters is how much regulatory red tape is involved.
My guess is that the paperwork will kill this. Read the announcement. Too much discussion about regulatory framework. In the US or China, all you need is some money and smart people. That’s a very low barrier to getting moving forward.
The goals don’t matter.
The people don’t matter.
The only thing that matters is how much regulatory red tape is involved.
My guess is that the paperwork will kill this. Read the announcement. Too much discussion about regulatory framework. In the US or China, all you need is some money and smart people. That’s a very low barrier to getting moving forward.
In other words, to be successful you need to be able to break the law and lobby the government? That is indeed the USA mindset, or should I say United Corporations of America? I'm happy EU is not USA.
That’s absolutely asinine and not at all what I said.
The EU over regulates things like tech and that why they won’t be successful at have an AI tech scene. Over time, anyone good will migrate to the US or China where they can work faster and not have as many rules to deal with.
A simple example is hiring and firing people - it’s much easier to make personnel changes in the US than Europe. As a result, US companies can take more risks.
The EU over regulates things like tech and that why they won’t be successful at have an AI tech scene. Over time, anyone good will migrate to the US or China where they can work faster and not have as many rules to deal with.
A simple example is hiring and firing people - it’s much easier to make personnel changes in the US than Europe. As a result, US companies can take more risks.
Yes, US has at-will firing, and healthcare tied to the employer, and so forth. Basically the US has made sure that the corporations have all the power, and the people have none of it. Does this make it easier to make companies? Well of course it does, just like slave trade made it easier to collect crops.
Unlike the US however, we in EU really like having basic human rights - such as mandatory minimum vacation time, healthcare that won't immediately disappear if you lose your job, or depend on the job, as well as not getting fired without cause, and without multiple warnings beforehand.
If the result of this means that we won't be successful in the AI tech scene, or that all the Musk-like slave owners migrate to US or China where they can abuse people however much they like, I'm pretty sure Europeans are not going to shed a tear over that.
I realize more and more that the main difference between Americans and Europeans is that Americans think from the perspective of a corporation, whereas Europeans think from the perspective of themselves, as human beings. We're not compatible, clearly, so there's no need to force us to be the same.
Unlike the US however, we in EU really like having basic human rights - such as mandatory minimum vacation time, healthcare that won't immediately disappear if you lose your job, or depend on the job, as well as not getting fired without cause, and without multiple warnings beforehand.
If the result of this means that we won't be successful in the AI tech scene, or that all the Musk-like slave owners migrate to US or China where they can abuse people however much they like, I'm pretty sure Europeans are not going to shed a tear over that.
I realize more and more that the main difference between Americans and Europeans is that Americans think from the perspective of a corporation, whereas Europeans think from the perspective of themselves, as human beings. We're not compatible, clearly, so there's no need to force us to be the same.
I disagree with "basic human rights". They aren't. And the reason they aren't is because one person's mandatory minimum vacation time is another person's liability.
Yeah, it's great for the employee - I totally agree. But if you run a startup, that's a huge cost.
So yes, we disagree on approaches, and that's fine. Not everyone needs to be like us, and if you reread my original comment, I never said they did. [0]
[0] - "My guess is that the paperwork will kill this."
------ side note:
I'm American. I spent 2 weeks in Europe last summer for vacation. I loved it. Food was great, Formula 1 was great. Overall a fantastic time.
But if I'm going to run a startup, I would never do it in Europe. An organic foods company - sure - that would be a great place to do it.
Yeah, it's great for the employee - I totally agree. But if you run a startup, that's a huge cost.
So yes, we disagree on approaches, and that's fine. Not everyone needs to be like us, and if you reread my original comment, I never said they did. [0]
[0] - "My guess is that the paperwork will kill this."
------ side note:
I'm American. I spent 2 weeks in Europe last summer for vacation. I loved it. Food was great, Formula 1 was great. Overall a fantastic time.
But if I'm going to run a startup, I would never do it in Europe. An organic foods company - sure - that would be a great place to do it.
From experience, regulation as an explanation for EU startup competitiveness is overused so much it's almost meaningless. Can you point out specific laws that you consider existential for startups?
What I find matters way, way more is two factors:
- Concentration of capital. The US has an ecosystem of wealthy people that want to put their money somewhere. This is good for startups, but can also backfire as we can see in the news.
- Unified market. EU is not a single market, it's several dozen markets with different regulations, different languages, and different cultures. You can't sell the same B2C product with the same marketing in Germany, Spain, and Sweden as easily as you can in California, Ohio, and Texas.
What I find matters way, way more is two factors:
- Concentration of capital. The US has an ecosystem of wealthy people that want to put their money somewhere. This is good for startups, but can also backfire as we can see in the news.
- Unified market. EU is not a single market, it's several dozen markets with different regulations, different languages, and different cultures. You can't sell the same B2C product with the same marketing in Germany, Spain, and Sweden as easily as you can in California, Ohio, and Texas.
Adding another point from Paul Graham [0] & [1]
[0] - https://x.com/paulg/status/1887186094120137042?s=46&t=mXA1Wm...
[1] - https://x.com/paulg/status/1887249759557009903?s=46&t=mXA1Wm...
[0] - https://x.com/paulg/status/1887186094120137042?s=46&t=mXA1Wm...
[1] - https://x.com/paulg/status/1887249759557009903?s=46&t=mXA1Wm...
First, your last point answers your first question: a non-unified market is an implicit result of too many regulations. Harmonizing them would create a more unified market. The US is efficient because it is more homogenous. That efficiency is one of the things that leads to capital formation.
So, I think you have causation backwards. Capital formation doesn't really happen because it's too difficult to build and grow things in Europe.
Look at tech in Silicon Valley - all that capital formation is years worth of growth and reinvestment.
Look at oil & gas Texas - again, all that capital comes from years of growth and reinvestment.
And what you learn in silicon valley you can generally apply to starting a company in Austin Texas. What would happen if Mercedes wanted to move it's company (HQ and all) to Spain? How much would it have to relearn from a regulatory perspective?
So, I think you have causation backwards. Capital formation doesn't really happen because it's too difficult to build and grow things in Europe.
Look at tech in Silicon Valley - all that capital formation is years worth of growth and reinvestment.
Look at oil & gas Texas - again, all that capital comes from years of growth and reinvestment.
And what you learn in silicon valley you can generally apply to starting a company in Austin Texas. What would happen if Mercedes wanted to move it's company (HQ and all) to Spain? How much would it have to relearn from a regulatory perspective?
I agree that the announcement should´ve talked more about goals and performance than regulatory stuff ;-).
But I think there is a new understanding among the bureaucracy that regulation (alone, without innovation) will kill Europe´s competitiveness and that some acceleration and cutting of red tape is necessary.
Can't say with certainty that this will be successful. But that we, as a very young startup that is barely known outside of our AI Open Source niche, are part of this, is already a sign in itself - a year ago I´d have never believed that this might be an option (and also probably would've declined if someone asked us to join a EU-funded project).
We will have engineers without a degree (but hundreds of thousands of HF downloads) working side-by-side with some of the top researchers + HPC centers.
But I think there is a new understanding among the bureaucracy that regulation (alone, without innovation) will kill Europe´s competitiveness and that some acceleration and cutting of red tape is necessary.
Can't say with certainty that this will be successful. But that we, as a very young startup that is barely known outside of our AI Open Source niche, are part of this, is already a sign in itself - a year ago I´d have never believed that this might be an option (and also probably would've declined if someone asked us to join a EU-funded project).
We will have engineers without a degree (but hundreds of thousands of HF downloads) working side-by-side with some of the top researchers + HPC centers.
I wish the effort well. Any change is welcome.
> China, all you need is some money and smart people
No way
No way
What I don't understand is the big plan. Say, you manage bring about something that works in the lab on par with DeepSeek R1. What happens with it next? In the market LLMs are being improved continuously based on feedback - in terms of usage data etc. and new versions are being released multiple times a year. If we want to stay sovereign, we need a similar engine started in Europe, but I can't see how a research project relying on a walled garden system of supercomputer centres can start it.
What route(s) did you go through for funding? As an outsider the bureaucracy fascinates me, I trust it's all open and transparent like the EU?
> Deepseek has just shown that you probably can't beat the big labs with these resources
is that a new take? cause so far deepseek was considered as proof for small companies being able to compete with big players like openai ...
is that a new take? cause so far deepseek was considered as proof for small companies being able to compete with big players like openai ...
might be debatable - but I tend to agree with Dario Amodei on this; my guess is that R1 is 7-10 months behind the internal frontier at the big labs, while having a few small novel tricks.
(But i might err, will be interesting to see the development going forward)
the main narrative so far was that deepseek was cheaper and better than llms by openai.
They allocated €37.4 million [1]. As an European, I truly don’t understand why they keep ignoring that the money required for such projects is at least an order of magnitude more.
[1] https://digital-strategy.ec.europa.eu/en/news/pioneering-ai-...
[1] https://digital-strategy.ec.europa.eu/en/news/pioneering-ai-...
Deepseek's release has shown that there's no great risk in getting left behind. All the info is out there, people with skills are readily available, creating a model that will match whatever current model is considered frontier level is not that hard for an entity like the EU.
For everyone here shouting that the EU needs to do something, be a leader, what have they lost so far by choosing to lead in legislation instead of development?
They've lost nothing. They've gained a lot.
They can use the same frontier level open source model as everyone else, and meanwhile, they can stay on top of harmful uses like social or credit scoring.
Also speaking as a European, legislation is kind of the point of a government in the first place. I do think the EU goes too far in many cases. But I haven't seen anything that makes me think they're dealing with this particular hype train badly so far. Play the safe long game, let everyone else spend all the money, see what works, focus on legislation of potentially dangerous technology.
For everyone here shouting that the EU needs to do something, be a leader, what have they lost so far by choosing to lead in legislation instead of development?
They've lost nothing. They've gained a lot.
They can use the same frontier level open source model as everyone else, and meanwhile, they can stay on top of harmful uses like social or credit scoring.
Also speaking as a European, legislation is kind of the point of a government in the first place. I do think the EU goes too far in many cases. But I haven't seen anything that makes me think they're dealing with this particular hype train badly so far. Play the safe long game, let everyone else spend all the money, see what works, focus on legislation of potentially dangerous technology.
> legislation is kind of the point of a government in the first place
I would personally consider legislation to be but one means to an end, with the point of a (democratic) government actually being to ensure stability and prosperity for its citizens.
In that framework, "leading with legislation" doesn't make any sense—you can lead with results, but the legislation is not itself a result! Lead with development or lead with standard of living or lead with civil rights, but don't lead with legislation.
Your formulation sounds like politician's logic: "something must be done, this is something, therefore we must do it". Legislation as an end in itself. Very interesting.
https://www.youtube.com/watch?v=vidzkYnaf6Y
I would personally consider legislation to be but one means to an end, with the point of a (democratic) government actually being to ensure stability and prosperity for its citizens.
In that framework, "leading with legislation" doesn't make any sense—you can lead with results, but the legislation is not itself a result! Lead with development or lead with standard of living or lead with civil rights, but don't lead with legislation.
Your formulation sounds like politician's logic: "something must be done, this is something, therefore we must do it". Legislation as an end in itself. Very interesting.
https://www.youtube.com/watch?v=vidzkYnaf6Y
> I would personally consider legislation to be but one means to an end, with the point of a (democratic) government actually being to ensure stability and prosperity for its citizens
You're correct, in retrospect I was a bit hyperbolic in my statement.
A better statement of my view is: the goal of a government should be the prosperity and wellbeing of it's citizens and the greater system we're all a part of (both geopolitical and ecological), and the best way we've so far discovered to do that is via legislation of an otherwise free market.
You're correct, in retrospect I was a bit hyperbolic in my statement.
A better statement of my view is: the goal of a government should be the prosperity and wellbeing of it's citizens and the greater system we're all a part of (both geopolitical and ecological), and the best way we've so far discovered to do that is via legislation of an otherwise free market.
> They can use the same frontier level open source model as everyone else, and meanwhile, they can stay on top of harmful uses like social or credit scoring.
We are dependent on models created by USA and Chinese companies for access to the technology that seems to be the next internet - while the entire world is accelerating hard towards protectionism and tariff wars.
What could possibly go wrong
We are dependent on models created by USA and Chinese companies for access to the technology that seems to be the next internet - while the entire world is accelerating hard towards protectionism and tariff wars.
What could possibly go wrong
Yeah, this is exactly what scares me. But it also scares me that there's almost zero oversight on what USA and China are producing and the bias that could be embedded into these models by their creators...
I'm just not sure whether it's worse to be behind or to try to be in front by all means necessary.
I'm just not sure whether it's worse to be behind or to try to be in front by all means necessary.
I partially agree with you. The only problem is that these markets are highly monopolistic, and we will be creating another technological dependency on the US.
Deepseek didn't show anything except the compute cost of final model. We don't know how much data collection costed, how much unethical data like copyrighted data or OpenAI's data is needed, the cost of experiments etc.
> Creating a model that will match whatever current model is considered frontier level is not that hard for an entity like the EU.
If they have this as their top priority and allotted few billion dollars then sure. Not in the current form where the people involved are only involved for publication, not doing hard engineering things that takes months or years and they could do the same thing in OpenAI or Deepseek for like $1 million salary which both of them pay.
> Creating a model that will match whatever current model is considered frontier level is not that hard for an entity like the EU.
If they have this as their top priority and allotted few billion dollars then sure. Not in the current form where the people involved are only involved for publication, not doing hard engineering things that takes months or years and they could do the same thing in OpenAI or Deepseek for like $1 million salary which both of them pay.
> lead in legislation
> legislation is kind of the point of a government
As an American, most of this post reads like doublespeak satire. I guess it's not, but just to put a transatlantic pov here.
I'll add a sports metaphor for good measure: in order to become expert football players, we'll get tickets to watch the best teams play.
> legislation is kind of the point of a government
As an American, most of this post reads like doublespeak satire. I guess it's not, but just to put a transatlantic pov here.
I'll add a sports metaphor for good measure: in order to become expert football players, we'll get tickets to watch the best teams play.
I’ll add some European wisdom to your sports metaphor. You don’t have to become a big football player to make money in football. I’d rather make money from the tickets and rights than dedicate my life to a sport that’s only played in the US.
> As an American, most of this post reads like doublespeak satire
Yeah, you guys have a lot of brainwashing to get over. I can imagine that you're deeply conditioned to read any outside views on politics as satire.
One kind of brainwashing is the need to reframe everything political into sports metaphors. The EU is not a sports team. It's a political entity. Whatever you might have been taught, these are very different things, with different needs. You can't have meaningful conversations about a political entity via sports metaphors.
Well, maybe in US politics you can. There you have two teams determined to beat the other at all costs. EU politics isn't like that. We are trying to work together, not kill each other.
Yeah, you guys have a lot of brainwashing to get over. I can imagine that you're deeply conditioned to read any outside views on politics as satire.
One kind of brainwashing is the need to reframe everything political into sports metaphors. The EU is not a sports team. It's a political entity. Whatever you might have been taught, these are very different things, with different needs. You can't have meaningful conversations about a political entity via sports metaphors.
Well, maybe in US politics you can. There you have two teams determined to beat the other at all costs. EU politics isn't like that. We are trying to work together, not kill each other.
> There you have two teams determined to beat the other at all costs
On the surface. It's all kayfabe though; heels and babyfaces. Just like with wrestling, the media know the score, and all the angles. After the match, they all laugh and joke together on the depraved billionaire owner's megayacht.
On the surface. It's all kayfabe though; heels and babyfaces. Just like with wrestling, the media know the score, and all the angles. After the match, they all laugh and joke together on the depraved billionaire owner's megayacht.
I don't think this is accurate, looking at it from outside. I mean, yeah, they both want to end up sitting on the billionaires yacht.
But one side wants to do that while looking out over a fascist dictatorship.
The other side has some weird idea that the billionaires will use their wealth to create a good life for everyone else too. Even though the term went out of fashion, it's still trickle down economics.
These two sides are not the same. They're both bad, but one is much worse. The last time fascism took hold it took nuclear bombs in Japan and firebombing Dresden to end it.
But one side wants to do that while looking out over a fascist dictatorship.
The other side has some weird idea that the billionaires will use their wealth to create a good life for everyone else too. Even though the term went out of fashion, it's still trickle down economics.
These two sides are not the same. They're both bad, but one is much worse. The last time fascism took hold it took nuclear bombs in Japan and firebombing Dresden to end it.
If you think Democrats were "determined" to beat Trump "at all costs" this last election, please, explain why they couldn't promise to stop arming Israel's genocide.
Democrat elites knew full well, as did the world, that 77% of Democrat voters wanted an arms embargo. Everyone who cared to look knew that in close battleground states over 3 in 10 Biden 2020 voters were saying that their vote could be affected by this, such was their feeling on this issue - understandable, given the daily atrocities livestreamed around the world.
Kamala's campaign had an easy win, a landslide victory for the taking. All they had to do was promise an arms embargo. Instead, she promised to keep sending bombs "no matter what"; even before her campaign page had a single policy on it. Does that look like they were fighting to beat the Republicans "at all costs"?
... How did Democrats hold Trump accountable for his insurrection attempt? Did that look like 'determination to win' to you? [0]
Did Blinken, Miller, Patel, Karine etc look or sound any less cartoonishly evil than the Trump goons? The things they said up there were mind-bogglingly cruel; staggeringly disrespectful of our intelligence.
The Biden admin censored millions of posts, pushed knowingly fake stories, physically removed journalists from the press room for asking legitimate questions, etc. Not super Democratic.
Sure; Republicans are much worse on some issues. But this corporate plutocracy didn't come out of nowhere. Despite the claims from the current Dem team, they do in fact take a lot of money from "bad" billionaires.
Even now, Democrats are crowing that Trump isn't deporting as many immigrants as they did. Because that's what's important right now??
Biden's admin pulled out all the stops to shut down student protesters - compare that to their response to Musk raiding the Treasury!
The two sides are not quite the same (neither are heels and heroes, ya know), but they are funded and owned by the same people. The difference is very clear when you see the unanimous support across the political and media class for things which the American people don't actually want - forever wars, environmental exploitation, tax cuts for the wealthy, full on genocide etc.
0 - https://sarahkendzior.substack.com/p/servants-of-the-mafia-s...
Democrat elites knew full well, as did the world, that 77% of Democrat voters wanted an arms embargo. Everyone who cared to look knew that in close battleground states over 3 in 10 Biden 2020 voters were saying that their vote could be affected by this, such was their feeling on this issue - understandable, given the daily atrocities livestreamed around the world.
Kamala's campaign had an easy win, a landslide victory for the taking. All they had to do was promise an arms embargo. Instead, she promised to keep sending bombs "no matter what"; even before her campaign page had a single policy on it. Does that look like they were fighting to beat the Republicans "at all costs"?
... How did Democrats hold Trump accountable for his insurrection attempt? Did that look like 'determination to win' to you? [0]
Did Blinken, Miller, Patel, Karine etc look or sound any less cartoonishly evil than the Trump goons? The things they said up there were mind-bogglingly cruel; staggeringly disrespectful of our intelligence.
The Biden admin censored millions of posts, pushed knowingly fake stories, physically removed journalists from the press room for asking legitimate questions, etc. Not super Democratic.
Sure; Republicans are much worse on some issues. But this corporate plutocracy didn't come out of nowhere. Despite the claims from the current Dem team, they do in fact take a lot of money from "bad" billionaires.
Even now, Democrats are crowing that Trump isn't deporting as many immigrants as they did. Because that's what's important right now??
Biden's admin pulled out all the stops to shut down student protesters - compare that to their response to Musk raiding the Treasury!
The two sides are not quite the same (neither are heels and heroes, ya know), but they are funded and owned by the same people. The difference is very clear when you see the unanimous support across the political and media class for things which the American people don't actually want - forever wars, environmental exploitation, tax cuts for the wealthy, full on genocide etc.
0 - https://sarahkendzior.substack.com/p/servants-of-the-mafia-s...
>fascist dictatorship
You probably shouldn’t be calling other people brainwashed.
You probably shouldn’t be calling other people brainwashed.
What do you call it when one of the billionaires who proudly and publicly sponsored the winning candidate for president (who, fun fact, has nominated enough supreme court judges that they ruled he has total immunity on official acts, and got away with an insurrection, rape, financial fraud, so obviously not a qualified candidate) does a Nazi salute on live TV in front of the whole country?
If this were a book or a movie, everyone would be dismissing it as far too obvious and not how real world works.
If this were a book or a movie, everyone would be dismissing it as far too obvious and not how real world works.
You’re right, it has become a fascist oligarchy in just two weeks. Faster than it took for you to realize it. But there’s still time to make Trump king.
I hope you're right. I like America, I want you guys to overcome this.
Just remember that what most people think of when you say "fascism" is "literally Nazis".
I don't think many people believe that's where the US is heading. There are far more possible flavors of fascism.
The direction of the US is more like what Russia has, an oligarchy, with elements of fascism like concentration camps.
Just remember that what most people think of when you say "fascism" is "literally Nazis".
I don't think many people believe that's where the US is heading. There are far more possible flavors of fascism.
The direction of the US is more like what Russia has, an oligarchy, with elements of fascism like concentration camps.
Yep, fascism will mold itself to the current culture and climate, and in the US right now that seems it will be meme ironic but real fascism.
Damn, metamodern fascism :facepalm_emoji:
> EU politics isn't like that. We are trying to work together, not kill each other.
Oh? Been quite a while longer since there was war inside the US than war inside Europe. While it's been no time at all since vicious party battles in major European countries. Or countries nope'ing out entirely. But apparently fascists are only a thing in the US now?
> creating a model that will match whatever current model is considered frontier level is not that hard for an entity like the EU
What industry has the EU caught up in or maintained pace in like that by "leading in legislation"?
I'd probably much rather retire in the EU than in the US but... there are certainly cons, not just pros, to the lack of urgency and bureaucratic "lets throw words at the problem" approach to economic development.
Oh? Been quite a while longer since there was war inside the US than war inside Europe. While it's been no time at all since vicious party battles in major European countries. Or countries nope'ing out entirely. But apparently fascists are only a thing in the US now?
> creating a model that will match whatever current model is considered frontier level is not that hard for an entity like the EU
What industry has the EU caught up in or maintained pace in like that by "leading in legislation"?
I'd probably much rather retire in the EU than in the US but... there are certainly cons, not just pros, to the lack of urgency and bureaucratic "lets throw words at the problem" approach to economic development.
> Been quite a while longer since there was war inside the US than war inside inEurope
Maybe you need to look up why the EU exists in the first place. Way back when it was called the European Coal and Steel Community (ECSC). There haven't been any wars between member countries since it's foundation, so I think it's working pretty well, actually.
Maybe you need to look up why the EU exists in the first place. Way back when it was called the European Coal and Steel Community (ECSC). There haven't been any wars between member countries since it's foundation, so I think it's working pretty well, actually.
I don't have much skin in this pissing contest, but I've lived in Europe, North America and East Asia.
> What industry has the EU caught up in or maintained pace
What industries is the US leading which reflects itself in improvement of quality of life of its citizens? Cause some things really don't matter in grand scheme of things.
> What industry has the EU caught up in or maintained pace
What industries is the US leading which reflects itself in improvement of quality of life of its citizens? Cause some things really don't matter in grand scheme of things.
If they could make money from empathy, the US would try to become the world leader real quick.
EU has better quality of life on borrowed time.
Yeah, some things don't matter in grand scheme of things. When your grand is larger, eu is in a bad place.
I’ve been hearing that about EU, China and Japan for the past 20 years in different degrees. Two generations were born and a lot of people have passed away in that period.
Even if EU’s QoL is on borrowed time, at least it has it for some time.
Even if EU’s QoL is on borrowed time, at least it has it for some time.
20 years is awfully small time.
It's getting bad now. It'll be terrible after 20 more years if course is not corrected.
It's getting bad now. It'll be terrible after 20 more years if course is not corrected.
[deleted]
Personally I'm rather happy that the allocation was not too large at first, even that is quite a sizeable sum. The EU is great at kickstarting projects that sound like a panacea, but end up not leading to anything. Once they have something to show, by all means, throw more money at them.
As said before in another comment. The project can likely make use of 'free' EuroHPC resources, which will also be funded simultaneously with hundreds of millions. Still not Stargate, but if they can actually innovate something beyond the obvious (like R1) I think the money is still useful.
On what basis are you are stating this? I'm asking because I have been involved in another project like these (15M budget) and the main issue was the lack of computing resources allocation, because no one thought about it (true story).
The application process IMHO is quite complex (thwy want compute estimations and CVs etc).However if you figure how ist works it is at least relatively easy to get batches of 100k GPU hours via EuroHPC. Currently few calls are open, but there is typically at least also national infrastructure. Again this is nothing compared to what OpenAI or Meta has access to.
I just got 25k node hours on Meluxina for a fine-tune project. My colleague got quite some GPU compute oh Germany's Tier3 NHR Clsuter (Horeka with >700 A100/H100 GPUs).
Because Europe does not have enough money. This comes from taxes i.e. as an EU citizen you pay for the fun.
Private sector often does not fund projects like these as they have bad return on investment.
Private sector often does not fund projects like these as they have bad return on investment.
>Because Europe does not have enough money.
They seem to have enough to send overseas and to spend on illegal economic migrants.
>Private sector often does not fund projects like these as they have bad return on investment.
Then why does the private sector in the US fund projects like these?
They seem to have enough to send overseas and to spend on illegal economic migrants.
>Private sector often does not fund projects like these as they have bad return on investment.
Then why does the private sector in the US fund projects like these?
Because America has the best private capital and startup ecosystem in the world it has a good chance of picking the big winners. There is no corresponding European ecosystem, only a bunch of small national ones. In fact, European investors are not betting on EU startups because they are unlikely to be able to scale to beat US and Chinese competitors due to lack of market and capital market scale.
Europe has lower cost of living and lower wages so EU Investors don't need US levels of money to compete.
Developers are cheaper but not a lot, and regulatory costs are higher - the difference in the end in not huge. Plus: if you want to win a global market you need global talent at global wages. You need a lot of private capital and Europe does not have any.
EU has enough capital it just works on US market cause there no unified capital market in EU. If Trump hits EU with tariffs I hope this changes.
You're right, the EU does have a lot of capital, but its not made available to European business.
It IS available to businesses, but only to those with the correct political connections.
> They seem to have enough to send overseas
If you mean the NDICI stuff, that's hardly 'sending money overseas', and it's a fairly tiny fraction of spending.
> and to spend on illegal economic migrants.
... What are you talking about here? What portion of the EU budget is spent on that? What activity specifically?
In the real world, most EU spending is on regional development, agricultural stuff, and operating the EU (civil service, enforcement bodies, etc etc). The EU is not a country and has only a very small budget (about 170bn/year).
If you mean the NDICI stuff, that's hardly 'sending money overseas', and it's a fairly tiny fraction of spending.
> and to spend on illegal economic migrants.
... What are you talking about here? What portion of the EU budget is spent on that? What activity specifically?
In the real world, most EU spending is on regional development, agricultural stuff, and operating the EU (civil service, enforcement bodies, etc etc). The EU is not a country and has only a very small budget (about 170bn/year).
These millions were allocated for business-class tickets and accommodations for the talking members of this task force. So, 37.4m is plenty.
I have zero doubt that nothing else will come out of this.
Source: have been working with major UN and international bodies on the software side.
I have zero doubt that nothing else will come out of this.
Source: have been working with major UN and international bodies on the software side.
Not anymore, with Deepseek's stuff right? Which is open.
DeepSeek had plenty of R&D expertise which were not included in the (declared) model training cost. Here we are talking about building something nearly from scratch, even if there is an open source starting point you still need the infrastructure, expertise and people to make it work, which with that budget are going to be hard to secure. Moreover these projects take months and months to get approved, meaning that this one was conceived long before DeepSeek, thus highlighting the original disalignment between the goal and the budget. DeepSeek might have changed the scenario (I hope so) but it would be just a lucky ex-post event… not a conscious choice behind that budget.
What do you mean, "nearly from scratch"?
Aleph Alpha is a business that has been going for some time in this sector, at least a couple of years with commercial LLM products. It's likely they'll provide hardware and base models for this project.
Aleph Alpha is a business that has been going for some time in this sector, at least a couple of years with commercial LLM products. It's likely they'll provide hardware and base models for this project.
DeepSeek probably spent closer to two billion on hardware. And then there’s the energy cost of numerous runs, staff costs, all of that. The 5.5m cost was basically misleading info, maybe used strategically to create doubt in the US tech industry or for DeepSeek’s parent hedge fund to make money off shorts.
https://semianalysis.com/2025/01/31/deepseek-debates/
https://semianalysis.com/2025/01/31/deepseek-debates/
[deleted]
[deleted]
I mean, I get that the current strategy by most participants seems to be burning billions on models which are almost immediately obsoleted, but it's... unclear whether this is a _good_ strategy. _Especially_ after deepseek has just shown that there _are_ approaches other than just "throw infinite GPUs at it".
Like, insofar as any of this is useful, working on, say, more techniques for reducing cost feels a lot more valuable than cranking out yet another frontier model which will be superseded within months.
Like, insofar as any of this is useful, working on, say, more techniques for reducing cost feels a lot more valuable than cranking out yet another frontier model which will be superseded within months.
So for €52mn you'll get... a worse Llama? But don't worry, it'll be "transparent and compliant" which will make people want to use it. Very European.
> a worse Llama?
As someone who lives here, I'd actually be surprised if we even got that. I expect lots of taxpayer funded websites, manifestos, PowerPoints and numerous discussions and ultimately nothing.
As someone who lives here, I'd actually be surprised if we even got that. I expect lots of taxpayer funded websites, manifestos, PowerPoints and numerous discussions and ultimately nothing.
That'd be very very good actually. I'd be happy if institutions would use that where one could TECHNICALLY (maybe just a miniscule amount of people would do that) verify data from end to end, instead of some "open" model that is actually not open at all. A little worse performance is a good trade-off imo
What's with this American mentality that everything needs to always be the best, and if it isn't, it should't even exist? I know USA is alright with breaking the law, invading people's privacy and lobbying its government to the point where it's really the corporations that elect politicians into power, but why do you also need Europe to be the same way? I thought us Europeans have made it pretty clear we don't like your way of governing, so stop forcing it on us. I'd much rather use a less capable LLM if it meant that the LLM isn't driven on top of mountains of illegally collected data.
you get money to sustain a bunch of academics and startups past their good-by date
the eu gets some publicity
and the public gets nothing but another bite out of their taxes
the eu gets some publicity
and the public gets nothing but another bite out of their taxes
They just shipped a frontpage; there is no model yet.
url says "Press release" https://openeurollm.eu/launch-press-release. They delivered what they promised.
The actual top EU AI labs like Mistral, Black Forest Labs, or Stability AI are nowhere to be seen. Same goes for potent, established companies like SAP, Schwarz Group and the like. They likely made the right move here as this is doomed to fail, as correctly elaborated by the top comments.
Better late than never. I can't wait to get my hands on a mediocre AI that's 2 generations behind!
2 is generous. 5 is more likely.
Also can't wait to get bombarded with cookie popup, ai bias popup, then ai accuracy popup etc.
Also can't wait to get bombarded with cookie popup, ai bias popup, then ai accuracy popup etc.
Anything more then a powerpoint coming out of this would be a generous expectation.
> ai bias popup
It's all fun and games until AI models decide your type of people (blonde/brown/from that zip code/with that type of last name/went to that school/worked there in the past/have those facial features) are "bad" or "untrustworthy" or don't deserve healthcare or to be hired for that job or get a mortgage.
"AI" bias has existed for as long as we have had "AI" in its various forms. Remember ML algorithms classifying black people as monkeys? And the "solution" was to make them unable to find monkeys or primates. That one got big because of the implication.. when it's "people with the last name Smith being dumb", nobody will care
It's all fun and games until AI models decide your type of people (blonde/brown/from that zip code/with that type of last name/went to that school/worked there in the past/have those facial features) are "bad" or "untrustworthy" or don't deserve healthcare or to be hired for that job or get a mortgage.
"AI" bias has existed for as long as we have had "AI" in its various forms. Remember ML algorithms classifying black people as monkeys? And the "solution" was to make them unable to find monkeys or primates. That one got big because of the implication.. when it's "people with the last name Smith being dumb", nobody will care
Has nothing to do with bias popup. What next? Need to slap a "chocking hazard" label on small items? Keep out of reach of children on medicines? Oh wai...
The alternative is businesses are not held to account. I'd much rather have a cookie pop-up and GDPR notices than businesses have no guard rails against moves that are not in the interest of the user/customer.
Or hear me out...mandate cookie setting option in browser (no cookie, essential cookies, tracking cookies) instead of fuking prompt in every single site. That also allows me to not let sites ask and force essential cookies everywhere.
or block tracking altogether.
these cookie banners collectively wasted billions of hours for no gain.
or block tracking altogether.
these cookie banners collectively wasted billions of hours for no gain.
Thank Google. There is no way they'd implement blanket config. Therefore neither will Firefox.
Lack of competition for you. Very American, not very EU.
Lack of competition for you. Very American, not very EU.
The point is, instead of retarded cookie banner requirements, EU could require that instead. Then google/ff would be forced to implement
> The models will be developed within Europe's robust regulatory framework
I'm sure that all AI research needs is "robust regulation".
As a European, it annoys me to no end that Brussels bureaucrats think they know and understand everything and they can regulate everything, the only thing they are achieving is making sure that AI companies will avoid forming in the EU, because nobody wants to be at a disadvantage compared to the rest of the world, sure eventually they will provide service to the EU countries, but we will never have our own industry.
The EU needs to stop having pencil pushers make decisions on things they have no clue about and somehow get people who know what they are talking about to make the choices.
I'm sure that all AI research needs is "robust regulation".
As a European, it annoys me to no end that Brussels bureaucrats think they know and understand everything and they can regulate everything, the only thing they are achieving is making sure that AI companies will avoid forming in the EU, because nobody wants to be at a disadvantage compared to the rest of the world, sure eventually they will provide service to the EU countries, but we will never have our own industry.
The EU needs to stop having pencil pushers make decisions on things they have no clue about and somehow get people who know what they are talking about to make the choices.
I see plenty of pessimism in the comments, & talk about how unqualified the organizations people are expected to be, without addressing how important this initiative is to EU & how necessary it is they succeed.
USA has just proven they are economically unpredictable & so unstable they have become fiscally volatile with control in the hands of the lobbiests. This is why Open LLM has the starting support it does already, & for soverign nations is seen as mission critical so as to avoid long term digital services taxations being leveraged like tarrifs against anyone who does not cooperate with whomever is leading the USA.
So to me it feels as though the project is impressive, & quite likely to succeed where others have failed because so few do understand the technology enough to get in the way of progress towards openly standardizing decentralization of AI compute across soverign cloud infrastructures. Even if Aleph Alpha is not able to lead development fast enough, organizations such as OUMI (Open Universal Machine Intelligence) will be working alongside them in attempts to build out the Linuxs of AI frontier modelling.
If nothing else, Open LLM guarantees a raise in the social standards of what it takes to succeed in AI long term. At worst it provides a measure bar of success of global AI innitiatives to be compared against while introducing new organizations & people to the open source ecosystem who would never of otherwise invested in it without the EU stamp of approval.
USA has just proven they are economically unpredictable & so unstable they have become fiscally volatile with control in the hands of the lobbiests. This is why Open LLM has the starting support it does already, & for soverign nations is seen as mission critical so as to avoid long term digital services taxations being leveraged like tarrifs against anyone who does not cooperate with whomever is leading the USA.
So to me it feels as though the project is impressive, & quite likely to succeed where others have failed because so few do understand the technology enough to get in the way of progress towards openly standardizing decentralization of AI compute across soverign cloud infrastructures. Even if Aleph Alpha is not able to lead development fast enough, organizations such as OUMI (Open Universal Machine Intelligence) will be working alongside them in attempts to build out the Linuxs of AI frontier modelling.
If nothing else, Open LLM guarantees a raise in the social standards of what it takes to succeed in AI long term. At worst it provides a measure bar of success of global AI innitiatives to be compared against while introducing new organizations & people to the open source ecosystem who would never of otherwise invested in it without the EU stamp of approval.
> The models will be developed within Europe's robust regulatory framework, ensuring alignment with European values while maintaining technological excellence
As a European, that's practically an oxymoron. The more one limits oneself to legally clean data, the worse the models will be.
I hate to be pessimistic from the get go, but it doesn't sound like anything useful will be produced by this and we'll have to keep relying on Google to do proper multilinguality in open models because Mistral can't be arsed to bother beyond French and German.
As a European, that's practically an oxymoron. The more one limits oneself to legally clean data, the worse the models will be.
I hate to be pessimistic from the get go, but it doesn't sound like anything useful will be produced by this and we'll have to keep relying on Google to do proper multilinguality in open models because Mistral can't be arsed to bother beyond French and German.
I've been using Mistral past week due to changes in geopolitics, and Mistral works absolutely great in English. I haven't bothered in my native language yet, but in English it worked great. Better than my first experience with ChatGPT (GPT 3.5), actually.
Update: tried a couple of Dutch (my native language) queries, and it worked well. No issues whatsoever. Which is no surprise, given Dutch <-> English and vice versa translations often work very well.
Ok I see we're very far from being on the same page.
Multilingualism in context of language models means something more than English, because that's what every model trained on the internet already knows. There aren't any I'm aware of that don't, since it would be exceedingly hard to exclude it from the dataset even if you wanted to for some reason. This is like the "what about men's rights" when talking about women's rights... yes we know, they're already entirely ubiquitous.
But more properly I would consider LLM multilingualism straight up knowing all languages. We benchmark models on the MMLU and similar collections that contain all fields of knowledge known to man, so I would say it's reasonable to expect fluency of all languages as well.
Multilingualism in context of language models means something more than English, because that's what every model trained on the internet already knows. There aren't any I'm aware of that don't, since it would be exceedingly hard to exclude it from the dataset even if you wanted to for some reason. This is like the "what about men's rights" when talking about women's rights... yes we know, they're already entirely ubiquitous.
But more properly I would consider LLM multilingualism straight up knowing all languages. We benchmark models on the MMLU and similar collections that contain all fields of knowledge known to man, so I would say it's reasonable to expect fluency of all languages as well.
I've been using mistral for most of January at the same rate as chatgpt before. I decided to pay for it as its per token (in and out) and the bill came yesterday... A whopping 1 cent. Thats probably rounded up.
> I decided to pay for it as its per token (in and out) and the bill came yesterday... A whopping 1 cent.
Doesn't sound too good wrt their eventual profitability.
Doesn't sound too good wrt their eventual profitability.
>As a European, that's practically an oxymoron. The more one limits oneself to legally clean data, the worse the models will be.
Train an LLM with text books and other legal books, you do not need to train it on pop culture to make it intelligent.
For face generations you might need to be more creative, you should not need milions of images stolen from social media to train your model.
But makes sense that tech giants do not want to share their data set and be transparent about stuff.
Train an LLM with text books and other legal books, you do not need to train it on pop culture to make it intelligent.
For face generations you might need to be more creative, you should not need milions of images stolen from social media to train your model.
But makes sense that tech giants do not want to share their data set and be transparent about stuff.
> Train an LLM with text books and other legal books
Without licenses to the books, they are just as illegal (and maybe even moreso) than web content.
Without licenses to the books, they are just as illegal (and maybe even moreso) than web content.
>Without licenses to the books, they are just as illegal (and maybe even moreso) than web content.
There are books that are out of copyright, and also free books.
There are books that are out of copyright, and also free books.
If LLM organizations are free to throw billions at hardware they can spare a paltry €50 million for 10 million e-books though, right?
€50 million is about 130% of OpenEuroLLM's budget. And I'm very sceptical publishers will give training licenses for €5 per book. Especially as OpenEuroLLM intends to have an openly available training set.
Copyright sucks.
Copyright sucks.
Open AI fed their original model Anna’s archive for breakfast.
>Mistral can't be arsed to bother beyond French and German.
Any more details here or a writeup you can link to?
Any more details here or a writeup you can link to?
My own experience mainly, only Gemma seems to have been any good for Slavic languages so far, and only the 27B when unquantized is reliable enough to be in any way usable.
Ravenwolf posts tests on his German benchmarks every so often in locallama and most models seem to do well enough, but I've heard some claims from people about Mistral's being their favorite models in German anyhow. And I think Mistral-Large scores higher than Llama-405B in French on lmsys and that's at least something one would expect from a French company.
Ravenwolf posts tests on his German benchmarks every so often in locallama and most models seem to do well enough, but I've heard some claims from people about Mistral's being their favorite models in German anyhow. And I think Mistral-Large scores higher than Llama-405B in French on lmsys and that's at least something one would expect from a French company.
In my experience Mistral (at least Nemo) works well with other languages. Don't know about Slavic languages but it does Romanian, with apparent issues around the translation of technical terms.
What do you mean by relying on Google?
Llama 3.1 and DeepSeek v3/R1 largest models are rather good at even a niche language like Finnish. The performance does plummet in the smaller versions, and even quantization may harm multilinguality disproportionally.
Something like deliberately distilling specific languages from the largest models could work well. Starting from scratch with a "legal" dataset will most likely fail as you say.
Silo AI (co-lead of this model) already tried Finnish and Scandinavian/Nordic models with the from-scratch strategy, and the results are not too encouraging.
https://huggingface.co/LumiOpen
Llama 3.1 and DeepSeek v3/R1 largest models are rather good at even a niche language like Finnish. The performance does plummet in the smaller versions, and even quantization may harm multilinguality disproportionally.
Something like deliberately distilling specific languages from the largest models could work well. Starting from scratch with a "legal" dataset will most likely fail as you say.
Silo AI (co-lead of this model) already tried Finnish and Scandinavian/Nordic models with the from-scratch strategy, and the results are not too encouraging.
https://huggingface.co/LumiOpen
Yes I think small languages which have a total corpus of maybe a few hundred million tokens total have no chance of producing a coherent model without synthetic data. And using synthetic data from existing models trained on all public (and less public) data is enough of a legally gray area that I wouldn't expect this project to consider it, so it's doomed before it even starts.
Something like 4o is so perfect in most languages that one could just make an infinite dataset from it and be done with it. I'm not sure how OAI managed it tbh.
Something like 4o is so perfect in most languages that one could just make an infinite dataset from it and be done with it. I'm not sure how OAI managed it tbh.
This article stayed on the front page of HN for a couple of days:
https://timsh.org/tracking-myself-down-through-in-app-ads/
The author was in Europe.
Aparently, all the rules protecting the privacy of european citizens make no difference in practice.
I wonder why, but I believe the EU will look into this soon, since it would be so unconfortable if the king were bad.
The author was in Europe.
Aparently, all the rules protecting the privacy of european citizens make no difference in practice.
I wonder why, but I believe the EU will look into this soon, since it would be so unconfortable if the king were bad.
Or it just takes time to enforce the regulations. As an EU citizen, the recent regulations have already helped me a lot - a lot of companies provide data takeout now, it has become easier to remove accounts, many more websites ask specific consent, etc. Or even small things, our daughter's school has to ask specific consent if they can make photos and where they can post them (of group activities, etc.). Does everyone play according the rules? Not yet, but we will get there.
> our daughter's school has to ask specific consent if they can make photos and where they can post them
The result of this is we don't see anything out daughter does in school because school decides to comply with draconian regulation by saying "fuck it". The same applies to having parents present daily: we don't touch the grounds of the school unless we make a formal request, we don't see the teacher everyday, we don't hear how the day went from professionals who actually spent time with them. This is all 100% the opposite of our experience outside of Europe before moving and I'm comparing public school system in a third world country to an European one. It's just an anecdote but it hasn't been more clear to me how much in a death spiral the EU is than the experience we currently are having
The result of this is we don't see anything out daughter does in school because school decides to comply with draconian regulation by saying "fuck it". The same applies to having parents present daily: we don't touch the grounds of the school unless we make a formal request, we don't see the teacher everyday, we don't hear how the day went from professionals who actually spent time with them. This is all 100% the opposite of our experience outside of Europe before moving and I'm comparing public school system in a third world country to an European one. It's just an anecdote but it hasn't been more clear to me how much in a death spiral the EU is than the experience we currently are having
Maybe it's because I'm not a parent, but what you describe seems to me less "privacy gone wild" and more "Europe vs Non-Europe".
The German parents I know wouldn't consider going to the school without reason (kids go either alone or as a group), nor would they expect their teachers to give daily reports. Not because of privacy rules, but rather because you're expected to grow up independent. There are of course regular reports, but talking to the kid's teacher every day would, I believe, get you classified as "oh, that parent". And then there's also the problem of vindictive divorcing parents who take their children away before the other parent shows up.
> we don't see anything our daughter does in school
If you're talking about photos of the children then I can't imagine a cost-effective way to ensure that photos of your children end up on the Internet while photos of my (hypothetical) children hugging yours do not. But perhaps you have a more precise example in mind.
The German parents I know wouldn't consider going to the school without reason (kids go either alone or as a group), nor would they expect their teachers to give daily reports. Not because of privacy rules, but rather because you're expected to grow up independent. There are of course regular reports, but talking to the kid's teacher every day would, I believe, get you classified as "oh, that parent". And then there's also the problem of vindictive divorcing parents who take their children away before the other parent shows up.
> we don't see anything our daughter does in school
If you're talking about photos of the children then I can't imagine a cost-effective way to ensure that photos of your children end up on the Internet while photos of my (hypothetical) children hugging yours do not. But perhaps you have a more precise example in mind.
You guys expect to see the teacher every single day?
The result of this is we don't see anything out daughter does in school because school
This makes very little sense. Our daughter's school just has three checkboxes: private school website, social media, local newspapers. We checked 'private school website' and we get pictures of school activities, but they don't post them on Facebook, etc.
we don't hear how the day went from professionals who actually spent time with them
Uhm, so? I don't feel the need to micro-manage our daughter's school life? She'll tell us what she did after school if she so pleases. If there is something important, the teacher will send a message. Not everything needs to a 24/7 live social media feed. Kids go to and from school by themselves and arrange their own playdates after a certain age, that's how they learn to be independent.
When I was a kid I also went from/to school by myself starting when I was maybe 7 or 8?
This makes very little sense. Our daughter's school just has three checkboxes: private school website, social media, local newspapers. We checked 'private school website' and we get pictures of school activities, but they don't post them on Facebook, etc.
we don't hear how the day went from professionals who actually spent time with them
Uhm, so? I don't feel the need to micro-manage our daughter's school life? She'll tell us what she did after school if she so pleases. If there is something important, the teacher will send a message. Not everything needs to a 24/7 live social media feed. Kids go to and from school by themselves and arrange their own playdates after a certain age, that's how they learn to be independent.
When I was a kid I also went from/to school by myself starting when I was maybe 7 or 8?
Enforcement of the GDPR has been _grindingly_ slow; the first really significant fines weren't issued until 2022, when the Irish regulator finally pulled the finger out.
Presumably based on this experience, more recent internet-y laws (DMA, DSA, AI Act) are _not_ dependent on national regulators, and enforcement is getting off the ground more or less immediately. I'd expect that when the GDPR's successor shows up it'll follow suit.
Presumably based on this experience, more recent internet-y laws (DMA, DSA, AI Act) are _not_ dependent on national regulators, and enforcement is getting off the ground more or less immediately. I'd expect that when the GDPR's successor shows up it'll follow suit.
In the EU, we need some social contracts for those things.
Multiple EU-funded projects are launched, consortiums between Unis and Private sector companies are created, deliverables are delivered, and grants are allocated, but the cumulative results haven't been that great, have they?
That has happened for every "trend," from nuclear physics to "expert systems" in the 1990s to green tech, now AI, etc.
Here's the simple question - who gets fired when the deliverables aren't met?
This is the single greatest motivators for American companies in our exhausting capitalistic society.
This is the single greatest motivators for American companies in our exhausting capitalistic society.
> Europe's leading AI companies
Followed by a list of five EU AI companies I have never heard of before and which seem to have little to no market penetration.
Followed by a list of five EU AI companies I have never heard of before and which seem to have little to no market penetration.
Answering some questions:
- Good data is available already for the project.
- There are already previously existing models, it is not starting from scratch.
- Companies like Red Hat, Volvo, SAAB are part of the initiative thru partners like AI Sweden. So, this is a initiative to support the public sector and universities but also will have commercial output.
All that is public information.
> The project, which has been awarded the STEP (Strategic Technologies for Europe Platform) seal, leverages support from previous European projects and the experience of the partners and their results, including large repositories of high-quality data and pilot LLMs developed previously. The consortium commences its work on February 1st, 2025, with funding from the European Commission under the Digital Europe Programme. - https://sciencebusiness.net/network-updates/charles-universi...
- Good data is available already for the project.
- There are already previously existing models, it is not starting from scratch.
- Companies like Red Hat, Volvo, SAAB are part of the initiative thru partners like AI Sweden. So, this is a initiative to support the public sector and universities but also will have commercial output.
All that is public information.
> The project, which has been awarded the STEP (Strategic Technologies for Europe Platform) seal, leverages support from previous European projects and the experience of the partners and their results, including large repositories of high-quality data and pilot LLMs developed previously. The consortium commences its work on February 1st, 2025, with funding from the European Commission under the Digital Europe Programme. - https://sciencebusiness.net/network-updates/charles-universi...
United we stand, divided we fall.
More than LLMs, Europe needs chip autonomy. ASAP.
Own fabs, own IP.
More than LLMs, Europe needs chip autonomy. ASAP.
Own fabs, own IP.
We dont need "total autonomy" when we have friends that already produce chips, for example.
Rather, invest in defense and protect trade with Taiwan.
We can do what we are best at and produce lithography equipment at ASML and the Taiwanese at TSMC produce the chips with it and send them back to us.
Rather, invest in defense and protect trade with Taiwan.
We can do what we are best at and produce lithography equipment at ASML and the Taiwanese at TSMC produce the chips with it and send them back to us.
Europe as a project is over, it's all downhill from here. You can't regulate yourself into economic growth, and there is nothing else the Eurocrats care to do. There is still lots of fat in the land that they can leech off before Europe kicks the bucket.
If I got an Euro for every time someone has expressed this opinion, I'd be a rich man. Save it until the EU really doesn't exist.
I mean, people have been saying this about the EU and its predecessor organisations since about 1950. If you believe the right-wing media, the EU should collapse a few times a year from various causes; it's as bad as the Roman Empire!
There are companies like infineon and elmos in germany (and i think a handful more). So it is happening, just not (yet) with consumer products
Europe has ARM, AMD and ASML, but everything is produced elsewhere. Time to build giant automated chip fabs.
"automated" is the issue when producing chips. You can automate some to a certain level of nm. Have you seen the labor needed for maintaing a single modern ASML machine? Also we got a lot, but Japan has the tools to verify results.
translation: a few finetunes of llama plus a lot of travel grants
Academia in Europe is a black hole which turns money into pipe dreams that has no practical application. It's really sad and frustrating, because so many of the pipe dreams sound cool, but it's clear that the people working in academia has no sense for what is needed for industry. The quality of the software they write is shockingly bad, and they have no interest in improving it because they only care about using it for academia anyway. It's like a walled garden where people get fat of poor people who keep everything going, just how it has always been.
Even without the problem of insufficient financing, you probably need to bend some rules to be at the top of LLM game (not just how you collect the training data, we all sort of forgot that Altman was kicked out of OpenAI because the board thought he was prioritizing features over security).
With all the regulations and paperwork around EU projects, I can't really see them competing against private sector.
With all the regulations and paperwork around EU projects, I can't really see them competing against private sector.
The losers in the "rule bending" are humans, whose creative works are turned into weights, whose livelihoods are diminished by indiscriminate greed.
I'm all for the advancement of AI, but not at the cost of humility and compassion for those enabling the models to be built.
Model building is already a community project, you just weren't asked if you wanted to contribute. You just did. Without compensation.
"rule bending" is putting it lightly.
I'm all for the advancement of AI, but not at the cost of humility and compassion for those enabling the models to be built.
Model building is already a community project, you just weren't asked if you wanted to contribute. You just did. Without compensation.
"rule bending" is putting it lightly.
Data is getting scraped, models are being built, nobody is really going to stop that now.
You may wish it wasn't like that (not you, but all of us), but there's no way China or USA block their companies in development of key technology like this, and I think we (EU countries) should act in the same way.
You may wish it wasn't like that (not you, but all of us), but there's no way China or USA block their companies in development of key technology like this, and I think we (EU countries) should act in the same way.
Do they have something tangible now? At least PWr (from Poland) have fine tuned Mistral and a lot of language data AFAIK - https://bielik.ai/
Anyway I think some novel training method is needed and I’m with Yann on this. They could luck into good idea but with this budget chances are < 1%
Anyway I think some novel training method is needed and I’m with Yann on this. They could luck into good idea but with this budget chances are < 1%
> will ensure that the models, software, data and evaluation will be fully open
I am VERY curious about that. Will they open up ALL the training data? Which would be a massive amount I'd guess, but I'd be curious where they got it and how they got it. Inb4 they just take some meta model and retrain it and then only publish the data from the fine tuned training.
I am VERY curious about that. Will they open up ALL the training data? Which would be a massive amount I'd guess, but I'd be curious where they got it and how they got it. Inb4 they just take some meta model and retrain it and then only publish the data from the fine tuned training.
Just the extensive list of academic partners is a major difference with any existing effort on LLM's.
No name scientists will create an actual product.
Plain funny or just sad?...
They want transparency but they give small peanuts, are they thinking they can just take llama and then distill other models into it can call it transparent? I’m not sure if they understand how that works
> will build a family of performant, multilingual, large language foundation models for commercial, industrial and public services.
The commercial aspect must be implemented ASAP, or it's going to flop.
The commercial aspect must be implemented ASAP, or it's going to flop.
With this kind of money, I have a feeling we'll only come up with a good dataset. LLM will be a completely different beast with completely different requirements.
This money would be better spent in producing good training data. But quality datasets don't generate the same administrative overhead or consulting fees.
maybe 5 million for the html frontend
Will they release the training data? That would really set them apart from other models.
Im all for more models. Go for it
No Mistral?
> The models will be developed within Europe's robust regulatory framework, ensuring alignment with European values while maintaining technological excellence.
translation: weakest competitor in the contest enters the fight with both hands tied behind its back and a budget akin to what OpenAI spends in a week on compute.
But hey, more power to you Europe: the more models around, the better.
Eventually, we'll be able to bind all those censored models worldwide into one giant mixture of expert to get rid of the built-in censorship of each individual component.
translation: weakest competitor in the contest enters the fight with both hands tied behind its back and a budget akin to what OpenAI spends in a week on compute.
But hey, more power to you Europe: the more models around, the better.
Eventually, we'll be able to bind all those censored models worldwide into one giant mixture of expert to get rid of the built-in censorship of each individual component.
No model, so irrelevant because EU is extremely late to the party, as i say that as someone from EU.
Show us results, please
"Europe's leading AI companies and research institutions" -- order should be reversed, if the EU is serious about AI. It should say: "Europe's leading research institutions and AI companies..."
History repeats itself as farce.
Nonsense, got something then just share a link to eurogpt. Fed up with this academic BS.
phatnguyen(2)
Meaning, everyone will talk, noone will take charge, some millions change hands and we continue with business as usual.
Instead this should have been a single new non-profit or whatever with deep pockets that convinces smart people to give their 100% for a while.
Death by committee. And I say this as someone who was in a multi-million research program across ~8 universities, that was going to do "groundbreaking" research. After a few months everyone was back to pushing their own lines of research, there was almost zero collaboration let alone common language or goal setting.