This is honestly awesome, copy editing is such a pain point that we schedule weekly 3 hour blocks to go through all changes live. This would greatly streamline our workflow.
Signed up and saw extraction can take several days — is this done manually? I assumed scanning would be done purely automatically but I can see why there would need to be a manual review component.
The main issue with deploying these systems right now is the technical overhead to develop them out. Existing solutions are either paid and require you to share your valuable data, or open source but either abandoned (rip Crab) or inextensible (most rely on their own DB or postgres).
I’d love to see a lightweight, flexible recommendation system at a low level, specifically the scoring portion. There are a few flexible ones (Apache has one) but none are lightweight and require massive servers (or often clusters). It also can’t be bundled into frontend applications which makes it difficult for privacy-centric, own-your-data applications to compete with paid, we-own-your-data-and-will-exploit-it applications.
I’ve been saying this for years, language models are the ML equivalent of the billionaire space race, it’s just a bunch of orgs with unlimited funding spending millions of dollars on compute to get more parameters than their rivals. It could be decades before we start to see them scale down or make meaningful optimizations. This paper is a good start but I’d be willing to bet everyone will ignore it and continue breaking the bank.
Can you say that about any other task in ML? When Inceptionv3 came out I was able to run the model pretty comfortable on a 1060. Even pix2pix and most GANs fit comfortably in commercial compute, and the top of the line massive models can still run inference on a 3090. It’s so unbelievably ironic that one of the major points Transformers aimed to solve when introduced was the compute inefficiency of recurrent networks, and it’s devolved into “how many TPUs can daddy afford” instead.
Mostly mask fill, but Transformers can be fine tuned to downstream tasks relatively easily (T5 was built for translation but is used for autocomplete in many cases)
This is really cool but I can’t say I’m a fan of Zapium given it would move to a commercial license in the future. If you have to ship CEF anyhow, what is the performance advantage to licensing and using Zapium over just compiling WASM and shipping binaries with Electron? FWIW — this is how Java, .NET, etc packaging is done for interop with Electron.
I can understand from an ease of use perspective to have the bridge in between but it wouldn’t be worth subjecting a codebase to commercial licensing IMO. It’s not a whole lot more work to use process calls instead there so it seems an odd choice to commercialize that aspect in particular.
Yeah my first thought was, well you could lay out the timestamp in a way that supports lexicographical sorting, and then realized they had already done so. No reason this shouldn’t be a string!
I find this a bit disingenuous. TikTok videos have by far the highest reach of all social media due to their format and the way the for you page works. Moreover it rewards influencers from interacting with each other’s posts which often leads to top comments on TikTok (and Reels too although it’s much smaller as a platform) largely being an echo chamber.
1 post on Facebook might reach 100s, 1000s of people. Rarely a page with large enough following may hit 100,000s of people.
1 post on TikTok from a moderate influencer can hit millions.
That’s not to say other social media forms haven’t had bad trends in the past, but TikTok has had far more and in a far shorter amount of time. People just don’t interact with other social content the way they buy into TikTok, which is dangerous and leads to far more misinformation — it was maybe not even 3 weeks ago I had a bunch of my friends sending me a bunch of popular TikTok videos and asking about how AI Transformers were here and taking over the world (they are, but transformers in AI have nothing in common with the movies).
Suicide rates are tricky since mental health can have long lasting issues and the societal changes from lockdown will have even longer term effects. How do you attribute a suicide 2 years from now to depression that started during COVID? It’s going to be interesting seeing how the psychology field approaches this.
They have their own pixel that presumably helps them match users to visitors; also most sites have a Facebook like button somewhere.
The FB app ID is also one of the most common meta tags behind Open Graph.
A nice small example of what this can do can be seen with Clearbit [0] which does a good job of telling you where someone works based off of nothing but their IP address. Imagine that but with the exponentially larger data warehouses of Facebook or Google, paired with referrer tags (FB has CLIDs that allow them but not you to match clicks to actual users) and meta tags (FB can tell exactly what app, page etc a website is associated with and use that data to advertise to users).
GPT-J is 6B and comes pretty close. Also practically I haven’t noticed a difference.
Keep in mind there are also closed source alternatives: for example, AI21’s Jurassic-1 models are comparable, cheaper, and technically larger (albeit somewhat comically, 178B instead of 175B parameters).
This is cool but I wish they updated the rest of their docs so the platform was more usable. I’m sure under the hood things make sense and integrate well with each other and other Google products but there’s no way I’m going to invest in figuring that out. Don’t know why such a major tech company has such a difficult time writing decent user documentation
This seems like a weird move given that developer tools seldom do well on public markets. I can’t help but think that staying private would do more to maintain their community & preserve the reasons people opt for GitLab over GitHub.
We tried it for a couple months, it was basically a huge hassle getting our stuff to work especially anything that has bindings to CPP (any of the node gyp packages). Also felt like we were putting in a lot more effort to try to get packages with docs for node to work similarly in deno, and weren’t really feeling any value from using deno over node.
If you’re a hobbyist or an academic or starting a totally new project that won’t have dependencies/doesn’t need a large community of modules, then I recommend deno. Otherwise I highly recommend sticking to node until deno comes out with something to make the switch more appealing.
I shouldn't need to read the code extremely closely or repeatedly to have to figure out what it does when the while loop does it clearly (and in a bounded way that you can literally mathematically prove).
Also, I would scream if some opinionated dev gone crazy with their linter added pylint disables and comments explaining it every time we use a while loop in our codebase.
Why does the linter rule not, instead, check if the while loop is unbounded and warn the user of that? Surely screaming fire when there's an actual fire is better than screaming fire at the first sign of smoke.
Signed up and saw extraction can take several days — is this done manually? I assumed scanning would be done purely automatically but I can see why there would need to be a manual review component.