How well GPTZero can detect ChatGPT generated text by measuring perplexity (how random the words choices are) and burstiness (how diverse the sentence structure is) shows that whatever algorithm our brain uses has stronger creative capabilities than this LLM.
GPT-3.5 isn’t a great writer like AlphaGo is a great go player. Maybe one day AI will generate better scripts and novels than humans, but not this model.
Medium-quality writing is ok for informative content though, but it’s problematic when the model doesn’t know fact from fiction. That’s the important complaint.
Is it dangerous? Maybe.
But is it useful? Not if it’s wrong too often.
You’re right that this tech should be taken seriously, but so should the hallucination problems. These problems can be solved. And maybe they should be solved before anyone trusts it with serious questions.
> LangChain uses pre-trained models from Hugging Face, such as BERT, GPT-2, and XLNet. For more information, please see the Getting Started Documentation[0].
That links to a 404, but I did find the correct link[1]. Oddly that doc only mentions an OpenAI API wrapper. I couldn’t find anything about the other models from huggingface.
Does LangChain have any tooling around fine tuning pre-trained LLMs like GPTNeoX[2]?
> We're predisposed to seeing meaning, and perhaps "intelligence", everywhere.
I’m guilty of this with my dog. I can’t help it with her head tilts and deep stares! Her inner monologue is probably less sophisticated than I like to think it is.
Yes on all three points! Especially search. Notion’s search is so painfully slow. Whenever I try to link a row to another row the loader sounds for 2+ secs, even if I’m searching a table with <10 rows.
The first use case in the demo is generating a blog post, so I’d assume that they’re trying to win the “cynical marketers wanting to use GPT-3 to churn out keyword nonsense to game Google Search” market. I know of some marketing teams that use notion for content management.
I wouldn’t trust the narrator here. As the CEO, Jeremy is incentivized to exaggerate the impact. It’s yet to be seen whether Bitcoin, Ethereum or Doge will be considered securities. Neither Bitcoin or Ethereum seem to pass the Howey test [0], but who knows.
> One significant case the LBRY ruling could impact is the SEC’s suit against Ripple Labs and two of its executives, who have been charged with selling $1.3 billion in unregistered securities. Much like LBRY, Ripple Labs’ defense has hinged on its claim that its native token XRP is not a security.
The precedents being set with these cases will have an enormous ripple effect on crypto and web3 companies.
Revenue/employee at Twitter is about $600k while it’s over $1.2M at Meta and Google [0]. Elon is winding up for a layoff with comments like this. Not sure if the accuracy of his comment is relevant.
It could be a bear market rally, which would not be too unusual [0]. Jamie Dimon (JPMorgan) says the market could drop another 20% before we hit bottom [1]. Then there’s OPEC threatening to cut supply. So, there’s certainly a chance of more pain to come in the stock market, but it’s impossible to predict a bottom.
I do agree with your overall sentiment though. After this economic storm passes there will likely be good times ahead for the US. There are lots of great companies selling at a discount right now and there will be more in the near future. It’s a great time for long-term investors to buy. (Apple is looking great!)
With that being said, this may represent a permanent change in the tech industry. Especially for startups and private, VC-backed companies. Last year we saw private SaaS companies raise at 100x ARR. Those multiples have dropped back down to 8-10x and may never reach similar heights again.
This could even be the end of the Unicorn era. We’ve had near 0% interest rates since 2008. This was the primary driver of high tech valuations and the proliferation of Unicorns. Now with rates closer to normal, profitability will be expected sooner from tech companies and startups.
In fact, Bessemer is trying to retire the term “Unicorn,” which is valuation-based, and replace it with “Centaur,” which is ARR-based (ARR>=$100M) [2]. It hasn’t caught on yet, but I’m a fan of the punnier spelling (CentARR).
I started to become concerned about Elon when I read his 2017 interview with Rolling Stone[0]:
> I explain that needing someone so badly that you feel like nothing without them is textbook codependence.
Musk disagrees. Strongly. “It’s not true,” he replies petulantly. “I will never be happy without having someone. Going to sleep alone kills me.” He hesitates, shakes his head, falters…
He’s been in desperate need of therapy for a long time. It’s sad in some ways. He is one of the most brilliant men alive, but he would be 10x happier and more effective if he worked on himself as hard as he works his companies.
The other night I watched the Crypto Startup School video series by a16z on YouTube [0]. It includes presentations from smart people saying that blockchain/ethereum is the computing platform of the future.
One issue with ETH/smart-contracts that is not addressed in the series is how to ship patches to a smart contract. Let’s say there’s a vulnerability in my contract that accidentally leaks ETH.
How do I ship a patch to fix the contract? Could my buggy contract be taken advantage of indefinitely? Maybe I could move all my ETH to a new wallet and leave the bad contract? How is this problem handled today?
> a man who presents a child at baptism and promises to take responsibility for their religious education.
So, the original definition is a gendered and religious term.
Sounds silly to me. Especially in this context.