HackerTrans
TopNewTrendsCommentsPastAskShowJobs

mhmmmmmm

no profile record

Submissions

How much do language models memorize?

arxiv.org
58 points·by mhmmmmmm·ปีที่แล้ว·1 comments

comments

mhmmmmmm
·5 เดือนที่ผ่านมา·discuss
I don't think thats necessarily true, they aren't really capacity constrained in practice (they might be behind the scenes and adjust training on the fly, but thats speculation), so wasting tokens effectively helps utilize their (potentially idle) inference GPU's
mhmmmmmm
·ปีที่แล้ว·discuss
They add Claude Code to the pro plan yesterday: https://x.com/_catwu/status/1930307574387363948
mhmmmmmm
·ปีที่แล้ว·discuss
Removing the "Market expert" which uses OHLCV (Open, High, Low, Close, Volume) also drops the sharpee from 5.01 to 1.88 while also increasing the max draw down to 13.29% (v.s. 9.70% for the index). I'd be very surprised if the pre training of the base model was the only source of leakage...
mhmmmmmm
·ปีที่แล้ว·discuss
They certainly do, and also offer the tooling to the public: https://docs.anthropic.com/en/docs/build-with-claude/prompt-...

They also recommend to use it to iterate on your own prompts when using Claude Code for example
mhmmmmmm
·ปีที่แล้ว·discuss
There is https://www.rwkv.com/ which is an LLM based on RNN's, thus having "infinite" context length, it comes with its own tradebacks though. (Notably that its impossible to actually store infinite information in the network, so it prunes based on which information it finds more important.)
mhmmmmmm
·ปีที่แล้ว·discuss
https://x.com/tayvano_/status/1847877011462901915 This thread has some info about very similar past attacks, should give some insights into the level of sophistication that goes into something like that.
mhmmmmmm
·ปีที่แล้ว·discuss
Bybit was quite literally using Gnosis Safe for the compromised wallet.
mhmmmmmm
·ปีที่แล้ว·discuss
> This is not something you can just log in on Binance and buy with cash in a single click.

You would've definitely been able to buy it with cash and a few clicks, for example using moonshot. (And I'm sure a couple other / similar platforms)
mhmmmmmm
·2 ปีที่แล้ว·discuss
Is reliably detecting if code has any infinite loops feasible? Sounds like the halting problem.
mhmmmmmm
·2 ปีที่แล้ว·discuss
So now I probabilistically spam a ton of different orders to on average get my desired fill... This just turns it into a "whoever is best at DoS'ing the exchange" game. As the orderbook fills with competitor orders it makes sense for yourself to also spam orders so each of your orders maintains the same probability of being filled
mhmmmmmm
·2 ปีที่แล้ว·discuss
Taiwan Stock Exchange used to have quantized trading times (read "frequent batch auction"), but it led to worse price discovery and a bigger bid ask spread: https://focus.world-exchanges.org/articles/citadel-trading-a...

> Our analysis of the TWSE’s transition clearly demonstrates that continuous trading results in better liquidity provision, lower bid-ask spreads, more stable prices and enhanced price discovery, as well as higher trading volumes.
mhmmmmmm
·2 ปีที่แล้ว·discuss
CLOB's force market participants to compete on pricing (which is only indirectly related to latency, since you can quote tighter if you know your orders won't get picked off by other, faster, traders) Taiwan used to have Batching style auction and it ultimately led to worse prices: https://focus.world-exchanges.org/articles/citadel-trading-a... > Our analysis of the TWSE’s transition clearly demonstrates that continuous trading results in better liquidity provision, lower bid-ask spreads, more stable prices and enhanced price discovery, as well as higher trading volumes.