HackerLangs
トップ新着トレンドコメント過去質問紹介求人

thesz

no profile record

コメント

thesz
·10 日前·議論
I do not know. I am here to point out that HIIT is almost a resistance training. ;)

Here's meta review of resistance training for endurance running: https://pmc.ncbi.nlm.nih.gov/articles/PMC11258194/

Here's old one: https://pubmed.ncbi.nlm.nih.gov/18460997/

I think it is possible to utilize squats both as weight losing device and running economy improvement device.

I do not run, though, as I am too old. But I love barbell squats!
thesz
·10 日前·議論


  > You say that like it's a bad thing?
I am saying that politicians will get around the sunsetting rule, if any, that's first.

Constitution, then, will serve as what regular law does right now, without anything that makes something Constitution. That's second.

I also am strongly suspecting that hundredths of thousands of pages of codes and laws will not get leaner at all. There is no point in ceding regulatory capture, because the capability to capture regulations is the point of governance, as I see it.
thesz
·11 日前·議論
HIIT is a borderline strength training.

Consider Tabata protocol.

It is supermaximal effort protocol, participants are required to exert maximum effort repeatedly.

The duration of active phase of Tabata is 20 seconds, half of approximately 40 seconds after which maximum performance (power output) drops significantly, because body switches to a different energy system.

In my experience, Tabata squats are done in range of 16-21 per 20 seconds of active phase. So, basically, Tabata squats are equal to somewhat less than 8 sets of 16-20 repetitions done close to failure. The failure usually come after first active phase, so that's why there are "somewhat less than 8 sets." I personally define failure as breakage of exercise form or exercise pace, and this is what I and others experience in Tabata squats.

And you know what? If you go close to failure, muscle mass and strength grow in the range of 5 to 35 repetitions [1].

[1] https://www.youtube.com/watch?v=dN_c4sQwfTI

PS

Other HIIT protocols are similar. For example, 3 one-minute-active-phase-one-minute-rest supermaximal protocol also leans close to "3 sets of 35 repetitions done to failure" - squats' pace noticeably quickly deteriorate to 1 squat in two seconds.
thesz
·12 日前·議論


  > Every law should have an automatic sunset period of 1-10 years that requires it to pass the entire legislative process again, or at least both full chambers + signing.
Then you will have a lot of Constitution amendments. That's first.

The burden of ever-changing law landscape will be carried by ordinary people, not by legislators. That's second.
thesz
·12 日前·議論
Adversarial inputs at the level of the government somewhat fascinate me.

(aeons old blackmail tactic requires more work than the ability to select which of two data batches is more aligned with adversarial behavior)
thesz
·26 日前·議論
https://en.wikipedia.org/wiki/Mixture_of_experts#Sparsely-ga...

"The sparsely-gated MoE layer,[21] published by researchers from Google Brain, uses feedforward networks as experts, and linear-softmax gating. Similar to the previously proposed hard MoE, they achieve sparsity by a weighted sum of only the top-k experts, instead of the weighted sum of all of them."

"Top-k experts," in case of some DeepSeek's models k=1.
thesz
·28 日前·議論
Slopkies.
thesz
·先月·議論


  > What kind of models are you including here?
Logistic regression, non-linear logistic regression, simple neural networks, etc. Not the code as in "bunch of ifs" or decision trees.

The truth tables? Predict zeroth bit in enwik9 from, say, bits of 64 previous bytes. Or multiply two 16 bit numbers and predict bit 16 of the multiplication result.
thesz
·先月·議論


  > doesn't that mean we're approaching optimality?
No.

Transformers are Markov chains [1]. Somewhere around this fascinating site [2] I read that stateful models have an advantage. Author provided an example, a state machine with two states A and B, where at state A transitions are to state A (output 0) and to state B (output 1) with equal probability and at state B the transition is always to state A and output is always 1.

For this state machine just one bit of memory can make an optimal prediction that ones always go in pairs, whereas Markov chain will approximate this prediction and never reach optimality.

  [1] https://arxiv.org/abs/2410.02724
  [2] https://bactra.org/
thesz
·先月·議論
My comment in the previous discussion of that paper: https://news.ycombinator.com/item?id=48014197

Authors used LTL (linear temporal logic) to express, basically, non-reduced non-ordered binary decision diagrams. Or just binary decision diagrams, BDDs.

BDDs are almost guaranteed to have exponential size because they do not employ reduction (sharing of common expressions). Reduced BDDs are more succinct and reduced ordered BDDs are even more succinct.

Also, transformers in the paper are constructed, not trained. Training any model to express some truth table is very hard. They also did not perform comparison with, say, Kolmogorov-Arnold representation, which is also universal approximator.

So this paper is not as deep as one may think it is.
thesz
·先月·議論
Most probably you do not want two of your SELECT statements to have the same seed during the execution.

This necessitates some state, most probably, persisted one. Hence, imperativeness.
thesz
·先月·議論
While it is true on the schema level, it is not true at the query level.

The most frequently used kind of join is a general relation.

[1] https://github.com/agirish/tpcds/blob/master/query1.sql

Query 1 from TPC-DS creates a multi-column relation by using GROUP BY. Which relation is then partially constrained by different columns from different tables.
thesz
·先月·議論
Imperative languages such as C/C++ specify "microtransactions" - an ordering over memory accesses (including (de)allocations) within some statement or group of statements.

Compilers are free to rearrange these accesses if the final result is same as if executed by these ordered microtransactions.

Consider loop fusion, loop splitting and/or loop skewing.
thesz
·先月·議論
For all practical purposes, it very much is, consider random number generation.
thesz
·先月·議論
Some of them, with notable exception of perfect squares of primes, can be expressed by products of different combinations of factors.

E.g., 6^2 = (223)3 = 2(233).

One of ~22 (ln(2^32)) perfect squares will be a square of perfect prime. Most won't.
thesz
·先月·議論
PSP/TSP have everything to do with the discussion.
thesz
·先月·議論


  > gradient descent isn't good at combinatorial optimisation.
If you convolve your problem with sufficiently wide Gaussian, you can use gradient descent. The approach is called Natural Evolution Strategies [1].

[1] https://en.wikipedia.org/wiki/Natural_evolution_strategy#Nat...

It requires O(N^4) evaluations to compute Fisher Information Matrix for N-dimensional parameterization of the problem in original formulation. But there are closed form solutions and more economical representations of covariance matrix (LoRA, hehe).
thesz
·先月·議論
Multiply "inference + backwards pass (~2x inference cost) + activations (vram overhead)" by batch size (thousands) to get to the actual RAM and compute cost. Optimizer like ADAM adds only two or three model-sized overhead.

And last, but not least, you need only one hidden layer kept in RAM for inference, but you need all of them (61 for Deepseek models) kept in RAM for computing gradient for one sample.
thesz
·先月·議論
The difference between training and inference is 1) one have to keep intermediate results for backward pass in training and 2) computation for training double because of the backward pass.

Training is also done over batches, which increase memory requirements by several orders of magnitude. This is why training needs costly compute.

One of the ways out of this unfortunate situation is to use something like Stochastic Average Gradient Descent [1]. Examples there are mostly concerned with regularized logistic regression, which makes problem more or less convex. Neural networks are inherently non-convex. Still, maybe some ideas from there can be utilized in the context of neural networks, like use of estimated Lipshitz constant to derive curvature and appropriate learning step.

  [1] https://www.cs.ubc.ca/~schmidtm/Courses/540-W19/L12.pdf
thesz
·先月·議論
English is not my native language.

PSP/TSP (Personal and Team Software Processes) and RUP (Rational's Uniform Process, to a lesser extent) are very valuable approaches to software engineering. Please, read about them, they are very interesting.