tosh

10 hari yang laludiscuss

adjacent take: seek out people who don't mind being wrong & who see it as contribution when you can help them understand something better

tosh

12 hari yang laludiscuss

Is there something like clickbench but specifically for time series dbs/workloads?

tosh

14 hari yang laludiscuss

rare to see images, let alone with color in a Daring Fireball post

great read, I'm sure I would have bought a suitcase from Om

RIP Om

tosh

14 hari yang laludiscuss

macbooks (macs in general) are a good package for llms because they come with so much RAM

and for llms more RAM means access to better models

macbooks might not be as fast as a GPU with similar amount of RAM but more affordable and well integrated

last but not least: compared to a PC+GPU the macbook is either silent (air) or at least way less annoying when you care about noise

for ultimate flexibility and low noise: GPU in the cloud for when you need/want it is probably also most cost effective if you don't have workloads that need to run 24/7

tosh

15 hari yang laludiscuss

discontinuing the cheaper options is a risky move for openai

will trigger re-evaluations of models by other labs + inference providers

tosh

15 hari yang laludiscuss

fondly remember meeting Om many years ago

I was so anxious I couldn't sleep the night before

then in the morning when I walked up to true ventures I was such a sleep deprived mess I worried I will just waste his time

he was a bit surprised and humored, I think, we grabbed some coffee and had a great conversation

ty for your kindness

RIP Om

tosh

17 hari yang laludiscuss

ty! very interesting

tosh

17 hari yang laludiscuss

would love to read also more on what other approaches you considered or played with before settling on the current api/algebra (which is really nice!)

maybe the point, stroke, path tower, enlist and scaling felt kinda self-evident from the beginning?

e.g. postscript has a more imperative (but also very interesting forth-y) approach

ty for the writeup, the wiggly effect is great

tosh

20 hari yang laludiscuss

apparently it is not what the author meant but:

using projection you can "call a function in two parts"

  add: {x+y}
  add4: add[4] / gives {4+x} by fixing 4 as first argument to {x+y}
  add4[2]      / gives 6

this is a useful pattern that you can use to first 'fix' data or behaviour to produce another function

https://en.wikipedia.org/wiki/Partial_application

tosh

20 hari yang laludiscuss

is learning how to accomplish or understand something boring

just because someone or something else does it better?

tosh

20 hari yang laludiscuss

I can't recommend highly enough to implement a simple lisp (or a forth).

Illuminating experience and it will also help you see (among many other things) the parentheses in a different light.

tosh

20 hari yang laludiscuss

it is not easy for a compiler to vectorize

a pragmatic approach: write in a high level interpreted language that rhymes with modern CPUs, vector extensions, memory bandwidth

e.g. apl [0], bqn [1], k [2], kiwi [3]

  - vectors are dense (not boxed)
  - optimized internal representation (e.g. bitpacked bool vectors)
  - primitives act on vectors + use avx, neon if possible

[0] https://www.dyalog.com [1] https://mlochbaum.github.io/BQN/ [2] https://kx.com [3] https://kiwilang.com

great article by marshall on BQN performance compared to C and how to think about it

https://mlochbaum.github.io/BQN/implementation/versusc.html

related:

  - columnar databases: kdb, duckdb, clickhouse
  - machine learning frameworks: pytorch, keras, jax, mlx

tosh

21 hari yang laludiscuss

> The modern Media Player is said to use around 377MB of RAM when idle, compared to roughly 103MB for the old player—about 3.5x as much memory while doing absolutely nothing.

even 103MB sound like a lot for doing nothing

tosh

21 hari yang laludiscuss

nb: Robert Recorde also came up with the equals sign as two horizontal parallel lines "=". Yes, that one.

"bicause noe 2, thynges, can be moare equalle"

(and helped make + and - signs more popular)

https://en.wikipedia.org/wiki/Robert_Recorde

see page 5:

https://sigapl.org/Articles/Language%20as%20an%20intellectua...

obligatory mention of Notation as a Tool of Thought

1979 Turing Award lecture by Ken Iverson

https://www.eecg.utoronto.ca/~jzhu/csc326/readings/iverson.p...

tosh

22 hari yang laludiscuss

Agree, in addition to that DuckDB also works quite well for data that is too big to fit in memory or on the machine DuckDB is on (predicate push down, out of core processing, …).

tosh

29 hari yang laludiscuss

ty, imho good examples for how you can achieve a distinct look

the problem is not tailwind, the model output just reflects the training material that most likely overindexed on tailwind templates with lots of fonts and text sizes and outlines, I'm sure future training runs will be better

tosh

bulan laludiscuss

afaiu morsel-driven means the workload gets turned into 'smallish' chunks (morsels)

instead of having to pre-allocate upfront (e.g. 4 nodes get 1/4 each) it is more granular and dynamic

a worker that's "done" can request another morsel

pragmatic approach because nodes might not all be equally fast (cache, cpu frequency, throttling, …) and also some morsel workloads take longer than others depending on the values they contain and what kind of work needs to get done

so this approach tends to balance out nicely

I'm sure someone else can explain it better / correct me (please do!)

tosh

bulan laludiscuss

finally a snow leopard like release focused on performance and fixing user experience

tosh

bulan laludiscuss

> It seems entirely possible that, in due course, electronic or chemical "machines" will outdo the human brain in most of the functions we now consider exclusively within its province.

tosh

bulan laludiscuss

https://archive.is/ia01T

Submissions

Give it five minutes (2015)

How to Build a Coding Agent

M64 Controller Review

A certain kind of talk around LLMs that I find increasingly puzzling

The OpenClaw Foundation

The four horsemen behind Postgres outages

Apple Announces $30B Broadcom Deal to Make More US Chips

Boeing 737 cargo plane goes missing off Pakistan coast

Packed Bed

Anthropic: A global workspace in language models

List of Screw Drives

Declaration of Independence Desk

Apple Silicon Exec Explains Mac Mini AI Demand and On-Device Future

Apple and Broadcom Extend Chip Supply Deal to 2031

Bomb the Arctic, dam the Mediterranean and build a second moon

Organic Maps

Binstack: Making a maximal multi-dimensional decision (2022)

Europe's air conditioning culture wars heat up

Zig: All Package Management Functionality Moved from Compiler to Build System

'clustered index penalty' on all non-clustered indexes

comments