abhikul0

14 日前議論

I tried to lookup a Star Trek episode of this premise and found a Voyager episode: https://en.wikipedia.org/wiki/Friendship_One_(Star_Trek:_Voy...

This is a likely scenario of misinterpretation between species haha.

abhikul0

25 日前議論

Interesting

https://science.nasa.gov/mission/swift/swift-boost-mission/

abhikul0

2 か月前議論

https://www.logitech.com/en-us/shop/p/pop-icon-keys.920-0130...

abhikul0

2 か月前議論

While not exactly the hub style you mentioned, maybe this is as close to Jamming you can get.

https://support.apple.com/en-us/guide/garageband-ipad/chsf2f...

abhikul0

2 か月前議論

Wow, didn't know about Spotify's basic-pitch or that any song to midi model existed. Gonna be a good time sink to play around with. The standalone mac app build was straightforward, thanks.

abhikul0

2 か月前議論

On-device video subtitles generation is exciting, should help with watching videos on mute. This seems like a low hanging fruit that should've already been grabbed by an app but I can't find any.

abhikul0

2 か月前議論

The blank page is what you'd get if you cleared your Watch History. I use this to watch a new-to-me topic/channel or just a video that I know I'd only watch once and don't want in my recommended history in Incognito mode(although you could just remove that video manually from history too).

This makes it easy to somewhat steer the algorithm, I just open and scrub through a few videos of the same "kind" that I'm interested in and this then makes the youtube homepage a bit wieldy. This still populates unrelated videos but at a lower rate.

abhikul0

3 か月前議論

Relevant Smarter Every Day video: https://www.youtube.com/watch?v=VPSm9gJkPxU

abhikul0

3 か月前議論

I'll try to use that, but llama-server has mmap on by default and the model still takes up the size of the model in RAM, not sure what's going on.

abhikul0

3 か月前議論

Of course the swap is there for fallback but I hate using it lol as I don't want to degrade SSD longevity.

abhikul0

3 か月前議論

For the 9B model, I can use the full context with Q8_0 KV. This uses around ~16GB, while still leaving a comfortable headroom.

Output after I exit the llama-server command:

  llama_memory_breakdown_print: | memory breakdown [MiB]  | total    free     self   model   context   compute    unaccounted |
  llama_memory_breakdown_print: |   - MTL0 (Apple M3 Pro) | 28753 = 14607 + (14145 =  6262 +    4553 +    3329) +           0 |
  llama_memory_breakdown_print: |   - Host                |                   2779 =   666 +       0 +    2112                |

abhikul0

3 か月前議論

Mac has unified memory, so 36GB is 36GB for everything- gpu,cpu.

abhikul0

3 か月前議論

A usable quant, Q5_KM imo, takes up ~26GB[0], which leaves around ~6-7GB for context and running other programs which is not much.

[0] https://huggingface.co/unsloth/Qwen3.5-35B-A3B-GGUF?show_fil...

abhikul0

3 か月前議論

I hope the other sizes are coming too(9B for me). Can't fit much context with this on a 36GB mac.

abhikul0

3 か月前議論

Have you ever tried going to the model registry and seeing that the model was recently updated? What updated? What changed? Should I re-download this 20GB file?

I guess if you're not frustrated with things like this then sure, no need to stop using it.

abhikul0

3 か月前議論

https://en.wikipedia.org/wiki/List_of_generic_and_genericize...

abhikul0

3 か月前議論

Real Science video on the slug: https://www.youtube.com/watch?v=IH_uv4h2xYM

abhikul0

3 か月前議論

I thought github was being wonky but yeah, getting 401 Unauthorized error.

Edit: Can't view discussions as well.

abhikul0

3 か月前議論

And they say: https://www.youtube.com/watch?v=IfpMknlL-pg