abhikul0

12 giorni fadiscuss

I tried to lookup a Star Trek episode of this premise and found a Voyager episode: https://en.wikipedia.org/wiki/Friendship_One_(Star_Trek:_Voy...

This is a likely scenario of misinterpretation between species haha.

abhikul0

23 giorni fadiscuss

Interesting

https://science.nasa.gov/mission/swift/swift-boost-mission/

abhikul0

2 mesi fadiscuss

https://www.logitech.com/en-us/shop/p/pop-icon-keys.920-0130...

abhikul0

2 mesi fadiscuss

While not exactly the hub style you mentioned, maybe this is as close to Jamming you can get.

https://support.apple.com/en-us/guide/garageband-ipad/chsf2f...

abhikul0

2 mesi fadiscuss

Wow, didn't know about Spotify's basic-pitch or that any song to midi model existed. Gonna be a good time sink to play around with. The standalone mac app build was straightforward, thanks.

abhikul0

2 mesi fadiscuss

On-device video subtitles generation is exciting, should help with watching videos on mute. This seems like a low hanging fruit that should've already been grabbed by an app but I can't find any.

abhikul0

2 mesi fadiscuss

The blank page is what you'd get if you cleared your Watch History. I use this to watch a new-to-me topic/channel or just a video that I know I'd only watch once and don't want in my recommended history in Incognito mode(although you could just remove that video manually from history too).

This makes it easy to somewhat steer the algorithm, I just open and scrub through a few videos of the same "kind" that I'm interested in and this then makes the youtube homepage a bit wieldy. This still populates unrelated videos but at a lower rate.

abhikul0

3 mesi fadiscuss

Relevant Smarter Every Day video: https://www.youtube.com/watch?v=VPSm9gJkPxU

abhikul0

3 mesi fadiscuss

I'll try to use that, but llama-server has mmap on by default and the model still takes up the size of the model in RAM, not sure what's going on.

abhikul0

3 mesi fadiscuss

Of course the swap is there for fallback but I hate using it lol as I don't want to degrade SSD longevity.

abhikul0

3 mesi fadiscuss

For the 9B model, I can use the full context with Q8_0 KV. This uses around ~16GB, while still leaving a comfortable headroom.

Output after I exit the llama-server command:

  llama_memory_breakdown_print: | memory breakdown [MiB]  | total    free     self   model   context   compute    unaccounted |
  llama_memory_breakdown_print: |   - MTL0 (Apple M3 Pro) | 28753 = 14607 + (14145 =  6262 +    4553 +    3329) +           0 |
  llama_memory_breakdown_print: |   - Host                |                   2779 =   666 +       0 +    2112                |

abhikul0

3 mesi fadiscuss

Mac has unified memory, so 36GB is 36GB for everything- gpu,cpu.

abhikul0

3 mesi fadiscuss

A usable quant, Q5_KM imo, takes up ~26GB[0], which leaves around ~6-7GB for context and running other programs which is not much.

[0] https://huggingface.co/unsloth/Qwen3.5-35B-A3B-GGUF?show_fil...

abhikul0

3 mesi fadiscuss

I hope the other sizes are coming too(9B for me). Can't fit much context with this on a 36GB mac.

abhikul0

3 mesi fadiscuss

Have you ever tried going to the model registry and seeing that the model was recently updated? What updated? What changed? Should I re-download this 20GB file?

I guess if you're not frustrated with things like this then sure, no need to stop using it.

abhikul0

3 mesi fadiscuss

https://en.wikipedia.org/wiki/List_of_generic_and_genericize...

abhikul0

3 mesi fadiscuss

Real Science video on the slug: https://www.youtube.com/watch?v=IH_uv4h2xYM

abhikul0

3 mesi fadiscuss

I thought github was being wonky but yeah, getting 401 Unauthorized error.

Edit: Can't view discussions as well.

abhikul0

3 mesi fadiscuss

And they say: https://www.youtube.com/watch?v=IfpMknlL-pg