HackerTrans
TopNewTrendsCommentsPastAskShowJobs

Show HN: Can an AI model fit on a single pixel?(github.com)

8 points·by deevelton·há 3 meses·10 comments
github.com
Show HN: Can an AI model fit on a single pixel?

https://github.com/dvelton/ai-pixel

10 comments

deevelton·há 3 meses
This was just a fun thought experiment.

Feed it two inputs (e.g. chance of rain and wind speed; this is one of the examples in the demo) and it learns to answer a yes/no question like "bring an umbrella?" It's a one-neuron binary classifier with three learned parameters: two weights and a bias. Those three numbers map directly to Red, Green, and Blue. Save the model: you get a 1x1 PNG. Load the pixel: you get your classifier back. The color is the model.
mememememememo·há 3 meses
It is fun. The trainer seems to get stuck in local minima though.
deevelton·há 3 meses
Thanks; does this fix it? https://github.com/dvelton/ai-pixel/commit/ba04e1c649e0ec99b...
mememememememo·há 3 meses
Tried again and no. To reproduce create a corridor e.g.

    X    O
    
     X     O

      X   O
       X     O

       X   O
Line can get jammed in non vertical positon.
deevelton·há 3 meses
Increased default epochs to 2000 instead of 500, I think that fixed it but let me know if you still run into this.
mememememememo·há 3 meses
Works for me now, thanks!
deevelton·há 3 meses
awesome! thanks for checking it out
crackalamoo·há 3 meses
This is super fun! Very elegant idea

Has anyone done this for larger neural nets? Is there a way to extract some kind of pattern or is the image just noise no matter how you construct it? I'd be curious to see something like that
deevelton·há 3 meses
Not sure what happens if you start scaling this, but curious too. Would love to see someone who actually knows ML try it.
deevelton·há 3 meses
one of my teammates experimenting with something along these lines :) https://github.com/jessephus/model-mosaic