HackerTrans
TopNewTrendsCommentsPastAskShowJobs

o40

no profile record

Submissions

Show HN: I created a PoC for live descriptions of the surroundings for the blind

github.com
73 points·by o40·2 lata temu·25 comments

comments

o40
·2 lata temu·discuss
Yes, repeated information is not great in many cases. A more advanced system could possibly keep track of which information is new and which information is already known to the user.

I wanted to create something opposite of needing to say "Hey Google, describe what is in front of me" or similar. Also a point was to see how cheap/simple you can go and still get valuable information.
o40
·2 lata temu·discuss
Yes. My partner is visually impaired so that is one of the reasons why I think this is interesting to investigate. The current solution is way to "janky" to actually use, but gives insight in the problem to solve.

My hope is that there will be "cheap" camera glasses that you can use different services for image descriptions. There is a company called "Be My Eyes" that is developing an AI tool for image descriptions, which probably is miles better than anything I can come up with. https://www.bemyeyes.com/blog/introducing-be-my-ai

Be My Eyes seem to support Ray-Ban Meta glasses, so hopefully "Be My AI" will too.

I understand the "not consulting the target audience" all too well, for instance braille signs that are at eye-level and is hard to find. Some workplaces is very keen to make accessibility adjustments, but mostly if they are seen so that they can show others that adjustments have been done, regardless if they actually help or not.
o40
·2 lata temu·discuss
Very interesting. This in combination with something that "tracks" described object not needing to describe them again would be a game changer.
o40
·2 lata temu·discuss
Yes, apps for this is for sure the best solution. Hopefully something like "Be My AI" in combination with consumer products such as Ray-Ban Meta, where you can get descriptions without telling the world that you are requesting descriptions.

I have not done any app development, and for this project I wanted to keep some things simple to focus on what can be expected from a low quality camera in combination with AI for descriptions.
o40
·5 lat temu·discuss
Braille input exists on apple phones:

https://support.apple.com/en-us/HT210066

and I think Android supports something similar.