dhruvbird · HackerTrans

22 วันที่ผ่านมาdiscuss

This would be cool. I suspect that people don't implement this model because it's a long tail of users requesting this. This is totally feasible technically.

dhruvbird

22 วันที่ผ่านมาdiscuss

Very cool. I'm a big fan of swipe. So much so that a bunch of us a Grammarly re-implemented it using a similar technique about 2 years ago on the Grammarly iOS keyboard, so if you want to experience something similar on iOS, you can head to the app store https://apps.apple.com/us/app/grammarly-ai-keyboard-notes/id... and use the qwerty english keyboard layout to get this neural net version of swipe.

See https://www.grammarly.com/blog/engineering/deep-learning-swi... for more details - it's very similar to the architecture described by the FUTO folks.

One key difference is that the learned model does not decode in a context sensitive manner but does it a word at a time. The main reason is because we wanted to release this soon and wanted the user's personal dictionary (i.e. contact names, etc... to show up correctly when swiped). It would have been nice if we could have followed through with the context sensitive decoding as described by the FUTO folks. It would really help with accuracy when dealing with words like:

1. (food, good, hood) 2. (you, toy, rot) 3. (our, or, it) etc...

(Disclaimer: I am one of the authors of the Grammarly swipe system as described in the linked blog post).

dhruvbird

7 เดือนที่ผ่านมาdiscuss

This ^^^^

While the provided schema has a "quantity" field, it doesn't mention the units.

<code>

class Item(BaseModel):

    name: str

    price: float = Field(description="per-unit item price")

    quantity: float = Field(default=1, description="If not specified, assume 1")

class Receipt(BaseModel):

    establishment_name: str

    date: str = Field(description="YYYY-MM-DD")

    total: float = Field(description="The total amount of the receipt")

    currency: str = Field(description="The currency used for everything on the receipt")

    items: list[Item] = Field(description="The items on the receipt")

</code>

There needs to be a better evaluation and a better provided schema that captures the full details of what is expected to be captured.

> What kind of error should it return if there's no total listed on the receipt? Should it even return an error or is it OK for it to return total = null?

Additionally, the schema allows optional fields, so the LLM is free to skip missing fields if they are specified as such.

dhruvbird

10 เดือนที่ผ่านมาdiscuss

I wonder if most people get the same things wrong. I checked your other comments and noticed that there is no server side component. In case you add one, I would be really interested in knowing which ones are most confused, and in which direction.

dhruvbird

10 เดือนที่ผ่านมาdiscuss

This is awesome! After about 50 attempts, I have a much better sense of what to look out for when I see something. I wish there were more such focused apps. for specific specific health related things.

dhruvbird

2 ปีที่แล้วdiscuss

Or waiting weeks could force you to think about the problem harder and eventually figure it out because you just spent more time on it this time.

dhruvbird

3 ปีที่แล้วdiscuss

How combustible are these batteries compared to the standard lower density ones, and if one of them catches fire, how easy/hard is it for the fire department to get it under control?

dhruvbird

3 ปีที่แล้วdiscuss

Did the blog mention any metrics like what the model size is etc... since that seems to be the one of the motivating factors?