lpasselin · HackerTrans

ปีที่แล้วdiscuss

A lawyer can become a locksmith in a few months (weeks? days?). If the flip mentioned is really happening, isn't it temporary?

lpasselin

ปีที่แล้วdiscuss

Hey, I read the paper in detail and presented to colleagues during our reading group.

I still do not understand exactly where D1L comes from in LGan(D1L, T(A1(u)). Is D1L simply A1(u)?

I also find that mixing notation in figure 2 and 3 makes it tricky.

Would have loved to have more insights from the results in the tables.

And more results from inversion, on more than Enron dataset. Since that is one end goals, even if reusing another method.

Thank you for the paper, very interesting!

lpasselin

2 ปีที่แล้วdiscuss

Do the captured elements move a lot during this snapshot? since it will take months? Is the difference significant?

lpasselin

2 ปีที่แล้วdiscuss

This comes from the same group as the EfficientViT model. A few months ago, their EfficientViT model was the only modern and small ViT style model I could find that had raw pytorch code available. No dependencies to the shitty framework and libraries that other ViT are using.

lpasselin

2 ปีที่แล้วdiscuss

Custom and _competent_ AI tutors will be a game changer for education.

lpasselin

2 ปีที่แล้วdiscuss

Meanwhile, I had a hard time last week getting a machine with 8 gpus from azure.

lpasselin

2 ปีที่แล้วdiscuss

I have a 200$ mini machine and would like to upgrade. Can DIY anything. What would you suggest for a maximum budget of 1500$?

lpasselin

2 ปีที่แล้วdiscuss

The mamba paper shows significant improvements in all model sizes, up to 1b, the largest one tested.

Are there any reason why it wouldn't scale to 7b or more? Have they tried it?

lpasselin

2 ปีที่แล้วdiscuss

Most of the leaderboard has much lower sequence length.

comments