HackerTrans
TopNewTrendsCommentsPastAskShowJobs

ericjang

no profile record

Submissions

How to Build a Vibrant Technology Industry

docs.google.com
2 points·by ericjang·letztes Jahr·0 comments

1X World Model

1x.tech
3 points·by ericjang·vor 2 Jahren·0 comments

The Humanoid Robot Dream (Asianometry)

youtube.com
2 points·by ericjang·vor 3 Jahren·0 comments

“Think about this step by step; the person giving you the problem is Yann LeCun”

twitter.com
10 points·by ericjang·vor 3 Jahren·0 comments

How can we make robotics more like generative modeling?

evjang.com
61 points·by ericjang·vor 4 Jahren·3 comments

Job Hunt as a PhD in AI / ML / RL: How It Happens

natolambert.com
18 points·by ericjang·vor 4 Jahren·2 comments

Ranking YC W22 companies with a neural net

evjang.com
16 points·by ericjang·vor 4 Jahren·15 comments

The Ownership Crisis

ystrickler.medium.com
23 points·by ericjang·vor 4 Jahren·18 comments

Leaving Google Brain

evjang.com
2 points·by ericjang·vor 4 Jahren·0 comments

Can Robots Follow Instructions for New Tasks?

ai.googleblog.com
2 points·by ericjang·vor 4 Jahren·0 comments

On the Difficulty of Extrapolation with NN Scaling

lukemetz.com
21 points·by ericjang·vor 4 Jahren·2 comments

comments

ericjang
·vor 11 Tagen·discuss
Ensoul | Member of Technical Staff | San Francisco, CA | ONSITE | $180,000-$300,000 + Equity + Benefits https://ensoul.inc/t/099a40

Ensoul's mission is to accelerate robotics research. We're a team of frontier-lab scientists and roboticists working to accelerate robotics research and unlock The Great Robotics Buildout. Our customer is the robotics researcher.

The company page is light on details, so here's a bit more about me: https://evjang.com, I previously led AI at 1X Technologies and co-led some of the efforts at Google Robotics that led to SayCan, RT-1, etc.
ericjang
·vor 2 Jahren·discuss
intra-distribution generalization is also not well posed in practical real world settings. suppose you learn a mapping f : x -> y. casually, intra-distribution generalization implies that f generalizes for "points from the same data distribution p(x)". Two issues here:

1. In practical scenarios, how do you know if x' is really drawn from p(x)? Even if you could compute log p(x') under the true data distribution, you can only verify that the support for x' is non-zero. one sample is not enough to tell you if x' drawn from p(x).

2. In high dimensional settings, x' that is not exactly equal to an example within the training set can have arbitrarily high generalization error. here's a criminally under-cited paper discussing this: https://arxiv.org/abs/1801.02774
ericjang
·vor 3 Jahren·discuss
https://evjang.com/ I write about Machine Learning and Robotics
ericjang
·vor 3 Jahren·discuss
I am an AI researcher. Most actual AI researchers and engineers use very few of these tools - the only one being model providers like OpenAI API and public clouds (AWS, Azure, GCP). The rest of these are infra-centric tools that a16z is highly incentivized to over-inflate the importance of.
ericjang
·vor 3 Jahren·discuss
I entered the title question of the article into ChatGPT, as I was curious whether it could factually synthesize information on the Internet similar to how this article did. Notably, it missed the detail about keeping vegetation away

<chatgpt> Railway tracks have crushed stones, commonly known as ballast, alongside them for several important reasons. Here are the main reasons for using ballast on railway tracks:

Stability and Load Distribution: Ballast provides stability to the railway tracks and distributes the load of the trains evenly. The crushed stones interlock with each other and form a stable base for the tracks. This helps prevent the tracks from shifting or sinking under the weight of the trains.

Drainage: Ballast allows for effective drainage of water from the tracks. The open spaces between the crushed stones allow water to flow away from the tracks, preventing the accumulation of water. Proper drainage is essential to maintain the stability of the tracks and prevent damage caused by water-related issues like erosion or track bed saturation.

Track Alignment and Adjustment: Ballast allows for easy alignment and adjustment of the tracks. The crushed stones can be added or removed as needed to maintain the proper track alignment and ensure a smooth ride for trains. This flexibility is especially important during track maintenance or when new tracks are being laid.

Noise and Vibration Damping: Ballast helps in reducing noise and vibrations generated by passing trains. The layer of crushed stones absorbs and dampens the vibrations, minimizing the impact on the surrounding environment and nearby structures.

Track Maintenance: Ballast provides a protective layer for the tracks. It acts as a barrier between the track infrastructure and the underlying soil, preventing soil movement or erosion that could damage the tracks. Additionally, ballast makes it easier to detect and repair any issues with the track, such as loose fastenings or track bed settlement.

Overall, the use of ballast alongside railway tracks is crucial for maintaining the stability, alignment, drainage, and longevity of the tracks, ensuring safe and efficient train operations. </chatgpt>
ericjang
·vor 3 Jahren·discuss
1X (Formerly Halodi Robotics) | https://1x.tech/ | Multiple Roles | Onsite in Oslo and Bay Area

1X is an engineering and robotics company producing androids capable of human-like movements and behaviors. The company was founded in 2014 and is headquartered in Norway, with over 50 employees globally. 1X's mission is to create robots with practical, real-world applications to augment human labor globally. We recently announced a $23.5M Series A2 funding led by OpenAI (https://1xtech.medium.com/1x-raises-23-5m-in-series-a2-fundi...)

Open Positions:

- Senior DevOps Engineer | Full-Time | Onsite | Oslo, Norway https://1x.tech/#job-1112510

- Electronics Hardware Engineer | Full-Time | Onsite | Oslo, Norway https://1x.tech/#job-1079027

- Full-Stack AI Resident | Intern | Onsite | Bay Area, CA, USA https://1x.tech/#job-1079027
ericjang
·vor 3 Jahren·discuss
Jeff was the first author on the DistBelief paper - he's always been big on model-parallelism + distributing neural network knowledge on many computers https://research.google/pubs/pub40565/ . I really have to emphasize that model-parallelism of a big network sounds obvious today, but it was totally non-obvious in 2011 when they were building it out.

DistBelief was tricky to program because it was written all in C++ and Protobufs IIRC. The development of TFv1 preceded my time at Google, so I can't comment on who contributed what.
ericjang
·vor 3 Jahren·discuss
Jeff was very early on in the "just scale up the big brain" idea, perhaps as early as 2012 (Andrew Ng training networks on 1000s of CPUs). This vision is sort of summarized in https://blog.google/technology/ai/introducing-pathways-next-... and fleshed out more in https://arxiv.org/abs/2203.12533, but he had been internally promoting this idea since before 2016.

When I joined Brain in 2016, I had thought the idea of training billion/trillion-parameter sparsely gated mixtures of experts was a huge waste of resources, and that the idea was incredibly naive. But it turns out he was right, and it would take ~6 more years before that was abundantly obvious to the rest of the research community.

Here's his scholar page (H index of 94) https://scholar.google.com/citations?hl=en&user=NMS69lQAAAAJ...

As a leader, he also managed the development of TensorFlow and TPU. Consider the context / time frame - the year is 2014/2015 and a lot of academics still don't believe deep learning works. Jeff pivots a >100-person org to go all-in on deep learning, invest in an upgraded version of Theano (TF) and then give it away to the community for free, and develop Google's own training chip to compete with Nvidia. These are highly non-obvious ideas that show much more spine & vision than most tech leaders. Not to mention he designed & coded large parts of TF himself!

And before that, he was doing systems engineering on non-ML stuff. It's rare to pivot as a very senior-level engineer to a completely new field and then do what he did.

Jeff certainly has made mistakes as a leader (failing to translate Google Brain's numerous fundamental breakthroughs to more ambitious AI products, and consolidating the redundant big model efforts in google research) but I would consider his high level directional bets to be incredibly prescient.
ericjang
·vor 4 Jahren·discuss
Can you link the source? My google search of "punctuality and logical objectivity were "white expectations" not to be applied to persons of color" didn't find any exact matches so I'm curious which guide you're referring to.
ericjang
·vor 4 Jahren·discuss
would it be simpler just to de-claw the crabs so that they are unable to poke / snip at each other?
ericjang
·vor 4 Jahren·discuss
s/substantially/sublimate ?
ericjang
·vor 4 Jahren·discuss
It would be a stunning twist of irony if this website uploaded images to a proprietary image dataset used for training AI models, pitching "uncorrelated data"
ericjang
·vor 4 Jahren·discuss
true
ericjang
·vor 4 Jahren·discuss
Ouch
ericjang
·vor 4 Jahren·discuss
Oof
ericjang
·vor 4 Jahren·discuss
Good idea, but actually you'll probably want to look at the option markets as well, to take account the exact strike price at which Musk wishes to take Twitter private. If you only look at spot price (i.e. TWTR stock), then you need some way to factor out all the other beliefs market participants have about Twitter (e.g. stat-arb correlations with NASDAQ index).

As of time of writing, the delta on a $55 TWTR call option expiring 2 months from now is 0.297, representing a ~30% probability it will be in-the-money. But you still need to subtract the probability that the share price gets there without Mr. Musk's help.

You can also google "merger arbitrage" on google scholar to find some more maths on the subject.
ericjang
·vor 4 Jahren·discuss
> Based on that, this is essentially what you could call a "DudeRank Classifier" because as The Dude in the Big Lebowski says, "Yeah, well, that's just like, your opinion, man" :)

Yes, but isn't human VC investing already just a big DudeRank classifier?
ericjang
·vor 4 Jahren·discuss
I got started with Andrew Ng's Coursera ML course in 2012, and have been learning ML ever since. I think a very diligent student could catch up in half the time (about 5 years).

Check out this page with introductory resources: https://www.reddit.com/r/learnmachinelearning/comments/bpjh2...
ericjang
·vor 4 Jahren·discuss
Supposing the hacker gets away with stealing such large quantities of stolen ETH without getting caught and their ETH is now sitting in a brand new wallet that everyone knows about. Is the next move to convert it into a privacy-preserving coin like Monero, then back to "clean" ETH?

source: https://ethereum.stackexchange.com/questions/2699/is-there-a...
ericjang
·vor 4 Jahren·discuss
Thread with additional context about Marina Ovsyannikova https://twitter.com/maxseddon/status/1503453848786059270?s=2...

Her bravery is incredible.