HackerTrans
トップ新着トレンドコメント過去質問紹介求人

alechammond

33 カルマ登録 3 年前

投稿

Who Needs DRAM? We Have Fiber

arxiv.org
12 ポイント·投稿者 alechammond·一昨日·2 コメント

Scholar Labs: An AI Powered Scholar Search

scholar.googleblog.com
2 ポイント·投稿者 alechammond·8 か月前·0 コメント

Magic Leap partners with Google to advance XR

magicleap.com
4 ポイント·投稿者 alechammond·2 年前·0 コメント

Nvidia Blackwell Arch Technical Brief

nvdam.widen.net
5 ポイント·投稿者 alechammond·2 年前·0 コメント

A gymnasium for machine learning assisted computer architecture design

blog.research.google
2 ポイント·投稿者 alechammond·3 年前·0 コメント

Silicon Photonics Key to Unlocking AI’s Full Potential

eetimes.com
2 ポイント·投稿者 alechammond·3 年前·0 コメント

Build data apps in Julia. Fast

geniecloud.io
1 ポイント·投稿者 alechammond·3 年前·0 コメント

The Bill Is Coming Due for China’s ‘Capitalist’ Experiment

nationalreview.com
13 ポイント·投稿者 alechammond·3 年前·0 コメント

Sophia: Stochastic Second-Order Optimizer for Language Model Pre-Training

arxiv.org
7 ポイント·投稿者 alechammond·3 年前·0 コメント

Meta unveils AI inference accelerator

ai.facebook.com
3 ポイント·投稿者 alechammond·3 年前·1 コメント

コメント

alechammond
·2 年前·議論
Thanks for the reply!

> So running 500 sequential kMC simulations would take approximately 125 years - not ideal.

Ah I see. Ya it’s hard to get around this…

> is fundamentally stochastic, and not differentiable

This is actually a common “inverse design pattern” for a variety of applications, and luckily there are tricks to efficiently compute gradients here. In my domain (nanophotonics) we’re often simulating incoherent sources, which are similarly stochastic. But there are ways to reformulate the problem to drastically reduce the number of forward and adjoint solves you need during the design process [1].

That being said, given the cost of the forward problem (3 months per iteration!) this doesn’t help you much…

[1] https://doi.org/10.1007/s00158-022-03389-5
alechammond
·2 年前·議論
Interesting paper, thanks for sharing! Whenever I see physics-based inverse design using ML surrogates, I always ask, “why not optimize the problem directly” (and eg compute the gradient using an adjoint-variable method)? The paper implies that the forward simulation process isn’t differentiable, but is this true? Thanks!
alechammond
·2 年前·議論
> They require significantly different fabrication processes, and we don't know how to fab them into the same chip as electrical ones.

There are actually a few commercial fabs that will monolithically integrate the photonics, analog electronics, and digital electronics, all in the same CMOS process. See for example GF’s process:

https://www.cmc.ca/globalfoundries-fotonix-45spclo/

Integrating good optical sources in silicon remains a challenge, but companies like Intel have mastered hybrid bonding and other packaging techniques. TSMC too has a strong silicon photonics effort.
alechammond
·3 年前·議論
Note that Meta recently added a Julia ruleset to its buck2 prelude set. An important step toward working with Julia on prod environments.

https://github.com/facebook/buck2/tree/main/prelude/julia
alechammond
·3 年前·議論
I wonder why ORNL used AMDGPU.jl directly rather than something like KernelAbstractions.jl, which doesn’t require you to overspecialize to a particular architecture. I realize Frontier is all AMD. But the DOE labs have flipped back and forth between HPC platforms a few times. (Which is partly why Sandia invested so heavily in developing Kokkos).
alechammond
·3 年前·議論
> Greer believes that this is one of the first demonstrations of 3D printing of metal structures at the nanoscale.

I may be missing something, but MIT has been doing something very similar for awhile now. The student (Dan Oran) even spun out a startup.

https://www.media.mit.edu/projects/implosion-fabrication-1/o...