maknee

4개월 전discuss

Thanks! Looks like I have to request the whitepaper to take a look at the details.

4개월 전discuss

How effective are LLMs at triaging issues? Has anyone found success using them to find the root cause? I've only been able to triage effectively for toy examples.

maknee

6개월 전discuss

https://maknee.github.io/

maknee

6개월 전discuss

Great paper! Love the easy to understand explanations and detailed graphs :)

maknee

6개월 전discuss

Read through the comments. Added RSS and subscribe to my blog!

[1] https://maknee.github.io/blog/

maknee

7개월 전discuss

It seems like the load_score serves a proxy for how much needs to be done. Is there a real value that could be used instead? The solution requires syncing with all of the GPU nodes anyways.

maknee

7개월 전discuss

  Location: New York City, NY, USA (NYC)
  Remote: Yes
  Willing to relocate: No
  Résumé: https://www.linkedin.com/in/henry-zhu-347233121/
  Email: find email on my blog OR reach out on linkedin
  LinkedIn: https://www.linkedin.com/in/henry-zhu-347233121/
  Github: https://github.com/maknee

Things I've done (I've put all these projects on my blog: https://maknee.github.io/blog/):

- Analyzed DeepSeek's distributed filesystem from the ground up in a multipart series

- Built a 100k+ (1TB+) RL dataset for a popular online MOBA game by reverse engineering data format (~50k -> ~100k downloads monthly on huggingface)

- Optimizing finetuning/RL on multi-node GPUs

- Built a framework that intercepts OpenGL pipelines and re‑renders them with NVIDIA ray tracing

I'm looking to work on optimizations and performance analysis of systems. This includes: building profiling tools, building and running large scale distributed systems (training, inference, vectordb, db, compilers, etc...), discussing napkin-math & identifying bottlenecks and writing about the work.

maknee

8개월 전discuss

interesting results. why does reload/cross-tile have worse results? would be nice to see some examples of failed results (how close did it to solving?)

maknee

8개월 전discuss

How does this compare against other DSLs?

maknee

10개월 전discuss

Great to see another distributed file system open sourced! It has some interesting design decisions.

Have a couple of questions:

- How do you go about benchmarking throughput / latency of such a system? Curious if it's different compared to how other distributed filesystems benchmark their systems.

- Is network or storage the bottleneck for nodes (at least for throughput)?

  - From my observations from RDMA-based distributed filesystems, network seems to be the case.

- How does the system respond to rand / seq + reads / writes? A lot of systems struggle to scale writes. Does this matter for what workload TernFS is designed for?

- Very very interesting to go down the path of writing a kernel module instead of using FUSE or writing a native client in userspace (referring to 3FS [1])

  - Any crashes in production? And how do you go about tracking it down?

  - What's the difference in performance between using the kernel module versus using FUSE?

[1] https://github.com/deepseek-ai/3FS/blob/main/docs/design_not...

Submissions

[untitled]

comments