maknee

قبل 4 أشهرdiscuss

Thanks! Looks like I have to request the whitepaper to take a look at the details.

قبل 4 أشهرdiscuss

How effective are LLMs at triaging issues? Has anyone found success using them to find the root cause? I've only been able to triage effectively for toy examples.

maknee

قبل 6 أشهرdiscuss

https://maknee.github.io/

maknee

قبل 6 أشهرdiscuss

Great paper! Love the easy to understand explanations and detailed graphs :)

maknee

قبل 6 أشهرdiscuss

Read through the comments. Added RSS and subscribe to my blog!

[1] https://maknee.github.io/blog/

maknee

قبل 7 أشهرdiscuss

It seems like the load_score serves a proxy for how much needs to be done. Is there a real value that could be used instead? The solution requires syncing with all of the GPU nodes anyways.

maknee

قبل 7 أشهرdiscuss

  Location: New York City, NY, USA (NYC)
  Remote: Yes
  Willing to relocate: No
  Résumé: https://www.linkedin.com/in/henry-zhu-347233121/
  Email: find email on my blog OR reach out on linkedin
  LinkedIn: https://www.linkedin.com/in/henry-zhu-347233121/
  Github: https://github.com/maknee

Things I've done (I've put all these projects on my blog: https://maknee.github.io/blog/):

- Analyzed DeepSeek's distributed filesystem from the ground up in a multipart series

- Built a 100k+ (1TB+) RL dataset for a popular online MOBA game by reverse engineering data format (~50k -> ~100k downloads monthly on huggingface)

- Optimizing finetuning/RL on multi-node GPUs

- Built a framework that intercepts OpenGL pipelines and re‑renders them with NVIDIA ray tracing

I'm looking to work on optimizations and performance analysis of systems. This includes: building profiling tools, building and running large scale distributed systems (training, inference, vectordb, db, compilers, etc...), discussing napkin-math & identifying bottlenecks and writing about the work.

maknee

قبل 8 أشهرdiscuss

interesting results. why does reload/cross-tile have worse results? would be nice to see some examples of failed results (how close did it to solving?)

maknee

قبل 8 أشهرdiscuss

How does this compare against other DSLs?

maknee

قبل 10 أشهرdiscuss

Great to see another distributed file system open sourced! It has some interesting design decisions.

Have a couple of questions:

- How do you go about benchmarking throughput / latency of such a system? Curious if it's different compared to how other distributed filesystems benchmark their systems.

- Is network or storage the bottleneck for nodes (at least for throughput)?

  - From my observations from RDMA-based distributed filesystems, network seems to be the case.

- How does the system respond to rand / seq + reads / writes? A lot of systems struggle to scale writes. Does this matter for what workload TernFS is designed for?

- Very very interesting to go down the path of writing a kernel module instead of using FUSE or writing a native client in userspace (referring to 3FS [1])

  - Any crashes in production? And how do you go about tracking it down?

  - What's the difference in performance between using the kernel module versus using FUSE?

[1] https://github.com/deepseek-ai/3FS/blob/main/docs/design_not...

Submissions

[untitled]

comments