HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jerrinot

no profile record

Submissions

Hardware Memory Models

research.swtch.com
2 points·by jerrinot·2 mesi fa·0 comments

Measuring Reorder Buffer Capacity

blog.stuffedcow.net
4 points·by jerrinot·9 mesi fa·0 comments

comments

jerrinot
·6 mesi fa·discuss
clock_gettime() goes through the vDSO shim, but whether it avoids a syscall depends on the clock ID and (in some cases) the clock source. For thread-specific CPU user time, the vDSO shim cannot resolve the request in user space and must transit into the kernel. In this specific case, there is absolutely a syscall.
jerrinot
·6 mesi fa·discuss
You raise a fair point about the percentiles. Those are reported as point estimates without confidence intervals and the implied precision overstates what system clock can deliver.

The mean does get proper statistical treatment (t-distribution confidence interval), but you're right that JMH doesn't compute confidence intervals for percentiles. Reporting p0.00 with three significant figures is ... optimistic.

That said I think the core finding survives this critique. The improvement shows up consistently across ~11 million samples at every percentile from p0.50 through p0.999.
jerrinot
·6 mesi fa·discuss
Hi Jonas, thanks for the work on OpenJDK and the post! I swear I hadn't seen your blog :) I finished my draft around Christmas and it’s been in the queue since. Great minds think alike, I guess.

edit: I just read your blog in full and I have to say I like it more than mine. You put a lot more rigor into it. I’m just peeking into things.

edit2: I linked your article from my post.
jerrinot
·6 mesi fa·discuss
In a system with green threads, you typically want the CPU time of the fiber or tasklet rather than the carrier thread. In that case, you have to ask the scheduler, not the kernel.
jerrinot
·6 mesi fa·discuss
Courtesy of Brendan Gregg and his flamegraph.pl scripts: https://github.com/brendangregg/FlameGraph

Normally, I use the generator included in async-profiler. It produces interactive HTML. But for this post, I used Brendan’s tool specifically to have a single, interactive SVG.
jerrinot
·6 mesi fa·discuss
no problem at all, I was confused too when I saw the profile for the first time.
jerrinot
·6 mesi fa·discuss
That's a brilliant trick. The setup overhead and permission requirements for perf_event might be heavy for arbitrary threads, but for long-lived threads it looks pretty awesome! Thanks for sharing!
jerrinot
·6 mesi fa·discuss
Exactly this.
jerrinot
·6 mesi fa·discuss
Only for some clocks (CLOCK_MONOTONIC, etc) and some clock sources. For VIRT/SCHED, the vDSO shim still has to invoke the actual syscall. You can't avoid the kernel transition when you need per-thread accounting.
jerrinot
·6 mesi fa·discuss
I was unsure whether to post it or not so I am glad you found it useful!
jerrinot
·6 mesi fa·discuss
Fair point. These were run on a standard dev workstation under load, which may account for the noise. I haven't done a deep dive into the outliers yet, but the distribution definitely warrants a more isolated look.
jerrinot
·6 mesi fa·discuss
Author here. After my last post about kernel bugs, I spent some time looking at how the JVM reports its own thread activity. It turns out that "What is the CPU time of this thread?" is/was a much more expensive question than it should be.
jerrinot
·7 mesi fa·discuss
I have no practical experience with bpftrace, so it did not occur to me. I'll give it a try and perhaps there's gonna be a 2nd part of this investigation.
jerrinot
·7 mesi fa·discuss
It's much tougher when it's so hard to reproduce. Perhaps the NMI watchdog could help? https://docs.kernel.org/admin-guide/lockup-watchdogs.html
jerrinot
·7 mesi fa·discuss
Wow, someone is actually reading the article in detail, that's a good feeling! In C, the != operator has higher precedence than the || operator. That said, extra parentheses never hurt readability.
jerrinot
·7 mesi fa·discuss
Thanks for the kind words!

Heatmaps are amazing for pattern spotting. I also use them when hunting irregular hiccups or outliers. More people should know about this feature.
jerrinot
·7 mesi fa·discuss
Author here. I've always been kernel-curious despite never having worked on one myself. Consider this either a collection of impractical party tricks or a hands-on way to get a feel for kernel internals.
jerrinot
·7 mesi fa·discuss
Snowflake did not acquire RP after all.
jerrinot
·10 mesi fa·discuss
I expect candidates to suggest similar optimisations, but I felt it was unnecessary for the article itself.
jerrinot
·10 mesi fa·discuss
That’s a neat trick, albeit with limited applicability given the very narrow range. Thanks for sharing!