HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jstephan

no profile record

Submissions

Tutorial – How to Run PySpark Inside Docker Containers

datamechanics.co
1 points·by jstephan·5 лет назад·0 comments

Show HN: Delight, the New and Improved Spark UI

datamechanics.co
1 points·by jstephan·5 лет назад·0 comments

comments

jstephan
·4 года назад·discuss
I've also been a happy user of Windmill.dev. I guess ToolJet has more of a low-code focus with their drag and drop builder, while Windmill is more focused on developers who want to turn their scripts into production workflows.

Very excited to see all these open-source projects take off in the internal tooling space. I regret how much time I spent building custom DIY tooling at previous jobs!
jstephan
·5 лет назад·discuss
I agree with you, and I hope Delight will be very useful!

We're showing new metrics (CPU & Memory) that you couldn't get in the Spark UI (you had to use something like Ganglia, and then jump back and forth between Ganglia and the Spark UI by comparing timestamps).

We alos hope to display this new information in a way that will make it more easy for most users to get insights. Make problems more obvious, more quickly.

Let us know your feedback!