HackerTrans
TopNewTrendsCommentsPastAskShowJobs

msond

48 karmajoined 2 года назад
I'm the CEO of Spectral Compute, building https://scale-lang.com/.

Ping me at [email protected]

Submissions

Why GPU compilers are MORE important in the agentic era

scale-lang.com
9 points·by msond·2 месяца назад·0 comments

CUDA version of GROMACS is faster on AMD than HIP port

scale-lang.com
15 points·by msond·в прошлом году·3 comments

Scale 1.3: Run CUDA Natively on MI-Instinct GPUs

docs.scale-lang.com
7 points·by msond·в прошлом году·1 comments

comments

msond
·15 часов назад·discuss
We haven’t yet released support for tcgen05, but we’ll deal with it the same way we deal with other inline PTX: parsing it and converting it to target-appropriate instructions together with the rest of the program.

This is something we’ve done already for the hopper-class tensorcore instructions, and the blackwell ones will map similarly, though likely with a kernel launch involved.
msond
·16 часов назад·discuss
We actually support NVIDIA hardware, too.

In some benchmarks, SCALE beats nvcc, and we have compiler optimizations in the pipeline that will improve those numbers over time.

> If all you want is to be able to easily use non-NVidia hardware then high level tools like PyTorch already let you do that

Somewhat true, but, CUDA is significantly larger than PyTorch and there's more to Accelerated Computing than just those types of applications supported there.

> OTOH if you want to be programming close to the metal to achieve top performance then you are probably not using CUDA in the first place, and using some CUDA translation layer on non-NVidia hardware would be an even worse idea.

SOTA mlperf submissions use CUDA to achieve their high levels of performance.

It's not a "translation layer", it's a native, ahead-of-time compiler that makes full use of the native hardware features. Here's an example of a feature (Shuffles) being compiled to take advantage of native hardware instructions, resulting in speedups: https://scale-lang.com/posts/2026-01-19-optimizing-cuda-shuf...
msond
·21 час назад·discuss
We have a comparison page: https://docs.scale-lang.com/stable/manual/comparison/#zluda
msond
·21 час назад·discuss
A guess would be some time next year — since our public launch our focus has generally been on API coverage and increasingly recently, on performance.

While performance improvements will always remain a target, we're soon at full coverage of the core CUDA APIs and will be shifting an increasing amount of effort towards developer tooling.
msond
·21 час назад·discuss
Actually we launched in 2024 and the last message in our discord is definitely not that: https://discord.gg/KNpgGbTc38
msond
·23 часа назад·discuss
We're actually targeting all of it, and not just CUDA C++.
msond
·в прошлом году·discuss
Hey there!

Would love to connect and hear more about what you like about SCALE and where you'd like it to go.

AMD is a part of our strategy, but it's not the end-game - we envision SCALE to be vendor neutral and have plans to support all of the competitive GPUs that come out in the future, including AMD, NVIDIA, Intel and any newcomers.
msond
·в прошлом году·discuss
With the latest release of SCALE, wave64 AMD Instinct GPUs are supported
msond
·2 года назад·discuss
Very interesting, thank you for sharing!

We do believe in open source software and we do want to move the GPGPU market away from fully closed languages. The future is open for discussion but regardless, the status-quo at the moment is a proprietary and dominant implementation which only supports a single vendor.

> I don't see a way for a new language to catch on nowadays that is not open source.

I do note that CUDA is itself closed source -- while there's an open source implementation in the LLVM project, it is not as bleeding edge as NVIDIA's own.
msond
·2 года назад·discuss
We're still thinking about our approach but this is a nice suggestion, thank you.

I'm curious, for what reasons are you interested in the source code yourself?
msond
·2 года назад·discuss
SCALE is not a "translation layer", it's a full source-to-target compiler from CUDA-like C++ code to AMD GPUs.

See this part of the documentation for more details regarding warp sizes: https://docs.scale-lang.com/manual/language-extensions/#impr...
msond
·2 года назад·discuss
We have not reverse engineered any compiled code in the process of developing SCALE.

It was clean-room implemented purely from the API surface and by trial-and-error with open CUDA code.
msond
·2 года назад·discuss
We're going to be publishing more details on later blog posts and documentation about how this works and how we've built it.

Yes, we're not open source, however our license is very permissive. It's both in the software distribution and viewable online at https://docs.scale-lang.com/licensing/
msond
·2 года назад·discuss
Actually, we use mkdocs and the excellent material for mkdocs theme: https://squidfunk.github.io/mkdocs-material/
msond
·2 года назад·discuss
We're putting together benchmarks to publish at a later time, and we've asked some independent third parties to work on their own additionally.
msond
·2 года назад·discuss
You can learn more about us on https://spectralcompute.co.uk