HackerTrans
TopNewTrendsCommentsPastAskShowJobs

mikepapadim

79 karmajoined 6 anni fa

Submissions

[untitled]

1 points·by mikepapadim·6 ore fa·0 comments

What If Java Apps Could Access CUDA Ecosystem Gracefully

tornadovm.org
3 points·by mikepapadim·13 ore fa·0 comments

Why accessing cuBLAS, cuFFT, cuDNN from within your Java application

tornadovm.org
4 points·by mikepapadim·4 giorni fa·0 comments

Show HN: MizAI LLM detection of price anomalies in public procurement for Greece

mizai.gr
1 points·by mikepapadim·26 giorni fa·0 comments

[untitled]

1 points·by mikepapadim·27 giorni fa·0 comments

[untitled]

1 points·by mikepapadim·28 giorni fa·0 comments

Neo4j Acquires GraphAware for an Intelligence Analysis Alternative to Palantir

hpcwire.com
6 points·by mikepapadim·mese scorso·0 comments

Claude Cowork found me a flat to rent in London in just 5 days

old.reddit.com
3 points·by mikepapadim·3 mesi fa·1 comments

[untitled]

1 points·by mikepapadim·3 mesi fa·0 comments

5 Open-Source Projects Running Transformers on CPUs to GPUs in Pure-Modern Java

old.reddit.com
10 points·by mikepapadim·3 mesi fa·2 comments

[untitled]

1 points·by mikepapadim·4 mesi fa·0 comments

[untitled]

1 points·by mikepapadim·4 mesi fa·0 comments

Java Running Directly on Apple Silicon GPUs with TornadoVM Metal Codegen

github.com
3 points·by mikepapadim·4 mesi fa·0 comments

TamboUI: A Modern Terminal UI Framework for Java (GraalVM Native)

github.com
4 points·by mikepapadim·5 mesi fa·0 comments

[untitled]

1 points·by mikepapadim·7 mesi fa·0 comments

A Glance at GPU Goodness in Java: LLM Inference with TornadoVM

javaadvent.com
2 points·by mikepapadim·7 mesi fa·0 comments

Show HN: GPULlama3.java Llama Compilied to PTX/OpenCL Now Integrated in Quarkus

24 points·by mikepapadim·7 mesi fa·6 comments

[untitled]

1 points·by mikepapadim·7 mesi fa·0 comments

[untitled]

1 points·by mikepapadim·9 mesi fa·0 comments

Detaching GraalVM from the Java Ecosystem Train

blogs.oracle.com
5 points·by mikepapadim·10 mesi fa·4 comments

comments

mikepapadim
·3 mesi fa·discuss
Twice a day, Claude Cowork searched SpareRoom, OpenRent, Rightmove and Zoopla, filtered out student flats and 3+ bed houses, wrote personalised outreach messages forevery good listing, and emailed me a digest I could act on from my phone.

As a result, I managed to put down a deposit for a decent 1 bed flat in London in just under a week for the price people asking for a room!

Totally skipped all the manual searching of new ads etc.

I create a repo so others can take ideas or even reuse it.

Just adapt your preferences

Just with Claude cowork + Claude in Chrome + Gmail MCP
mikepapadim
·3 mesi fa·discuss
- [Llama3.java] https://github.com/mukel/llama3.java - [Gemma4.java] https://github.com/mukel/gemma4.java - [Jlama] https://github.com/tjake/Jlama - [GPULlama3.java https://github.com/beehive-lab/GPULlama3.java - [Qxotic] https://github.com/qxoticai/qxotic - [TornadoVM]https://github.com/beehive-lab/TornadoVM
mikepapadim
·3 mesi fa·discuss
- [Llama3.java](https://github.com/mukel/llama3.java) - [Gemma4.java](https://github.com/mukel/gemma4.java) - [Jlama](https://github.com/tjake/Jlama) - [GPULlama3.java](https://github.com/beehive-lab/GPULlama3.java) - [Qxotic](https://github.com/qxoticai/qxotic) - [TornadoVM](https://github.com/beehive-lab/TornadoVM)
mikepapadim
·4 mesi fa·discuss
I'm exploring an idea to reduce GPU dispatch overhead in a Java-based runtime, TornadoVM, which executes compute operations from TornadoVM bytecodes.
mikepapadim
·7 mesi fa·discuss
https://github.com/beehive-lab/TornadoVM/pull/732 https://github.com/beehive-lab/TornadoVM/pull/313
mikepapadim
·7 mesi fa·discuss
Yes, when you use the PTX backend it supports Tensor Cores.It has also implementation for flash attention. You can also write your own kernels, have a look here: https://github.com/beehive-lab/GPULlama3.java/blob/main/src/... https://github.com/beehive-lab/GPULlama3.java/blob/main/src/...
mikepapadim
·7 mesi fa·discuss
https://github.com/beehive-lab/GPULlama3.java
mikepapadim
·7 mesi fa·discuss
Highlights Simpler execution via Java argfiles Improved performance on FP16/Int8 LLM Inference on hashtag#Nvidia GPUs Extended reduced precision type support for GPUs (Int8, fp16) Zero-copy object support through project Panama Support for compressed oops on modern JVMs New cross-platform SDK distribution (soon hashtag#SDKMAN! https://lnkd.in/d8pGHYy5) Official TornadoVM dependencies now published on Maven Central. (https://lnkd.in/dDRZj8ru)
mikepapadim
·9 mesi fa·discuss
https://github.com/beehive-lab/TornadoVM
mikepapadim
·anno scorso·discuss


  Location: UK
  Remote: Yes
  Willing to relocate: No
  Technologies: Java, C++, Python, Cuda, OpenCL, Docker, ONNXRT,Git, Apache TVM, Compilers, GPUs
  Résumé/CV:https://github.com/mikepapadim && https://www.linkedin.com/in/michalis-papadimitriou/
  Email:mpapadimitriou92 [ΑΤ] gmail.com
mikepapadim
·anno scorso·discuss
https://github.com/beehive-lab/GPULlama3.java

We took Llama3.java and we ported TornadoVM to enable GPU code generation. Apparrently, the first beta version runs on Nnvidia GPUs, while getting a bit more than 100 toks/sec for 3B model on FP16.

All the inference code offloaded to the GPU is in pure-Java just by using the TornadoVM apis to express the computation.

Runs Llama3 and Mistral models in GGUF format.

It is fully open-sourced, so give it a try. It currently run on Nvidia GPUs (OpenCL & PTX), Apple Silicon GPUs (OpenCL), and Intel GPUs and Integrated Graphics (OpenCL).
mikepapadim
·anno scorso·discuss
Java to OpenCL and PTX inference of Llama3 through TornadoVM