mikepapadim

vor 3 Monatendiscuss

Twice a day, Claude Cowork searched SpareRoom, OpenRent, Rightmove and Zoopla, filtered out student flats and 3+ bed houses, wrote personalised outreach messages forevery good listing, and emailed me a digest I could act on from my phone.

As a result, I managed to put down a deposit for a decent 1 bed flat in London in just under a week for the price people asking for a room!

Totally skipped all the manual searching of new ads etc.

I create a repo so others can take ideas or even reuse it.

Just adapt your preferences

Just with Claude cowork + Claude in Chrome + Gmail MCP

mikepapadim

vor 3 Monatendiscuss

- [Llama3.java] https://github.com/mukel/llama3.java - [Gemma4.java] https://github.com/mukel/gemma4.java - [Jlama] https://github.com/tjake/Jlama - [GPULlama3.java https://github.com/beehive-lab/GPULlama3.java - [Qxotic] https://github.com/qxoticai/qxotic - [TornadoVM]https://github.com/beehive-lab/TornadoVM

mikepapadim

vor 3 Monatendiscuss

- [Llama3.java](https://github.com/mukel/llama3.java) - [Gemma4.java](https://github.com/mukel/gemma4.java) - [Jlama](https://github.com/tjake/Jlama) - [GPULlama3.java](https://github.com/beehive-lab/GPULlama3.java) - [Qxotic](https://github.com/qxoticai/qxotic) - [TornadoVM](https://github.com/beehive-lab/TornadoVM)

mikepapadim

vor 4 Monatendiscuss

I'm exploring an idea to reduce GPU dispatch overhead in a Java-based runtime, TornadoVM, which executes compute operations from TornadoVM bytecodes.

mikepapadim

vor 7 Monatendiscuss

https://github.com/beehive-lab/TornadoVM/pull/732 https://github.com/beehive-lab/TornadoVM/pull/313

mikepapadim

vor 7 Monatendiscuss

Yes, when you use the PTX backend it supports Tensor Cores.It has also implementation for flash attention. You can also write your own kernels, have a look here: https://github.com/beehive-lab/GPULlama3.java/blob/main/src/... https://github.com/beehive-lab/GPULlama3.java/blob/main/src/...

mikepapadim

vor 7 Monatendiscuss

https://github.com/beehive-lab/GPULlama3.java

mikepapadim

vor 7 Monatendiscuss

Highlights Simpler execution via Java argfiles Improved performance on FP16/Int8 LLM Inference on hashtag#Nvidia GPUs Extended reduced precision type support for GPUs (Int8, fp16) Zero-copy object support through project Panama Support for compressed oops on modern JVMs New cross-platform SDK distribution (soon hashtag#SDKMAN! https://lnkd.in/d8pGHYy5) Official TornadoVM dependencies now published on Maven Central. (https://lnkd.in/dDRZj8ru)

mikepapadim

vor 9 Monatendiscuss

https://github.com/beehive-lab/TornadoVM

mikepapadim

letztes Jahrdiscuss

  Location: UK
  Remote: Yes
  Willing to relocate: No
  Technologies: Java, C++, Python, Cuda, OpenCL, Docker, ONNXRT,Git, Apache TVM, Compilers, GPUs
  Résumé/CV:https://github.com/mikepapadim && https://www.linkedin.com/in/michalis-papadimitriou/
  Email:mpapadimitriou92 [ΑΤ] gmail.com

mikepapadim

letztes Jahrdiscuss

https://github.com/beehive-lab/GPULlama3.java

We took Llama3.java and we ported TornadoVM to enable GPU code generation. Apparrently, the first beta version runs on Nnvidia GPUs, while getting a bit more than 100 toks/sec for 3B model on FP16.

All the inference code offloaded to the GPU is in pure-Java just by using the TornadoVM apis to express the computation.

Runs Llama3 and Mistral models in GGUF format.

It is fully open-sourced, so give it a try. It currently run on Nvidia GPUs (OpenCL & PTX), Apple Silicon GPUs (OpenCL), and Intel GPUs and Integrated Graphics (OpenCL).

mikepapadim

letztes Jahrdiscuss

Java to OpenCL and PTX inference of Llama3 through TornadoVM

mikepapadim

Submissions

[untitled]

What If Java Apps Could Access CUDA Ecosystem Gracefully

Why accessing cuBLAS, cuFFT, cuDNN from within your Java application

Show HN: MizAI LLM detection of price anomalies in public procurement for Greece

[untitled]

[untitled]

Neo4j Acquires GraphAware for an Intelligence Analysis Alternative to Palantir

Claude Cowork found me a flat to rent in London in just 5 days

[untitled]

5 Open-Source Projects Running Transformers on CPUs to GPUs in Pure-Modern Java

[untitled]

[untitled]

Java Running Directly on Apple Silicon GPUs with TornadoVM Metal Codegen

TamboUI: A Modern Terminal UI Framework for Java (GraalVM Native)

[untitled]

A Glance at GPU Goodness in Java: LLM Inference with TornadoVM

Show HN: GPULlama3.java Llama Compilied to PTX/OpenCL Now Integrated in Quarkus

[untitled]

[untitled]

Detaching GraalVM from the Java Ecosystem Train

comments