HackerTrans
TopNewTrendsCommentsPastAskShowJobs

wfalcon

no profile record

Submissions

LitServe: Build custom AI inference engines

github.com
1 points·by wfalcon·9 months ago·0 comments

Build your own AI model inference engines

github.com
1 points·by wfalcon·9 months ago·0 comments

[untitled]

1 points·by wfalcon·11 months ago·0 comments

[untitled]

1 points·by wfalcon·11 months ago·0 comments

[untitled]

1 points·by wfalcon·12 months ago·0 comments

[untitled]

1 points·by wfalcon·12 months ago·0 comments

[untitled]

1 points·by wfalcon·12 months ago·0 comments

Agent sandbox: safe, persistent cloud environments for agents

lightning.ai
2 points·by wfalcon·last year·1 comments

[untitled]

1 points·by wfalcon·last year·0 comments

[untitled]

1 points·by wfalcon·last year·0 comments

Lightning AI hub: Production AI in your cloud in minutes

lightning.ai
16 points·by wfalcon·last year·0 comments

Deploy dedicated DeepSeek 32B on L40 GPUs ($8/hour)

lightning.ai
19 points·by wfalcon·last year·6 comments

I'm crazy: I deployed DeepSeek in my company VPC in <24 hours without Kubernetes

lightning.ai
5 points·by wfalcon·last year·2 comments

Deploy a custom Llama 3 API in 15 lines of code

lightning.ai
1 points·by wfalcon·2 years ago·0 comments

Thunder – A new compiler for PyTorch that can use many device executors at once

github.com
11 points·by wfalcon·2 years ago·1 comments

Remote GPU development with VSCode [video]

youtube.com
1 points·by wfalcon·2 years ago·0 comments

comments

wfalcon
·last year·discuss
Studios are a great google colab alternative with:

- persistent storage (setup env and data persists across restarts)

- free ssh and connect your local IDE

- CPU setup, GPU run (do setup work on CPUs and switch to run on a GPU when ready)

- no credit card

- pay-as-you-go if you need more GPU hours

- A100s, H100s, and more GPUs available
wfalcon
·2 years ago·discuss
this is also what our (Lightning AI) lit-gpt library does. https://github.com/Lightning-AI/lit-gpt