wow, I'm not a bio person and had no idea AlphaFold was so complex compared to vanilla Transformers, etc. I wonder newer combinations of LLMs with RL for general reasoning are looking like, sad we might never know haha, but can dive into this in the interim :)
We would love your feedback and contributions! We would also love to hear your thoughts on the future of AI Agent architectures and approaches like those we are building on top of with TreeVoyager! Also feel free to reach out to Marco/Matt if you have any Qs on using the playground to test your agents!
honestly would recommend using spot/rented instances on that budget vs. buying! A100s run around ~$2/hour, the hard part is getting a large allocation... training workloads are quite spikey anyways, usually running lots of smaller experiments before actually doing a larger single run...
feel free to DM on twitter or linkedin. In a nutshell, if you want to pursue a company now in or in the near future, we would likely need to consider you through our normal investing process for equity funding. If you are considering just working on it OSS, we would encourage taking first steps in that direct,
and testing community-project fit validation before quite going full or near-full time!
Definitely. This was kicked off in the last month or two when there just seemed to be a bit more happening in OSS LLMs, but we are prioritizing diversifying this for the next cohort!
Thank you so much for your work and enthusiasm here!! Unfortunately, that’s roughly the best way to approach it and how most of these have worked so far, demonstrations on smaller models (e.g. 7/13B), with slightly smaller datasets, catching the eye of the community, etc. in general it’s not a bad approach to research too, prove out concepts at smaller scale before scaling up!
Interesting, hadn’t thought of that, thank you! If you want to host end points Replicate is a great option, they also have a newer fine tuning api and solution! for raw VMs with GPUs right now it’s a bit situational and you have to try multiple different vendors tbh, also really depends on the capacity you need and which machines!!