oedemis·الشهر الماضي·discusswhy no one talks about claude shannon deep understanding of information theory and the consequences for compression and intelligence
oedemis·قبل 6 أشهر·discussas architectures evolve, i think it can be that we learn more "side effects".. back in 2020 openai researchers said "GPT-3 is applied without any gradient updates or fine-tuning" the model emerges at a certain level of scale...
oedemis·قبل 7 أشهر·discussthere is also very good explanation from Luis Serrano, https://youtu.be/fkO9T027an0
oedemis·قبل 7 أشهر·discussStreaming, EDA can solve lot of data challenges for enterprise AI use cases
oedemis·قبل 7 أشهر·discusshttps://huggingface.co/ibm here is very interesting research going https://huggingface.co/ibm-granite
oedemis·قبل 7 أشهر·discussibm developed SSMs/mamba models and also releasing trainings datasets i think, also quantum computing is strategic option..