That is very disappointing.
That's it right there. Show the others how it's done. Can see going forward most model training being done in winter, making for a proper resource recycling ecosystem.
This isnt some novel thing in Germany, selling excess heat from some energy intensive commercial proccess is pretty standard. The local district heating operator probably took care of almost all the infrastructure for them.
Must resist... making... papercli
Either way, happy to see two open models from outside the us-cn duopoly in the same week.
- https://huggingface.co/spaces/Soofi-Project/Pretraining-Tech...
Nice trick to be not comparable with most other LLMs on the market, open weight or proprietary.
But I think, that's the right way.
Had to request access on huggingface, which was still not answered after a day.
Given all the Inkling and Kimi announcements, this atm just feels like too little too late to be taken seriously.
That said, it’s their first release and I hope they do catch up fast.