I am very excited to announce that a joint proposal w/ @AiEleuther @Mila_Quebec and @laion_ai to train Foundation Models on @ORNL's Summit supercomputer has won a 5.94M V100-hour INCITE grant.
The work we do at @AiEleuther is incredibly compute-intensive, but it is thanks to grants like this that we are able to continue to train and publicly release cutting edge research on large transformer models.
This was made possible by the work of a great many people: @QuentinAnthon15 @EricHallahan @AiEleuther;
@JJitsev Christoph Schuhmann Mehdi Cherti @laion_ai; @irinarish @introspection @MilaQuebec; Guillermo Cecchi @IBMResearch; @rioyokota @tokyotech_en; Sergey Panitkin @StabilityAI
It's often very challenging for academics and non-profit researchers to gain access to the large amount of compute required to do this kind of work, but with first the @BigscienceW and now this things are boding well for the future of open science large scale AI research.
Stella Rose Biderman
@BlancheMinerva
Mathematician, AI researcher, Magic the Gathering player. NLP researcher at @BoozAllen and @AiEleuther. My employer disowns my tweets. She/her