Linking scientific instruments and computation: Patterns, technologies, and experiences
New article in @Patterns_CP covers:
A) patterns for linking big data instruments & computers;
B) capturing such “flows” in reusable forms;
C) Globus automation services to run flows;
D) examples from synchrotron light sources;
E) implications for scientists & facilities, 1/8
🧵 Thread
New @TheHDSR paper on methods & experiences for realizing "continuous and ubiquitous FAIRness" by using simple tools to track all data all the time: Lightweight IDs to name things; BDBag/BagIt/Research Object to create aggregations; flow automation hdsr.mitpress.mit.edu/pub/qjpg8oik/release/2
🧵 Thread
The @NSF CC-* program connects institutions to the world at high speeds via the @globus-based @ESnet #ScienceDMZ architecture. To ease adoption, the @UChicago Globus team offers free subscriptions to new CC* awardees. Contact @globus for details
globus.org/blog/globus-support-2022-nsf-cc-program 1/3
🧵 Thread
1/4 On February 12, 2022 we started replicating 7.5 PB #CMIP climate data from @Livermore_Lab to @argonne_lcf and @OLCFGOV. We used @globus to automate this transfer of 28,907,532 files: mostly LLNL->ALCF->OLCF, but also LLNL->OLCF->ALCF during ALCF maintenance. @doescience @NSF
The History of the Grid on Arxiv
I posted "The History of the Grid" on Arxiv. This 2011 article reviews the work that, from the 1990s onwards, pioneered on-demand and federated computing and data over then-new high-speed networks. arxiv.org/abs/2204.04312
🧵 Thread
Inaugural AI+Science Summer School this August in Chicago,
co-hosted by @DSI_UChicago and @IMSI_Institute. Apply by 4/25. A week of summer in Chicago, great lecturers, smart colleagues--what's not to like? datascience.uchicago.edu/events/2022-ai-science-summer-school/
🧵 Thread
Congratulations to Jack Dongarra for well-deserved Turing Award. His use of mathematics, in particular linear algebra, as a language for programming increasingly complex computer architectures has lasted 30+ years and enabled scaling by billions. fortune.com/2022/03/30/turing-award-dongarra-supercomputer-expert-winner-1-million-nobel-prize-of-computing/
A National Discovery Cloud
"A National Discovery Cloud" is a white paper that @dplopresti, Bill Gropp, Mark D. Hill, Katie Schuman, and I wrote for CCC. I presented these slides at a CRA "Cloud for Computing Research" workshop cra.org/industry/events/cloudworkshop/ this week slideshare.net/ianfoster/foster-cra-march-2022pptx
Connecting scientists worldwide
What a difference a decade makes for connecting scientists worldwide: The @globus counter in 2012 (7 PB total transferred, 100s MB/s aggregate) ...