Training and Consulting Resources
Research Computing will connect researchers to the training and consulting they need to succeed. Contact us to get connected and learn how we can help. If we don't have the answers, we can connect you to those that do. Below you will find a collection of training and consulting resources we can connect you to.
UCR High-Performance Computing Center
The High-Performance Computing Center can support and consult with various HPC and Research Software related hardware and software issues.
They hold regular training classes on topics such as:
- The cluster scheduler, Slurm
- Basic Linux commands
- Linux File systems
- Cluster policies and best practices
- Basic job submissions to the cluster
- UCR Library
Some online training resources for AWS.
Internet2 NET+ Introduction to AWS for Researchers Virtual Event
- Access the session recording
- Access the AWS and NET+ slides
- AWS regularly hosts events for the researcher community. If you’d like to be invited, please click here
Deploying a Burstable and Event-driven HPC Cluster on AWS Using SLURM
AWS Education Research Seminar Series
Each month, Amazon Web Services (AWS) brings together a community of leading researchers for informational sessions focused on how research spurs scientific and technological evolutions. You’re invited to our next webinar session. Read below to learn more:
The National Institutes of Health (NIH) Science and Technology Research Infrastructure for Discovery, Experimentation, and Sustainability (STRIDES) Initiative aims to modernize the biomedical research ecosystem by fostering innovation in biomedical research using technological advancements in the cloud. NIH-funded biomedical researchers are eligible to leverage the NIH STRIDES Initiative to access cutting-edge cloud services and tools, which includes access to valuable datasets and favorable pricing on cloud environments. Join this session where we will have three separate presentations from representatives from the NIH, Amazon Web Services (AWS), and Four Points Technology, LLC.
We hope you can join the discussion on Wednesday, August 26. If you have to miss, don’t worry. We will share a recording with all registrants. Feel free to invite your colleagues.
Serverless Applications in Python
Tuesday, February 16, 2021 | 9:00 AM - 10:00 AM PT
January 2021 AWS Announcements
AWS - University of California Egress Waiver
Learn how to establish an Amazon Web Services (AWS) account under the UC Agreement.
A UC-wide agreement for Amazon Web Services (AWS) has been established. The agreement provides a Data Egress fee waiver for up to 15% of total monthly AWS fees.
Please follow the instructions below to ensure that an AWS account for UCR business is covered under this agreement and in compliance with UC policy and the law.
Understand Appropriate Use
Review the following to understand the applicable terms and conditions, and allowable data use for AWS:
- University of California AWS Enterprise Customer Agreement
- Applies to all AWS accounts UC-wide, except those used for:
- Commercial Web Hosting
- Media Streaming
- Massive Open Online Courses (MOOCs)
- 80%+ of data egress must be via an approved National Research and Education Network (NREN). This includes CENIC and Internet2, so normal UC usage meets this requirement.
- Applies to all AWS accounts UC-wide, except those used for:
- Determine whether the data you are working with should be hosted in the cloud.
- HIPAA Business Associate Agreement (BAA)
- In order to cover your locations AWS accounts under the terms of the UC AWS Enterprise Agreement (EA) and HIPAA Business Associate Agreement (BAA), follow the instructions found on the UCOP Website (PDF).
Connect AWS Account to UC Agreement and PO
Send an email to UCs AWS account representative, Devinder Narula firstname.lastname@example.org to:
- Activate your new AWS account (if pertinent)
- Include your AWS account under the terms of the UC-wide AWS agreement
- Connect your AWS account to your Purchase Order number
To accomplish this, the email needs to include the following information:
- AWS 12-Digit Account Number
- Company Name = University of California, Riverside (UCR)
- Your Name
AWS Account Activation
You will receive an email response from AWS confirming that your AWS account is now set up for invoicing under the UC AWS agreement and providing final instructions to activate your account. Follow the instructions in the AWS activation email and your account will be active and ready for use.
- University of California AWS Enterprise Customer Agreement
XSEDE Extended Collaborative Support Services
The mission of the Extended Collaborative Support Services (ECSS) program is to improve the productivity of the XSEDE user community through successful, meaningful collaborations which optimize applications, improve work and data flows, increase effective use of the XSEDE digital infrastructure and broadly expand the XSEDE user base by engaging members of underrepresented communities and domain areas.
Through ECSS, users have access to a variety of cyberinfrastructure expertise. ECSS experts, many with advanced degrees in domain areas, are available for collaborations, lasting months to one year, to help researchers fundamentally advance their use of XSEDE resources.
Expertise is available over a wide range of areas:
- performance analysis
- petascale optimization
- efficient use of accelerators
- I/O optimization
- data analytics
- use of XSEDE by science gateways
Please join us for our next ECSS Symposium.
Tuesday, October 20, 10:00 AM Pacific / 1:00 PM Eastern
Join from PC, Mac, Linux, iOS or Android: https://zoom.us/j/114343187
Or iPhone one-tap : US: +16468769923,,114343187## or +16699006833,,114343187##
Or Telephone: Dial(for higher quality, dial a number based on your current location): US: +1 646 876 9923 or +1 669 900 6833 or +1 408 638 0968
Meeting ID: 114 343 187
International numbers available: https://zoom.us/zoomconference?m=Kzg5xp93d84wOReXpCZzGCWHpKACTSLh
More information about the Symposium series and links to previous presentation can be found here
Speaker: Shawn Brown, Director of PSC and Bridges-2 PI
Title: Introducing Bridges-2
Abstract: Bridges-2, PSC's newest supercomputer, will provide transformative capability for rapidly evolving, computation-intensive and data-intensive research, creating opportunities for collaboration and convergent research. It will support both traditional and non-traditional research communities and applications. Bridges-2 will integrate new technologies for converged, scalable HPC, machine learning and data; prioritize researcher productivity and ease of use; and provide an extensible architecture for interoperation with complementary data-intensive projects, campus resources, and clouds.
Speaker: Sergiu Sanielevici, Neocortex co-PI and Associate Director of PSC User Support
Title: Introducing Neocortex
Abstract: Neocortex will be a highly innovative resource at PSC that will accelerate AI-powered scientific discovery by vastly shortening the time required for deep learning training, foster greater integration of artificial deep learning with scientific workflows, and provide revolutionary new hardware for the development of more efficient algorithms for artificial intelligence and graph analytics.
ACM Digital Library
Practice and Experience in Advanced Research Computing (PEARC) Proceedings
- Cyberinfrastructure of a Multi-Petabyte Microscopy Resource for Neuroscience Research
- Grendel: Bare Metal Provisioning System for High Performance Computing
- Cloud and on-premises data center usage, expenditures, and approaches to return on investment: A survey of academic research computing organizations
- Implementing a Loosely-Coupled Integrated Assessment Model in the Pegasus Workflow Management System
- Cluster Usage Policy Enforcement Using Slurm Plugins and an HTTP API
- The Hawai‘i Rainfall Analysis and Mapping Application (HI-RAMA): Decision Support and Data Visualization for Statewide Rainfall Data
- Extracting and Analyzing Deep Learning Features for Discriminating Historical Art: Deep Learning Features and Art
- Research Workflows - Towards reproducible science via detailed provenance tracking in Open Science Chain
- Simulating Large-scale Models of Brain Neuronal Circuits using Google Cloud Platform
CLASS: Cloud Learning and Skills Sessions
Empowering the R&E Workforce to Leverage the Transformational Capabilities of Cloud Computing
Internet2 has explored the many challenges of fully leveraging cloud computing platforms with U.S. research and education (R&E) community stakeholders including CIOs, campus research computing center leaders, researchers, and funding agencies. These discussions have consistently highlighted the lack of suitable and sustainable training for our large, diverse, and distributed workforces as a significant factor hindering the effective use of cloud platforms.
nanoHUB - free platform for computational research
nanoHUB.org is the premier open and free platform for computational research, education, and collaboration in nanotechnology, materials science, and related fields. Our site hosts a rapidly growing collection of simulation tools that run in the cloud and are accessible through a web browser. In addition, nanoHUB provides online presentations, nanoHUB-U short courses, animations, teaching materials, and more. These resources instruct users about our simulation tools as well as general nanoelectronics, materials science, photonics, data science, and other topics. A good starting page for those new to nanoHUB is the Education page.
Our site offers researchers a venue to explore, collaborate, and publish content as well. Many of these collaborative efforts occur via workspaces, user groups, and projects. Uncertainty Quantification (UQ) is now automatically available for most nanoHUB tools and adds powerful analytical and predictive capabilities for researchers.
- ICE Cube Computing Grid (Video)
- Presentation covering how the IceCube computing efforts have evolved over the last 15 years from mostly home-grown solutions to a globally distributed computing infrastructure. It highlights the advantages and disadvantages of such an approach for an experiment with broad science goals ranging from astrophysics to particle physics to geophysics, and what we see in our future as we engage in more external collaborations in computing.
- Distributed Computing CS Lecture Series (Video)
- Classroom lecture videos for CS 436, University of Waterloo
- ICE Cube Computing Grid (Video)
- Edge Computing
- Q & A platform for people who do research computing - researchers, facilitators, research software engineers, cyberinfrastructure engineers, system administrators, and others. Ask.CI provides a centralized, searchable, archived site to aggregate expert knowledge that is widely distributed throughout the research computing community. A joint project of the Northeast Cyberteam and the Campus Champions, it was launched in July, 2018 at PEARC18.
- OAuth Authorization for SSH
- OAuth SSH delivers use of federated identities to the SSH platform providing a uniform security infrastructure for institutions.
- OAuth Authorization for SSH
- HPC Carpentry
- HPC Carpentry is a set of teaching materials designed to help new users take advantage of high-performance computing systems. No prior computational experience is required - these lessons are ideal for either an in-person workshop or independent study.
- HPC University
- The HPC University (HPCU) is a virtual organization whose primary goal is to provide a cohesive, persistent, and sustainable on-line environment to share educational and training materials for a continuum of high performance computing environments that span desktop computing capabilities to the highest-end of computing facilities offered by HPC centers.
- OSU InfiniBand Network Analysis and Monitoring tool - OSU INAM
- Monitors IB clusters in real-time by querying various subnet management entities in the network.
- MVAPICH: MPI over InfiniBand, Omni-Path, Ethernet/iWARP, and RoCE
- MVAPICH is a high performance implementation of MPI-1 over InfiniBand and RDMAoE based on MPICH1. MVAPICH2 is a high performance MPI-2 implementation for InfiniBand, Omni-Path, Ethernet/iWARP, and RoCE based on MPICH2. High performance, scalable and fault-tolerance support are provided in these packages. These packages provide multiple underlying support (such as OpenFabrics/Gen2, OpenFabrics/Gen2-Hybrid, OpenFabrics-RDMAoE, QLogic-InfiniPath, and the standard TCP/IP) for portability across multiple networks
- Spack is a package manager for supercomputers, research clusters, Linux, and macOS. It makes installing scientific software easy. Spack isn’t tied to a particular language; you can build a software stack in Python or R, link to libraries written in C, C++, or Fortran, and easily swap compilers or target specific microarchitectures. Learn more here.
- OSU InfiniBand Network Analysis and Monitoring tool - OSU INAM
Artificial Intelligence / Machine Learning
Summer Webinar Series
R for Biologist
Greetings from NCGAS!
Here in Indiana, the leaves are falling, midterms are wrapping up, so it's time... for another round of our Introduction to R for Biologists course! We will be hosting this course online again this round, through IU's Expand/Canvas platform, starting Oct 27 and running through Nov 12.
This course has filled every time we've offered it, so register early if you are interested! Registration deadline is October 25th at 5pm EST! Register here:
All participants in the course will be directed to a pre-made Virtual Machine with RStudio installed and all necessary packages loaded. You are free to use your own installation of RStudio, however, we will not be troubleshooting individual installations as that is tremendously time-consuming.
The course materials are all available in pdf textbook format with links to video lectures on YouTube. These parts will be self-guided. The labs are also available as textbook chapters. All answers to problems in the labs can be filled in on Canvas quizzes to get immediate feedback. The answers are also available in pdf if you prefer that route.
Instructors will be having live office hours via Piazza on Tues from 1-4:30 PM EST to answer questions and provide insight on the lecture and lab sections. We will also be answering questions throughout the week, so if the time does not work for your schedule, you can still take the course! We will also be adding supplemental videos for the course to answer common questions, additional tips, etc. The schedule is as follows:
Tuesday, Oct 27: Chapter 1 - Intro to R Language and Data Types; Chapter 2 - Lab I: DNA words (practice for vectors and syntax)
Tuesday, Nov 3: Chapter 3 - Intro to Graphing and Visualization in R; Chapter 4 - Lab II: Metagenomic Analysis with PCA/PCoA (practice for visualization)
Tuesday, Nov 10: Chapter 5 - Intro to Reading and Writing Functions in R; Chapter 6 - Lab III: Writing a Sliding Window Analysis Function (practice for functions and all other skills)
You will be free to work at your own pace in the course, but we will focus on answering questions/running discussions for the course as per the schedule (i.e. if you get to Chapter 6 on Oct 28, we won't likely get to your questions as fast as we do for people who are still on Chapter 1).
We designed this so you could do as much as possible offline (using pdfs and your own RStudio install) or on public machines (using Canvas and VMs, without software installation) to help mitigate any access issues you may have. We have run this course online before, and it was a big hit, so we're hoping this will go smoothly as well!
Feel free to email me any questions you may have! Also, feel free to send this to anyone you think might be interested, as this course is open to students at any university.
Dr. Sheri Sanders
Manager, Bioinformatic Analyst
National Center for Genome Analysis Support (NCGAS)
NCGAS is a management unit of the Research Technologies division of UITS; NCGAS is affiliated with the Indiana University Pervasive Technology Institute.
Cyberinfrastructure Engineering Learning Series
CI Engineering Lunch & Learn Series
Designing, building, and maintaining advanced cyberinfrastructure to support scientific use cases can be challenging. There are numerous items to learn about, and the learning can be never ending. As a community, it is important for all of us to be available to answer questions, propose new ideas, and build upon our collective knowledge.
Starting in 2017 ESnet, in collaboration with the National Science Foundation, began sponsoring semi-weekly talks on engineering and engagement topics. These CI Engineering Lunch & Learn talks are held on Friday afternoons @ 2:00pm ET using the following Zoom number:
Join Zoom Meeting
One tap mobile
+16699006833,,804696793# US (San Jose)
+16465588656,,804696793# US (New York)
Dial by your location
+1 669 900 6833 US (San Jose)
+1 646 558 8656 US (New York)
Meeting ID: 804 696 793
Find your local number: https://zoom.us/u/aboUJCvWEZ
Join by SIP
Join by H.323
18.104.22.168 (US West)
22.214.171.124 (US East)
126.96.36.199 (Hong Kong)
Meeting ID: 804 696 793
Talk announcements are made weekly on the following mailing list, sign up is moderated but all are welcome to join:
The following is a list of upcoming talks:
Date Speaker / Affiliation Talk Topic Oct 23, 2020 Michael Smitasin & Jay Krous / LBNL Cloudflare Reverse Proxy Oct 30, 2020 None Scheduled None Scheduled Nov 6, 2020 Edward Colone / Univ of Michigan & perfSONAR Provisioning perfSONAR with Ansible Nov 13, 2020 None Scheduled - Virtual SC20 None Scheduled - Virtual SC20 Nov 20, 2020 None Scheduled - Virtual SC20 None Scheduled - Virtual SC20 Nov 27, 2020 None Scheduled - Turkey Day None Scheduled - Turkey Day Dec 4, 2020 Jeffry Handal / Cisco IPv6
The most up to date schedule can be found here:
All previous talks (slides and recordings) can be found here:
2017 - 2020 talks are also posted to youtube:
Date Speaker / Affiliation Topic Recording Link YouTube Link 1/17/2020 Anita Nikolich / Illinois Institute of Technology What is FABRIC? GDrive YouTube 2/21/2020 Hyojoon Kim / Princeton University Princeton P4 Campus: Building and Running Novel Campus Network Applications GDrive YouTube 2/28/2020
Jorge Crichigno & Elie Kfoury / University of South Carolina
Offloading Media Traffic to P4 Programmable Data Plane Switches GDrive YouTube 3/6/2020
Rick Wagner / Globus
Automating Research Data Workflows with Globus GDrive YouTube 3/20/2020
Math Mathis / Google
BBR and the evolution of transport protocols GDrive YouTube 3/27/2020
David Teach / Univ of Oregon
Route Views GDrive YouTube 4/3/2020
Jason Zurawski / ESnet & EPOC
Data Movement Exhibition Update GDrive YouTube 4/10/2020
Eric Boyd / Univ of Michigan
NetBasilisk @ The University of Michigan GDrive YouTube 4/17/2020
Nick Buraglio / ESnet
ESnetIPv6 management network deployment GDrive YouTube 5/1/2020
Eli Dart & Hans Addleman / IU, ESnet, & EPOC
Network Strategy to Enable Data Intensive Science GDrive YouTube 5/4-6/2020 GDrive YouTube 5/14/2020
Brad Cowie / University of Waikato
FAUCET GDrive YouTube 6/5/2020
Peter Boothe / Google & MLab
NDT GDrive YouTube 6/12/2020
Fatema Bannat Wala / ESnet
Zeek And Ye Shall Find!- A Zeek Primer GDrive YouTube 6/26/2020
Andrew Gallo / GWU & Lenny Giuliano / Juniper
Automatic Multicast Tunneling (AMT) GDrive YouTube 7/10/2020
Pete Siemsen /NCAR & FRGP
BCP38 GDrive YouTube 7/17/2020
Fatema Bannat Wala / ESnet
KYD - Know Your Devices, a Method for Profiling Devices Using DHCP and Zeek GDrive YouTube 7/24/2020
Nathan Shepherd, Abigail Fox, and Edward Colone / Univ of Michigan
perfSONAR Deployment technologies (Small nodes and Embedded Systems) GDrive YouTube 7/31/2020
Ali Alrubaiee, Brendan Kailukaitis, Charles Beach, Ian Thompson, Iffat Saiyara, Konstantin Kovalchuk, and Edward Colone / Univ of Michigan
Performance monitoring WiFi with perfSONAR GDrive YouTube 8/7/2020
Michael Lambert / PSC
Peering DB & IRR GDrive YouTube 8/13/2020
Quilt Webinar: Identifying Campus Infrastructure Needs GDrive YouTube 8/14/2020
Ken Miller / ESnet
Data Movement Exhibition Update GDrive YouTube 8/21/2020 Alan Whinery / University of Hawaii The IPv6 Only Network: How To Simplify Your Life By Turning Off IPv4 GDrive YouTube 8/28/2020 George Robb & Charles Shiflett / ESnet DTN Design Patterns GDrive YouTube 9/11/2020 Michael Sinatra / ESnet MANRS GDrive YouTube 9/25/2020 Jen Schopf / IU International Networks NetSage Now GDrive YouTube 10/2/2020 Edward Colone / Univ of Michigan & perfSONAR Mobile perfSONAR nodes best practices GDrive YouTube 10/16/2020 Rachana Ananthakrishnan / University of Chicago & Globus Globus Connect Server v5: An Enhanced Experience for User and Admin Alike! GDrive YouTube 10/23/2020 Michael Smitasin & Jay Krous / LBNL Cloudflare Reverse Proxy GDrive
11/6/2020 Edward Colone / Univ of Michigan & perfSONAR Provisioning perfSONAR with Ansible GDrive
12/4/2020 Jeffry Handal / Cisco IPv6 GDrive
Date Speaker / Affiliation Topic Recording Link YouTube Link 3/29/2019 Jason Zurawski / ESnet Overview of the Engagement and Performance Operations Center (EPOC) GDrive YouTube 3/29/2019 Chuck Benson / Univ Washington IoT Systems risk mitigation GDrive YouTube 4/12/2019 Frank Wuerthwein / UCSC & OSG Supporting Science via the Open Science Grid (OSG) GDrive YouTube 4/19/2019 Edward Colone / Univ Michigan & perfSONAR perfSONAR automations GDrive YouTube 4/26/2019 Michael Johnson / Indiana Univ & perfSONAR PWA GDrive YouTube 5/3/2019 Hans Addleman / Indiana Univ & SCinet SC19 SCinet WAN GDrive YouTube 5/10/2019 Garhan Attebury / Univ Nebraska UNLHCC Data Center Upgrades GDrive YouTube 5/17/2019 Rachana Ananthakrishnan / Univ of Chicago & Globus Globus Protected Data GDrive YouTube 5/24/2019 Thomas DeFanti / UCSD & SDSC Pacific Research Platform GDrive YouTube 5/31/2019 Douglas Jennewein / Univ of South Dakota XSEDECampus Champions GDrive YouTube 6/7/2019 Joseph White / Univ of Buffalo XDMoD GDrive YouTube 6/14/2019 Von Welch & Susan Sons / Indiana Univ TrustedCI & ResearchSOC GDrive YouTube 6/28/2019 Dori Sajdak/Univ of Buffalo ColdFront GDrive YouTube 7/12/2019 Shawn Campbell/Malone Univ Virtual vs. Physical DTNs GDrive YouTube 7/26/2019 Julie Ma/MGHPCC Ask.ci GDrive YouTube 8/9/2019 Wallace Chase/REANNZ REANNZ GDrive YouTube 8/16/2019 Nick Buraglio/ESnet Automation, Orchestration, SDN, Technical Debt GDrive YouTube 8/23/2019 Jennifer Schopf/IU International Networks NetSage GDrive YouTube 8/30/2019 Jason Zurawski/ESnet CC* Data Movement Workshop and Exhibition GDrive YouTube 9/13/2019 William Deigaard / Texas A&M Batfish Experience at TAMU, so far... GDrive YouTube 10/4/2019 Kevin Thompson / NSF CC* Program Update GDrive YouTube 10/11/2019 Klara Nahrstedt / UIUC Campus-Specific Cyber-Infrastructure Challenges and Solutions for Scientific Instruments, and their Workflows and Lab Environments GDrive YouTube 10/18/2019 Jeronimo Bezerra / FIU & AMPATH AmLight-INT Project GDrive YouTube
Date Speaker / Affiliation Topic Recording Link YouTube Link 1/5/2018 Kevin Thompson / NSF CC* Overview GDrive YouTube 1/12/2018 SCinet SCinet Architecture GDrive YouTube 1/19/2018 Grace Wilson Caudill / University of New Hampshire & NorthEast Big Data Innovation Hub (NE BDIH) Security in Trusted Research Systems and Spaces (SiTRSS)" (pronounced ‘Citrus’) GDrive YouTube 1/26/2018 Michael Sinatra / ESnet Intro to Crypto GDrive YouTube 2/16/2018 Eli Dart / ESnet Petascale DTNs / ICNWG GDrive YouTube 2/23/2018 UCAR/KINBER/ESnet WINS Program GDrive YouTube 3/9/2018 Jeff Mitchell / Lukas, LaFuria, Gutierrez, and Sachs LLP Net Neutrality Briefing GDrive YouTube 3/16/2018 Derek Weitzel / Univ of Nebraska StashCache GDrive YouTube 3/23/2018 Steve Lovaas / Colorado State Univ Our CUI approach, as part of a general high-assurance security topology GDrive YouTube 3/30/2018 Jorge Crichigno / Univ of South Carolina CC* Experience + Research Projects GDrive YouTube 4/13/2018 Steven Wallace / Indiana Univ. Micro DMZs GDrive YouTube 4/27/2018 ESnet Infrastructure, Routing, Security Configuration Management GDrive YouTube 5/4/2018 Prasad Calyam / Univ of Missouri Cyber and Software Automation for Neuroscience Community: Needs in Research and Training GDrive YouTube 6/15/2018 Pete Siemsen / NCAR implementation of BCP38 GDrive YouTube 6/22/2018 Andy Lake / ESnet pSConfig (the meshconfig replacement in perfSONAR 4.1) GDrive YouTube 8/3/2018 Gregory Schueren TCP Snitch GDrive YouTube 8/24/2018 Azael Fernandez Alcantara / UNAM Mexican / Latin American NREN GDrive YouTube 9/14/2018 Scott Hogg / GTRI AWS Security GDrive YouTube 9/21/2018 Azher Mughal / USC 100G Experiences @ USC GDrive YouTube 9/28/2018 Mariam Kiran / ESnet Enabling intents for networks GDrive YouTube 10/12/2018 Antoine Delvaux & Szymon Trocha / perfSONAR TWAMP GDrive YouTube
Date Speaker / Affiliation Topic Recording Link YouTube Link 6/2/2017 Hunter Fuller / University of Alabama Huntsville Campus Security Architecture GDrive YouTube 6/23/2017 Steve Bogol / University of Notre Dame Science DMZ and Data Center Architecture GDrive YouTube 6/30/2017 Scott Valcourt & Doug Green / University of New Hampshire Small School DMZ & Collaboration Lessons Learned GDrive YouTube 7/7/2017 Ken Miller / The Pennsylvania State University Science DMZ Implementation, Policy, and Sustainability GDrive YouTube 7/14/2017 Jeff Weekley / The University of California at Merced WAVE Scientific Visualization GDrive YouTube 7/21/2017 Jerry Sheehan / Montana State University Science DMZ Implementation and Operation GDrive YouTube 7/28/2017 Jay Krous & Aashish Sharma / Lawrence Berkeley National Laboratory Security @ 100G GDrive YouTube 8/4/2017 Jim Warner / The University of California at Santa Cruz Switches, Buffers, and Buffer Monitoring GDrive YouTube 8/18/2017 Cody Smith / OARnet Statewide perfSONAR GDrive YouTube 8/25/2017 Hans Kuhn & Hervey Allen / Network Startup Resource Center (NSRC) @ University of Oregon Operations and overview of NSRC GDrive YouTube 9/8/2017 Neil McKee & Ken Miller / SCinet DevOps Netflow/Inmon GDrive YouTube 9/15/2017 University of Virginia Readonly Root Environment for Scientific Computing GDrive YouTube 9/22/2017 Andy Lake / ESnet & perfSONAR perfSONAR 4.1 GDrive YouTube 9/29/2017 Alan Whinery / University of Hawaii Where packets go GDrive YouTube 10/13/2017 Greg Veldman & Paul Anderson / SCinet DevOps Puppet on SCinet Resources GDrive YouTube 10/20/2017 Matt Mathis / Google BBR GDrive YouTube 10/27/2017 Vas Vasiliadis / Univ of Chicago & Globus Instrument Automation/Data Management Plan Support GDrive YouTube 11/3/2017 Elliot Fenech / The University of Utah Utah Student CI PRogram GDrive YouTube 12/1/2017 Alan Sutter, Jonathan Miller, Carrie Rampp, Jason Brooks / Franklin and Marshall College Science DMZ @ Small Schools GDrive YouTube 12/8/2017 Christopher Tengi & Hyojoon Kim / Princeton University Software Defined Border Router GDrive YouTube
Affiliated Training Materials
The R&E community produces lots of informative and educational content that is worth subscribing too, particularly to share with new colleagues looking for education on emerging or existing technology.
- The Network Startup Resource Center (NSRC) maintains a rich set of materials on their Website, and their YouTube channel. Materials span the basics like BGP, to emerging work on MANRS, perfSONAR, and other advanced CI topics.
- TrustedCI, the NSF Cybersecurity Center of Excellence, publishes printed materials on their Website, along with presentations on their YouTube channel.
- The perfSONAR project makes many training materials available via their YouTube channel.
Google Cloud Public Sector Summit
We will showcase fresh ideas and innovation from academic, research, and gov leaders alongside Google executives.
Here is a sampling of topics that may be of interest to you:
• Running Astronomical Pipelines with HTCondor
• AI Fuels Smarter Medical Imaging and Better Outcomes
All sessions will have YouTube closed captioning option for language preference.
Explore the session catalog. We’re constantly adding sessions, so we encourage you to check in regularly.
Register Today →
Research Data Management
Michener, William K. 2015. “Ten Simple Rules for Creating a Good Data Management Plan (Links to an external site.).” PLoS Computational Biology 11(10): e1004525.
Strasser, Carly. 2015. “Research Data Management: A Primer Publication of the National Information Standards Organization (Links to an external site.).” National Information Standards Organization (NISO).
Griffin, Philippa C. et al. 2017. "Best Practice Data Life Cycle Approaches for the Life Sciences (Links to an external site.)." bioRxiv 167619.
Ziemann, Mark, Yotam Eren, and Assam El-Osta. 2016. "Gene name errors are widespread in the scientific literature (Links to an external site.)." Genome Biology 17(1): 177-179.
DataONE. Data Management Best Practices
- Cloud Native Computing
Established in Durham, NC in 1994, Shodor is a nonprofit organization serving students and educators by providing materials and instruction relating to computational science (scientific, interactive computing).
With an Internet presence producing 3 to 4 million page views per month, Shodor has an international impact. Its award-winning, free online education tools such as Interactivate are popular with students and educators alike.
Shodor is transforming learning through computational thinking. In the Raleigh-Durham, NC area, Shodor offers workshops, apprenticeships and internships for youth and teens to build excitement for science, technology, engineering, and mathematics (STEM) through interactive explorations using hands-on and computer-enhanced activities, giving them the experience they will need to pursue a technology-intensive career path.
CaRCC - Campus Research Computing Consortium - Trainings
Data-Facing Track (first Tuesdays)
Tuesday, January 5, 1p ET/ 12p CT/ 11a MT/ 10a PT
Python for Big Data
Presenter: Bala Desinghu, Rutgers University
Python is a popular programming language for developing software and data science applications. Its popularity stems from many factors such as simplicity, readability, portability, etc. As such, Python is slow compared to C or Fortran and it does not manage memory well. These limitations in speed and memory management may not be significant when analyzing small data sets, but it becomes a bottleneck when analyzing big data sets. Techniques based on vectorization, parallelization, just in time compilation, and distributed task executions have been widely adopted by the Python community to address these challenges associated with big data. This presentation will address a few techniques suitable for large scale data analysis and answer the following questions: What to do when the data set size exceeds the available physical memory? How to speed up the data analysis? How to distribute the workloads when doing machine learning for big data sets?
Researcher-Facing Track (second Thursdays)
Thursday, January 14, 12p ET/ 11a CT/ 10a MT/ 9a PT
All about CaRCC (... beyond the R-F Track)
The Researcher-Facing Track would like to take the opportunity to start 2021 by pausing, reflecting, and asking "Who are we?" CaRCC has grown and evolved over the past two to three years -- the People Network alone currently has over 900 persons on its mailing list; and the number of working groups has approximately doubled. Many persons within CaRCC and part of the Ecosystem are hard at work "boundary spanning" -- bringing groups together, sharing ideas, and helping both the RCD profession and the research & researchers we support. We will give attendees an overview & update on the organization; highlight some key, example activities and outputs of a couple Working Groups, and conclude with Engagement. This is a great time to invite new colleagues to come and learn about CaRCC, its activities, and how to Get Started or Get Involved!
Emerging Centers Track (third Wednesdays)
Wednesday, January 20, 12p ET/ 11a CT/ 10a MT/ 9a PT
EPOC and OSG support for CC* Proposals
Carrying on our popular meeting with NSF program directors on the CC* Program, the Emerging Centers Track January call will bring representatives from the EPOC (Engagement and Performance Operations Center) and OSG on support of potential CC* proposals. Jennifer Schopf and Lauren Michael will contribute. Learn more about each of these programs interoperation with CC* activities and how you can improve your proposal by engaging these organizations.
Systems-Facing Track (third Thursdays)
Thursday, January 21, 12p ET/ 11a CT/ 10a MT/ 9a PT
HPC Cluster Operating Systems Options
With the recent announcement from IBM/Redhat that CentOS 8 will be EOL at the end 2021 and CentOS 7 in 2024 many HPC systems professionals now face the prospect of having to migrate off the downstream distribution and either adopt CentOS 8 Stream or purchase licenses for RHEL. There are some institutions where clusters run other operating systems, most notably Cray has deployed SuSE as part of their Cray environment and NVIDIA DGX boxes notably run more smoothly with Ubuntu. Our January meeting we will have a panel discussion on this topic and explore experiences using/migrating to/from other distributions on their HPC resources.