AWS - HPC and HTC Day

Many N8 researchers are now turning to the Cloud to meet their on-demand or extra compute needs. The former N8 HPC Technical Management Group recognised this need and made preliminary investigations into the use of Cloud by researchers. Separately, Research IT at the University of Manchester has been working with AWS to make it simple for users of their Condor pool to burst out into AWS and making the most of "spot market" prices for cost-effective compute resources. At the same time the University of Liverpool has also been using AWS for bursting HPC.

11 Dec 2018 10 a.m. — 5 p.m.

As the desire to use Cloud is common across N8 it seemed sensible to combine resources and experience. An AWS HPC and HTC day has been organised by the new technical theme of N8 CIR as their first event. The day will cover AWS overview and updates, security and demos of Condor bursting and AWS Parallel Cluster. There will also be the opportunity to login via the AWS portal and set up a HPC/HTC cluster of your own!

Initially the day is open to technical staff and researchers from the N8 universities - Durham, Lancaster, Leeds, Liverpool, Manchester, Newcastle, Sheffield and York. Any available places will then be offered to those external from N8.

Mark Lundie, Research Infrastructure Engineer, University of Manchester has produced a write up of the event:

AWS - HPC and HTC Day Nov 2018

Agenda

10.00 - 10.10 Introduction – Charlotte Spiteri, AWS
10.10 - 10.20 AWS Overview – Charlotte Spiteri, AWS
10.20 - 10.30 Overview, Simon Hood, Research IT, University of Manchester
10.30 - 11.00 AWS and Security Introduction – Phil Edwards, AWS
11.00 - 11.20 Break
11.20 - 12.05 Research and AWS – Scott Eberhardt, AWS
12.05 - 12.35 AWS Console Demo – Phil Edwards, AWS
12.35 - 13.05 HTCondor AWS Annex Demo – Christopher Paul, Research IT, University of Manchester
13.05 - 14.05 Lunch
14.15 - 15.15 Parallel Cluster Demo and Hands-on exercise for attendees – Scott Eberhardt, AWS
15.15 - 15.45 Break
15.45 - 16.15 AWS HPC New announcements from AWS re:Invent – Scott Eberhardt, AWS
16.15 - 16.30 Frameworks and how to set up your account – Charlotte Spiteri & Phil Edwards, AWS
16.30 - 17.00 Wrap up and Q&A – Charlotte Spiteri & Team, AWS