Re: [Discuss] hpc-novice revival?
Hello, As part of the software carpentry community, and also as part of the scientific community (life sciences), constantly using HPC resources (and constantly getting stucked in the process), I think having HPC lessons as part of the workshops is actually a necessity! Thanks for bringing this up Best Tania From: Discuss <discuss-boun...@lists.software-carpentry.org> on behalf of Peter Steinbach <steinb...@scionics.de> Sent: Monday, December 5, 2016 1:26 PM To: Software Carpentry Discussion Subject: [Discuss] hpc-novice revival? Dear list members, as 2016 ends, 2017 begins. With it, some unique opportunities are arising to revive hpc-novice, aka the novice HPC lessons that we once discussed and laid out to get into SC16. https://github.com/swcarpentry/hpc-novice I see 2 possible venues in the near future in my geographic proximity, where we could apply for having a HPC novice lesson take place. parallel 2017: http://www.parallelcon.de/call_en.php (small and new conference) ISC2017: http://isc-hpc.com/tutorials.html (one of the standard HPC conferences in the year) [I am sure you can list more conferences on your continent here ...] and of course: https://www.software.ac.uk/cw17 (as a venue for having a first course or for working on its contents) To cut a long mail short: Who would be interested in trying to bring hpc-novice to new life? Or in other words, does the software carpentry community still think a hpc-novice lesson is worth pursuing? Best, Peter PS. I am currently unclear who maintains the above mentioned repo swcarpentry/hpc-novice as there are 4 unanswered PRs, some of which are over a year old. ___ Discuss mailing list Discuss@lists.software-carpentry.org http://lists.software-carpentry.org/listinfo/discuss ___ Discuss mailing list Discuss@lists.software-carpentry.org http://lists.software-carpentry.org/listinfo/discuss
Re: [Discuss] hpc-novice revival?
Dear list, I have submitted a PR https://github.com/swcarpentry/hpc-novice/pull/9 containing a possible outline of the contents in the course. https://github.com/psteinb/hpc-novice/blob/9a584e9fe0fa1009e0cc32228684ca1685038364/outline.md Best, Peter ___ Discuss mailing list Discuss@lists.software-carpentry.org http://lists.software-carpentry.org/listinfo/discuss
Re: [Discuss] hpc-novice revival?
Dear Anelda, thank you for your reply. I think we have to go through the discussion again about what should this lesson contain that you bring up. In nuce, I think we should concentrate on 1-2 core principles behind cloud and hpc. I agree that many scientists are confused by the availability of computing resources today. Therefor, I had in mind teaching HPC (classical simulations) versus HTC (a majority of bioinformatics, image processing, deep learning, cloud stuff) based on a somewhat simple example without diving too much into the details of the underlying APIs. With this, I hope to convey a simple mental model that will help participants not only to exploit HPC/cloud more effectively but also to judge available technologies better. I warmly invite you to repost your reply in a contrived manner here: https://github.com/swcarpentry/hpc-novice/issues Best, Peter On 06.12.2016 04:54, ane...@talarify.co.za wrote: Dear Peter, Seems like HPC Carpentry crops up at least every 2 months in conversations around the world. We recently had a great email chat between Mateusz Kuzak (Netherlands eScience Centre), Christina Koch (University of Wisconsin-Madison), Peter van Heusden (South African National Bioinformatics Institute) and myself. We would ideally like to see a lesson on research computing infrastructure - explaining the different infrastructures that are available - grid, cloud, hpc, other(?) and helping researchers to understand when to use what - or rather what they need to address their specific research computing needs. This is more than just HPC novice, but with such a wide variety of infrastructures becoming very accessible (even to researchers in Africa) it would be great if our researchers understood why they should/could use the one or the other. Once we have a lesson like this in place, an applied HPC lesson might have much more impact? I'd love to see a HPC novice lesson developed to complement that as our university (and I suppose many around South Africa) could benefit greatly from it. Previously people have bumped into the problem of HPCs which are differently configured, but I think there is a sufficient level of abstraction possible where novices can learn concepts applicable to HPC in the broad even if they were taught the details of a specific system. Learning the new vocabulary of queues, head nodes, schedulers, etc will already take them a long way in being able to talk to their HPC service provider. I'm not sure how far things have gone with the lesson I describe above - I think Christina and possibly Mateusz was working on something to this effect? Happy to be involved in both. By chance I'll be at the South African HPC conference this week and could see if there is interest there to help develop? Kind regards, Anelda ___ Discuss mailing list Discuss@lists.software-carpentry.org http://lists.software-carpentry.org/listinfo/discuss
Re: [Discuss] hpc-novice revival?
Dear Peter, Seems like HPC Carpentry crops up at least every 2 months in conversations around the world. We recently had a great email chat between Mateusz Kuzak (Netherlands eScience Centre), Christina Koch (University of Wisconsin-Madison), Peter van Heusden (South African National Bioinformatics Institute) and myself. We would ideally like to see a lesson on research computing infrastructure - explaining the different infrastructures that are available - grid, cloud, hpc, other(?) and helping researchers to understand when to use what - or rather what they need to address their specific research computing needs. This is more than just HPC novice, but with such a wide variety of infrastructures becoming very accessible (even to researchers in Africa) it would be great if our researchers understood why they should/could use the one or the other. Once we have a lesson like this in place, an applied HPC lesson might have much more impact? I'd love to see a HPC novice lesson developed to complement that as our university (and I suppose many around South Africa) could benefit greatly from it. Previously people have bumped into the problem of HPCs which are differently configured, but I think there is a sufficient level of abstraction possible where novices can learn concepts applicable to HPC in the broad even if they were taught the details of a specific system. Learning the new vocabulary of queues, head nodes, schedulers, etc will already take them a long way in being able to talk to their HPC service provider. I'm not sure how far things have gone with the lesson I describe above - I think Christina and possibly Mateusz was working on something to this effect? Happy to be involved in both. By chance I'll be at the South African HPC conference this week and could see if there is interest there to help develop? Kind regards, Anelda On 2016-12-05 22:26, Peter Steinbach wrote: Dear list members, as 2016 ends, 2017 begins. With it, some unique opportunities are arising to revive hpc-novice, aka the novice HPC lessons that we once discussed and laid out to get into SC16. https://github.com/swcarpentry/hpc-novice I see 2 possible venues in the near future in my geographic proximity, where we could apply for having a HPC novice lesson take place. parallel 2017: http://www.parallelcon.de/call_en.php (small and new conference) ISC2017: http://isc-hpc.com/tutorials.html (one of the standard HPC conferences in the year) [I am sure you can list more conferences on your continent here ...] and of course: https://www.software.ac.uk/cw17 (as a venue for having a first course or for working on its contents) To cut a long mail short: Who would be interested in trying to bring hpc-novice to new life? Or in other words, does the software carpentry community still think a hpc-novice lesson is worth pursuing? Best, Peter PS. I am currently unclear who maintains the above mentioned repo swcarpentry/hpc-novice as there are 4 unanswered PRs, some of which are over a year old. ___ Discuss mailing list Discuss@lists.software-carpentry.org http://lists.software-carpentry.org/listinfo/discuss ___ Discuss mailing list Discuss@lists.software-carpentry.org http://lists.software-carpentry.org/listinfo/discuss
