Tue 14 Jun 2016 14:30 - 15:00 at Santa Rosa East - Keynote and Research Paper

Many PGAS languages and libraries rely on high performance transport layers such as GASNet and MPI to achieve low communication latency, portability and scalability. As systems increase in scale, failures are expected to become normal events rather than exceptions. Unfortunately, GASNet and standard MPI do not provide fault tolerance capabilities. This limitation hinders PGAS languages and other high-level programming models from supporting resilience at scale. For this reason, Resilient X10 has previously been supported over sockets only, not over MPI. This paper describes the use of a fault tolerant MPI implementation, called ULFM (User Level Failure Mitigation), as a transport layer for Resilient X10. By providing fault tolerant collective and agreement algorithms, on demand failure propagation, and support for InfiniBand, ULFM provides the required infrastructure to create a high performance transport layer for Resilient X10. We show that replacing X10’s emulated collectives with ULFM’s blocking collectives results in significant performance improvements. For three iterative SPMD-style applications running on 1000 X10 places, the improvement ranged between 30% and 51%. The per-step overhead for resilience was less than 9%. A proposal for adding ULFM to the coming MPI-4 standard is currently under assessment by the MPI Forum. Our results show that adding user-level fault tolerance support in MPI makes it a suitable base for resilience in high-level programming models.

Presentation (presentation_press.pdf)2.20MiB

Tue 14 Jun

Displayed time zone: Tijuana, Baja California change

13:30 - 15:00
Keynote and Research PaperX10 at Santa Rosa East
13:30
60m
Talk
Keynote: Tracking and Constraining Work Stealing Schedulers
X10
A: Sriram Krishnamoorthy Pacific Northwest National Laboratories
File Attached
14:30
30m
Talk
Resilient X10 over MPI User Level Failure Mitigation
X10
A: Sara S. Hamouda Australian National University, A: Benjamin Herta , A: Josh Milthorpe IBM Research, A: David Grove IBM Research, A: Olivier Tardieu IBM Research
Link to publication DOI Pre-print File Attached