Adaptive Checkpointing with Bandwidth-Aware Optimization

[nGreen27]

1. Improved bandwidth limiting

• filesize scaling
• file distinction
  • design file distinction list
  • adapt file specific bandwidth limiting
• FTIO bandwidth phase prediction
  • FTIO interface with bandwidth limit
  • phase limiting with I/O frequency
  • utilize confidence

2. IO Prefetching

• caching infrastructure
  • implement configurable cache
  • read through on cache miss
• async file prefetching
  • FTIO interface with ZMQ
  • async file reading
  • determine file prefetch timing

3. Checkpointing

• design checkpointing interface
• implement POSIX bandwidth limiting solution
• compare custom bandwidth based checkpointing strategies