In this special guest feature, Bill Wagner from Bright Computing writes that the convergence of HPC & AI presents new challenges for containers, job scheduling, and system management
"The convergence of HPC & A.I. is a hot topic right now, and for good reasons. In practice, there is a symbiotic relationship between (for example) HPC simulations and machine learning. HPC simulations generate tons of data, and as luck would have it, machine learning requires tons of data to train models. If we turn the value proposition around, the quality and effectiveness of HPC simulations can be improved if we use machine learning to identify the parameters in simulation data that have a significant effect on the outcome and focus subsequent iterations of simulation on those parameters..."