Talks > 13-14/06/2019 Christian Kniep

Containerized Convergence of Big Data and Big Computer

Since the early days of High Performance Computing operations and usage of such systems was highly dependent on the vendor, the discipline, the diversity of use-cases and the community it was embedded in.

The use-cases and communities of Big Data, Big Compute are converging, due to commoditisation in hard- (x86) and software (Linux), the growing importance of big enterprise IT and the advent of HPC characteristics in AI/ML workloads.

With the introduction of containers as distribution artefact and Kubernetes as orchestration substrate, this convergence might experienced it’s final push to take place.

This talk will dissect the convergence by refreshing the audiences’ memory on what containerization is about, segueing into why AI/ML workloads are leading to fully fledged HPC applications eventually and how this will inform the way forward.

In conclusion Christian will discuss the three main challenges `Hardware Access`, `Data Access` and `Distributed Computing` in container technology and how they can be tackled by the power of open source, while focusing on the first.


Related Talks

Visit our forum

One of the main goals of this project is to motivate new initiatives and collaborations in the HPC field. Visit our forum to share your knowledge and discuss with other HPC experts!

About us

HPCKP (High-Performance Computing Knowledge Portal) is an Open Knowledge project focused on technology transfer and knowledge sharing in the HPC, AI and Quantum Science fields.

Promo HPCNow