Talks > 15-16/06/2017 Yorick Poels

Leveraging version control and continuous integration to improve a Linux HPC eco system

This presentation covers the improvements we made to our HPC setup and workflow, implementing best practices from the DevOps toolchain. The age of bash scripting, for system setup and configuration, has seen its dawn with the rise of configuration management systems like Puppet, Chef, and Ansible.

After we switched from shell scripts to Puppet, we felt the need to take another step in automating our workflow. We implemented an automated validation and build setup using Git for version control, Jenkins for automation, and Docker containers for reproducible builds of our HPC master package.

Deploying our code more often and in a more controlled way, gives us a more consistent code base to deploy our HPC environment. It improved our code quality and diminished bugs and mistakes that went into our production package.

The presentation will focus on how we used tools like Jenkins to improve the reliability of our Puppet code base, and how some simple improvements (git precommit hooks, syntax validation, test deployments,…) can help in the daily management of a Linux HPC environment.


Related Talks

Igor Seletskiy

AlmaLinux OS: The Soul of Community. The Heart of Innovation

25/06/2021

Jacinto Grijalba

Novell Sentinel

13-14/10/2011

Gregory Kurtzer

Rocky Linux: Linux should be Stable and Free

23/06/2021

Visit our forum

One of the main goals of this project is to motivate new initiatives and collaborations in the HPC field. Visit our forum to share your knowledge and discuss with other HPC experts!

About us

HPCKP (High-Performance Computing Knowledge Portal) is an Open Knowledge project focused on technology transfer and knowledge sharing in the HPC, AI and Quantum Science fields.

Promo HPCNow