Talks > 17/05/2023 William J. Cunningham

Managing Complex Workflows Across Cloud Platforms with Covalent

Covalent is an open-source Pythonic tool designed to orchestrate heterogeneous HPC and quantum workflows, enabling computational research to be reproducible and manageable. By attaching metadata to workflows as they execute, Covalent provides users with a way to inspect everything from source code to data dependencies to software and environments in real time. With a browser-based user interface, users can easily visualize large and complex workflows distributed across multiple clouds, including AWS, Azure, and GCP Batch services.
In this talk, we will explore how Covalent can be used in multi-cloud and hybrid-cloud environments to enable seamless workflow management across various platforms. Specifically, we will discuss the benefits of using Covalent with AWS compute resources, as well as some of the challenges involved in joining cloud and on-prem HPC resources. I will also highlight the upcoming release of Covalent Cloud, a SaaS offering of Covalent which expands the tool’s capabilities and makes it accessible to a broader range of users.

Related Talks

Visit our forum

One of the main goals of this project is to motivate new initiatives and collaborations in the HPC field. Visit our forum to share your knowledge and discuss with other HPC experts!

About us

HPCKP (High-Performance Computing Knowledge Portal) is an Open Knowledge project focused on technology transfer and knowledge sharing in the HPC, AI and Quantum Science fields.

Promo HPCNow