Talks > 05/06/2025 Safae Bourhnane

Streamlining HPC Data Workflows: Cloud SQL Databases at Scale for Metadata

HPC applications are increasingly generating and using large amounts of data which makes efficient data management extremely essential.

As it might be known, relational databases are rarely used in HPC applications since researchers prefer NoSQL databases for their flexibility.

However, SQL-based databases on the cloud are being increasingly used for storing and processing metadata in HPC workflows.

Nevertheless, their performance has not been extensively benchmarked against HPC workloads in terms of I/O operations, latency, and scalability.

This study aims at bridging the gap by benchmarking PostgreSQL performance in a cloud environment to understand its suitability for HPC workloads. Our study investigates latency, concurrency, and scalability.

This research aims to improve data management strategies and enhance the overall efficiency of cloud-based databases in the HPC domain.

Download PDF


Related Talks

Visit our forum

One of the main goals of this project is to motivate new initiatives and collaborations in the HPC field. Visit our forum to share your knowledge and discuss with other HPC experts!

About us

HPCKP (High-Performance Computing Knowledge Portal) is an Open Knowledge project focused on technology transfer and knowledge sharing in the HPC, AI and Quantum Science fields.

Promo HPCNow