To ensure that commercial cloud service offerings conform to the tender requirements and satisfy the needs of the research community, ARCHIVER is assembling a benchmarking and service validation test suite that leverage on the testing activities that took place during the HNSciCloud project.
These tests derive from multiple use cases from several scientific domains and are based on scientific workload deployments in domains such as:
The test suite is maintained on Github with associated documentation, distributed under the AGPL open source license. The test suite design is as modular and autonomous as possible for easy deployment, using an abstraction layer based on Docker and Kubernetes for orchestration, using Terraform for resource provisioning, and currently pushing the results to be stored in the CERN cloud. The test suite also gives the researcher the option to repatriate all associated data from the commercial cloud provider to Zenodo1.
This test suite will be used to validate the technical readiness level (TRL) of suppliers against the community's requirements stipulated in the ARCHIVER tender.
A process for onboarding test contributions from the research community has been developed consisting of four steps:
Initial deployments of the test suite have been performed on the following cloud service providers: Exoscale (Cloudstack), Cloudscale, CloudFerro, CloudSigma, Google Cloud, Amazon Web Services, Microsoft Azure.