Bridging HPC and Cloud storage
The Jülich Supercomputing Centre (JSC) as representative of the Fenix consortium has decided to commission AKQUINET and MT-C with development tasks for the implementation of part of the Fenix infrastructure. The aim is to simplify the data transfer between cloud object stores with a Swift interface and fast parallel file systems with a POSIX interface. For this purpose, the multifunctional data mover NODEUM® is to be used with the corresponding expansion of specific functionalities.
The goal of the project is to realise the Data Mover service at different Fenix locations, including the European supercomputing centres JSC (Germany), BSC (Spain), CINECA (Italy), CEA (France) and CSCS (Switzerland). Federated cloud object stores are used at these locations, which enable researchers to exchange their data. With the Data Mover, researchers can copy their data locally to the existing parallel file systems in order to process them on the fast HPC systems. In addition, researchers can copy data, which have been generated on these supercomputers to the cloud object stores in order to make them accessible to other researchers from all over the world.
Today the main storage service provided by HPC centres is realised by internal but super-fast parallel file systems based on, e.g., GPFS or Lustre. They thus work as individual silos in internal infrastructures. To make data externally accessible and sharable, cloud object stores technologies are better suitable. The scope of the project is to connect the two worlds with the NODEUM® Data Mover and to transfer data from the world of the parallel file systems to the new world of Posix / S3 – considering all AAI requirements.
Press Release: Microsoft Word – pr-data-mover-sc21-v03 final (akquinet.com)
More Info: centralONE at SC21 (akquinet.com)
akquinet AG is an internationally active, continuously growing IT consulting company headquartered in Hamburg. Currently, 950 specialists with extensive knowledge in future-oriented technologies are employed. The company specializes in the implementation of ERP systems (SAP and Microsoft) and the individual development of software solutions. Especially in mechanical and plant engineering, the public sector and logistics, akquinet has many years of industry expertise and certified solutions. In four high-performance data centers in Hamburg, Norderstedt and Itzehoe, akquinet operates IT systems in outsourcing for companies of all sizes. The Twin Datacenter complies with the TÜV IT TSI 4.1 and EN50600 standards. The IT provider implements cross-location projects via branches in Germany and Austria.
akquinet GmbH
Werner-Otto-Straße 6
22179 Hamburg
Telefon: +49 (40) 88173-0
Telefax: +49 (40) 88173-111
http://www.akquinet.com
Presse- und Öffentlichkeitsarbeit
Telefon: +49 (40) 88173-1035
Fax: +49 (40) 88173-111
E-Mail: Angela.Sauerland@akquinet.de
