High Performance Computing

The Need

The analytic and high-performance computing tools the organization currently uses were not up to the demands being put on them. In addition, the use of cloud was very limited, leading to higher costs and limited HPC resources during peak times. The company needed a new, modern, and extensible HPC infrastructure that could support current and future analytics activities.

The Maverick Solution

The Maverick team started the process by gathering a complete and comprehensive set of requirements that would drive the decisions around the HPC infrastructure. This infrastructure had to include not only on-premises resources, the inclusion of their preferred cloud service provider, AWS, was also necessary. After a complete review, the Maverick team built a design for new HPC infrastructure that includes:

• High Speed/ Low Latency network using 200Gbps HDR 200 Infiniband fabric.

• Current generation Intel Cascade Lake processors (48c/2.4GHz)

• Nvidia V100 GPU (32GB mem, 32 GB/s throughput per GPU)

• High performance Parallel storage platform (Weka) capable of throughput greater than 2.4 Tbps

• Cluster management and Job management platforms (Bright and Slurm) which automate the management of resources and allow us to seamlessly direct workloads to on-premises or cloud infrastructures.

• Data management tools (Starfish) that enable administrators to automate data management based on metadata

Customer Benefits

The solution has only recently been brought into production. The documentation on benefits from a full rollout are yet to come. As Maverick has onboarded the first teams to this new infrastructure, it has seen an eager uptake of these new capabilities. Teams are quickly recognizing the capabilities of this new platform and the benefits to their work. These teams are now able to utilize more data, generate results more quickly, and drive their processes forward faster.