Overview

Cloud Parallel File Storage (CPFS) is a fully-managed parallel file system provided by Alibaba Cloud. You can use CPFS in scenarios where high-performance computing is required. CPFS provides a unified namespace and supports concurrent access of hundreds of machines. CPFS also provides an I/O throughput of tens of GB/s and millions of IOPS to ensure a sub-millisecond latency. CPFS file systems can be used in I/O-intensive business that requires high throughput and high IOPS, and involves a large amount of data, such as AI training, autonomous driving, genomics computing, film rendering, oil exploration, weather forecast, and emulation for electronic design automation (EDA) software.

Benefits

High Performance

Provides an I/O throughput of 2 TB/s and 30 million IOPS based on a distributed concurrent architecture.

Scalable

Supports auto scaling and linearly improved performance

Integration with OSS Data Lake

Supports the data communication between OSS and reduces data storage costs.

Easy to Use

Allows you to create a high-performance file system within a few minutes.

Features

High-performance Computing File Storage

CPFS supports the standard Portable Operating System Interface (POSIX), MPI-IO, and Network File System (NFS) protocols. You can effectively execute your high-performance computing programs without calling API operations or optimizing performance. Compatible with the POSIX, MPI-IO, and NFS protocols CPFS is compatible with the POSIX, MPI-IO, and NFS protocols. You can directly use an ECS instance or the Container Storage Interface (CSI) interface plug-in to read data from or write data to CPFS without modifications on your high-performance programs. High throughput and low latency CPFS uses a new generation of parallel architecture to enable the concurrent I/O throughput of clients and storage nodes. CPFS also provides linearly improved I/O performance by aggregating clusters and sub-millisecond latency based on all-flash SSD storage. Improved performance in concurrent access CPFS uses a distributed parallel architecture to store metadata and data, which supports millions of IPOS for a large number of small files. CPFS can be concurrently accessed by thousands of servers and is suitable for the training of multiple multi-GPU servers.

Deep Integration with Alibaba Cloud Computing Services

CPFS can be mounted to computing platforms, such as Elastic High Performance Computing(E-HPC), Container Service for Kubernetes (ACK), and WUYING Workspace. You can build a high-performance computing and analytic platform in the cloud within a few minutes. Deep integration with E-HPC You can quickly create a CPFS file system and build a complete high-performance computing platform by using the E-HPC console. Compatible with ACK CPFS can be mounted to ACK. This way, ACK can use the CSI plug-in to use the high I/O performance of CPFS and enable the large-scale auto scaling of computing power. Compatible with WUYING Workspace CPFS can be directly mounted to WUYING Workspace over NFS. This allows you to share data between development and debugging terminals and high-performance computing clusters.