Achieve Universal Data Movement
Radically Simple Data Mover That Does More
zx-File supports any POSIX compliant file services, e.g. XFS, Lustre, NFSv3/4. It bulk transfers data over digital connections of any speed across any distance. To the best of our knowledge, it is the world’s only commercial data mover that has transferred actual 1PB production-like data, storage-to-storage, over 5000-miles in 29 hours with a 94% average bandwidth utilization (under a 80Gbps bandwidth cap) with full TLS encryption and checksumming. It can replicate data sets incrementally, even those with hundreds of millions of small files.
zx-Object supports AWS S3 object storage and true compatibles. It transfers data objects over digital connections of any speed across any distance. It supports the advanced AWS S3 multipart REST APIs with high concurrency resulting both very high reading and writing performance. It is the only product of this kind that has been proven to work well with Samsung’s KV SSDs, with the results demonstrated at the Supercomputing 2019 (SC19) Conference.
zx has highly efficient and rich ways to interact with storage services. It offers a unique single-site mode (SSM) that enables moving data among different locations, even zx is only running at a single location. For example, exchanging data with an external collaborator who is not (yet) a zx user; interacting with AWS S3 or compatibles directly.
Recent advances in all aspects of computing have made it possible to stream modern machine generated data from multiple sources through various stages of online and near line processing. This results in rich multi-dimensional datasets that can be made accessible for processing using a hybrid cloud. zx-Append-Streaming facilitates such a modern workflow model.
zx is the most modern scale-out petascale-proven data mover software available in the market. Its peer-to-peer enabled scale-out architecture, simplicity, robustness, capabilities, and efficiency are proven with production deployments, many world records, and winning of a highest level international competition – the two month long, grueling Supercomputing Asia 2019 Data Mover Challenge.