Zettar ZX enables the "distributed" in distributed data-intensive engineering and sciences

Highly scalable, reliable, and proven in real high-end HPC deployments

About Zettar

An HPC data transfer solution turns network-bound problems into I/O-bound problems - Chin Fang, Zettar Inc.

Zettar Inc. delivers a production-ready, scale-out (i.e. cluster-oriented), highly available data transfer solution capable of multi-100+Gbps for distributed data-intensive engineering and science applications. The solution consists of 1) the data transfer software, Zettar zx, 2) a multi-node (i.e. cluster) data transfer system reference design, and 3) an HPC all-NVMe storage tier reference design. Zettar zx is capable of scale-out encryption for data transfers. The solution's capabilities enable the use of existing storage and transfer setup to transparently gain higher throughput with each additional transfer node, with high reliability, and strong privacy for data-in-motion (if encryption is enabled). Zettar is a US National Science Foundation funded startup in Palo Alto, California.

As of 2016, the solution is in its third generation. Each generation has been developed, tested, and verified on best-of-breed hardware provided by various tier 1 vendor partners in the storage, compute, and networking spaces.

Zettar collaborates with the US Department of Energy (DOE)'s national lab system and its Energy Science Network (ESnet), which runs a state-of-the-art national 100Gbps network infrastructure. As a result, Zettar's software and data transfer system reference design are both proven in this demanding production environment. This Intel blog Transferring data at 100Gbps and beyond for distributed data-intensive engineering and sciences explains the overall co-design approach of the solution.

Zettar demoed an earlier version of its solution at the prestigious Supercomputing 2014 conference and showcased its third generation solution at various vendor partners' booths and the DOE's booth during the Supercomputing 2016 conference. All presentations included a 100Gbps real-time live demo of production preparation runs (with and without TLS encryption) using an innovative and unique 100Gbps 5000-mile loop provided by ESnet (120+ms latency).

Zettar is deploying its solution at a well-known research university, a DOE Exascale Computing Project (ECP) project, and a hyperscale Web property.

The demo was shown at SC16 Nov 16, DOE booth

zettar_sc16_demo

talk_in_sc16_doe_booth

News & Publications

  1. Andrey Kudryavtsev, Chin Fang, “Transferring data at 100Gbps and beyond for distributed data-intensive engineering and sciences”, Intel IT Peer Network article, November 2016
  2. Chin Fang, “Using AIC SB122A-PH 1U 10-Bay NVMe Storage Servers as the Building Blocks of High-Performance Scale-out Storage for HPC Applications”, white paper commissioned by AIC with Intel’s participation, November 2016
  3. Les Cottrell, Chin Fang, Andy Hanushevsky, Wilko Kreoger, Wei Yang, “High Performance Data Transfer”, CHEP 16, October 10-14, San Francisco, California
  4. Chin Fang, Les Cottrell, Andy Hanushevsky, Wilko Kreoger, Wei Yang, “High Performance Data Transfer for Distributed Data Intensive Sciences”, SLAC Technical Note: SLAC-TN-16-001, September 2016, SLAC National Accelerator Laboratory, Menlo Park, California
  5. Les Cottrell, Antonio Ceseracciu, Chin Fang , “Zettar Data Transfer Node Appliance testing" (zettar_escc-spring16.pptx - access controlled), ESNet Site Coordinators Committee, Spring 2016, Berkeley, California
  6. Les Cottrell, Antonio Ceseracciu, Chin Fang , “Zettar Data Transfer Node Appliance testing” (zettar_fq.pptx - access controlled), ESNet Site Coordinators Committee, September 2015, Austin, Texas
  7. Chin Fang, R. “Les” A. Cottrell, “An Overview of High-performance Parallel Big Data transfers over multiple network channels with Transport Layer Security (TLS) and TLS plus Perfect Forward Secrecy (PFS)”, SLAC Technical Note: SLAC-TN-15-002, April 25, 2015
  8. Chin Fang, “Using NVMe Gen3 PCIe SSD Cards in High-density Servers for High-performance Big Data Transfer Over Multiple Network Channels”, SLAC Technical Note: SLAC-TN-15-001, February 24, 2015
  9. Scot Schultz, "Mellanox and Zettar Crush World Record LOSF Performance Using ESnet OSCARS Test Circuit" Mellanox blog, Mellanox Technologies, December 12, 2016

Contact Us