THE HYPERSCALE DATA DISTRIBUTION SOFTWARE PLATFORM

10GB per sec
1000X faster than FTP
10min setup

About Zettar

Zettar Inc. delivers a GA-grade, scale-out, petascale-proven, all-in-one hyperscale data distribution software solution capable of multi-100+Gbps. We help businesses defy data gravity and realize data agility. Modern IT is driven by the four giants: storage, computing, networking, and hyperscale data distribution. Zettar aims to be at the heart of the 4th giant. It is a critical enabler of large scale enterprise digital transformations.

Unlike all other commercial data transfer software, all of which belong to the legacy (decade+ old) Managed File Transfer (MFT) category, Zettar zx has a ground breaking design and establishes the brand new "hyperscale data distribution" category for modern digital businesses. Zettar is a US National Science Foundation (NSF) funded startup in Palo Alto, California.

Zettar zx is the world's only data transfer software whose performance is unaffected by distance, encryption, and checksumming. This is a Holy Grail that numerous parties, both academic and commercial, have tried hard to find for decades, but all have failed. The tremendous value to the business efficiency of all distributed data-intensive enterprises should be evident.

Zettar has deployed its solution at a large global biopharmaceutical company, a US DOE Exascale Computing Project (ECP) project, a hyperscale Web property, a well-known research university, and more. Many use cases involve the moving of multiple petabytes of data over distance.

May 2017 Zettar Moves Petabyte Datasets at Unprecedented Speed via ESnet

Each end only employs a modest two-node cluster consisting of two inexpensive 1U commodity servers with 4x10Gbps unbonded Ethernet ports (thus 2 x 4 x10Gbps = 80Gbps - the bandwidth cap)

September 2018, with the same data transfer nodes as the 2017 trial, and the 4 AIC SB122A-PH 1U 10-bay storage servers updated with Intel E5-2699v4 CPUs along with 16 Intel Optane P4800X 375GB SSDs, Zettar transferred, with encryption and checksumming, one petabyte of data in just 29 hours over the same connection. The average transfer rate is 75Gbps, or 94% utilization of the available bandwidth.

The May 2017 trial results visualized

Zettar zx generated 1/3 plus of ESnet traffic

The September 2018 trial results visualized

Zettar zx generated 1/3 plus of ESnet traffic again

News & Publications

  1. Press release, Zettar Transferred, with Encryption, One Petabyte of Data in Just 29 Hours Using AIC Servers, October 04, 2018
  2. Chin Fang, Dealing With Fast Growing Data With Hyperscale Data Distribution, Bio-IT World, Contributed commentary, August 17, 2018
  3. Les Cottrell, Chin Fang, Andy Hanushevsky, Wilko Kreoger, Wei Yang, High Performance Data Transfer, Journal of Physics: Conference Series, Volume 898, Track 4: Data Handling, November 2017
  4. Professor Vijay Mehrotra, ANALYZE THIS!: Mathematical modeling gives way to interesting analytics topics, Analytics Magazine, Nov 15, 2017
  5. Les Cottrell, Riccardo Veraldi, Chin Fang, CT Sun, Featured Talks in the DOE booth (Booth 613) SC17, Denver, CO, Wednesday, Nov. 15 10:45 a.m.
  6. Intel WHITE PAPER, Data Center, Intel® SSD DC P3700 Series, Hyperscale, Dependable Data Transfer with the Intel® SSD DC P3700 Series, September 21, 2017
  7. Network Matters: Updates from DOE's Energy Sciences Network, SLAC, AIC and Zettar Move Petabyte Datasets at Unprecedented Speed via ESnet, July 26, 2017
  8. Rich Bruecker, InsideHPC article, How Zettar Transferred 1 Petabyte of Data in Just 34 Hours Using AIC Servers, June 24, 2017
  9. Press release, Zettar Transferred 1 Petabyte of Data in Just 34 Hours Using AIC Servers, May 24, 2017
  10. Chin Fang, Les Cottrell, High Performance PetaByte Transfer (PB-SLAC-LesCottrell.pdf - restricted to US DOE audience only), ESNet Site Coordinators Commitee, May 2nd, 2017, Berkeley, California
  11. Andrey Kudryavtsev, Chin Fang, “Transferring data at 100Gbps and beyond for distributed data-intensive engineering and sciences”, Intel IT Peer Network article, November 2016
  12. Chin Fang, “Using AIC SB122A-PH 1U 10-Bay NVMe Storage Servers as the Building Blocks of High-Performance Scale-out Storage for HPC Applications”, white paper commissioned by AIC with Intel’s participation, November 2016
  13. Les Cottrell, Chin Fang, Andy Hanushevsky, Wilko Kreoger, Wei Yang, “High Performance Data Transfer”, CHEP 16, October 10-14, San Francisco, California
  14. Chin Fang, Les Cottrell, Andy Hanushevsky, Wilko Kreoger, Wei Yang, “High Performance Data Transfer for Distributed Data Intensive Sciences”, SLAC Technical Note: SLAC-TN-16-001, September 2016, SLAC National Accelerator Laboratory, Menlo Park, California
  15. Les Cottrell, Antonio Ceseracciu, Chin Fang , “Zettar Data Transfer Node Appliance testing" (zettar_escc-spring16.pptx - restricted to US DOE audience only), ESNet Site Coordinators Committee, Spring 2016, Berkeley, California
  16. Les Cottrell, Antonio Ceseracciu, Chin Fang , “Zettar Data Transfer Node Appliance testing” (zettar_fq.pptx - restricted to US DOE audience only), ESNet Site Coordinators Committee, September 2015, Austin, Texas
  17. Chin Fang, R. “Les” A. Cottrell, “An Overview of High-performance Parallel Big Data transfers over multiple network channels with Transport Layer Security (TLS) and TLS plus Perfect Forward Secrecy (PFS)”, SLAC Technical Note: SLAC-TN-15-002, April 25, 2015
  18. Chin Fang, “Using NVMe Gen3 PCIe SSD Cards in High-density Servers for High-performance Big Data Transfer Over Multiple Network Channels”, SLAC Technical Note: SLAC-TN-15-001, February 24, 2015
  19. Scot Schultz, "Mellanox and Zettar Crush World Record LOSF Performance Using ESnet OSCARS Test Circuit" Mellanox blog, Mellanox Technologies, December 12, 2016

Contact Us