About Zettar
Zettar Inc. delivers a GA-grade, scale-out, petascale-proven, all-in-one hyperscale data distribution software solution capable of multi-100+Gbps. We help businesses defy data gravity and realize data agility. Modern IT is driven by the four giants: storage, computing, networking, and hyperscale data distribution. Zettar aims to be at the heart of the 4th giant. It is a critical enabler of large scale enterprise digital transformations.
Unlike all other commercial data transfer software, all of which belong to the legacy (decade+ old) Managed File Transfer (MFT) category, Zettar zx has a ground breaking design and establishes the brand new "hyperscale data distribution" category for modern digital businesses. Zettar is a US National Science Foundation (NSF) funded startup in Palo Alto, California.
Zettar zx is the world's only data transfer software whose performance is unaffected by distance, encryption, and checksumming. This is a Holy Grail that numerous parties, both academic and commercial, have tried hard to find for decades, but all have failed. The tremendous value to the business efficiency of all distributed data-intensive enterprises should be evident.
Zettar has deployed its solution at a large global biopharmaceutical company, a US DOE Exascale Computing Project (ECP) project, a hyperscale Web property, a well-known research university, and more. Many use cases involve the moving of multiple petabytes of data over distance.
May 2017 Zettar Moves Petabyte Datasets at Unprecedented Speed via ESnet
Each end only employs a modest two-node cluster consisting of two inexpensive 1U commodity servers with 4x10Gbps unbonded Ethernet ports (thus 2 x 4 x10Gbps = 80Gbps - the bandwidth cap)
September 2018 ESnet's Network, Software Help SLAC Researchers in Record-Setting Transfer of 1 Petabyte of Data
With the same data transfer nodes as the 2017 trial, and the 4 AIC SB122A-PH 1U 10-bay storage servers updated with Intel E5-2699v4 CPUs along with 16 Intel Optane P4800X 375GB SSDs, Zettar transferred, with encryption and checksumming, one petabyte of data in just 29 hours over the same connection. The average transfer rate is 75Gbps, or 94% utilization of the available bandwidth.
The May 2017 trial results visualized
The September 2018 trial results visualized
News & Publications
- Press release, BeeGFS based burst buffer enables world record hyperscale data distribution, Oct 25, 2018
- Machine Design, DoE Tests Newest Information Superhighway, October 23, 2018
- ESnet News & Publications, ESnet's Network, Software Help SLAC Researchers in Record-Setting Transfer of 1 Petabyte of Data, OCTOBER 17, 2018
- InsideHPC article, Big Data over Big Distance: Zettar Moves a Petabyte over 5000 Miles in 29 Hours, October 5, 2018
- Press release, Zettar Transferred, with Encryption, One Petabyte of Data in Just 29 Hours Using AIC Servers, October 04, 2018
- Chin Fang, Dealing With Fast Growing Data With Hyperscale Data Distribution, Bio-IT World, Contributed commentary, August 17, 2018
- Les Cottrell, Chin Fang, Andy Hanushevsky, Wilko Kreoger, Wei Yang, High Performance Data Transfer, Journal of Physics: Conference Series, Volume 898, Track 4: Data Handling, November 2017
- Professor Vijay Mehrotra, ANALYZE THIS!: Mathematical modeling gives way to interesting analytics topics, Analytics Magazine, Nov 15, 2017
- Les Cottrell, Riccardo Veraldi, Chin Fang, CT Sun, Featured Talks in the DOE booth (Booth 613) SC17, Denver, CO, Wednesday, Nov. 15 10:45 a.m.
- Intel WHITE PAPER, Data Center, Intel® SSD DC P3700 Series, Hyperscale, Dependable Data Transfer with the Intel® SSD DC P3700 Series, September 21, 2017
- Network Matters: Updates from DOE's Energy Sciences Network, SLAC, AIC and Zettar Move Petabyte Datasets at Unprecedented Speed via ESnet, July 26, 2017
- Rich Bruecker, InsideHPC article, How Zettar Transferred 1 Petabyte of Data in Just 34 Hours Using AIC Servers, June 24, 2017
- Press release, Zettar Transferred 1 Petabyte of Data in Just 34 Hours Using AIC Servers, May 24, 2017
- Chin Fang, Les Cottrell, High Performance PetaByte Transfer (PB-SLAC-LesCottrell.pdf - restricted to US DOE audience only), ESNet Site Coordinators Commitee, May 2nd, 2017, Berkeley, California
- Andrey Kudryavtsev, Chin Fang, “Transferring data at 100Gbps and beyond for distributed data-intensive engineering and sciences”, Intel IT Peer Network article, November 2016
- Chin Fang, “Using AIC SB122A-PH 1U 10-Bay NVMe Storage Servers as the Building Blocks of High-Performance Scale-out Storage for HPC Applications”, white paper commissioned by AIC with Intel’s participation, November 2016
- Les Cottrell, Chin Fang, Andy Hanushevsky, Wilko Kreoger, Wei Yang, “High Performance Data Transfer”, CHEP 16, October 10-14, San Francisco, California
- Chin Fang, Les Cottrell, Andy Hanushevsky, Wilko Kreoger, Wei Yang, “High Performance Data Transfer for Distributed Data Intensive Sciences”, SLAC Technical Note: SLAC-TN-16-001, September 2016, SLAC National Accelerator Laboratory, Menlo Park, California
- Les Cottrell, Antonio Ceseracciu, Chin Fang , “Zettar Data Transfer Node Appliance testing" (zettar_escc-spring16.pptx - restricted to US DOE audience only), ESNet Site Coordinators Committee, Spring 2016, Berkeley, California
- Les Cottrell, Antonio Ceseracciu, Chin Fang , “Zettar Data Transfer Node Appliance testing” (zettar_fq.pptx - restricted to US DOE audience only), ESNet Site Coordinators Committee, September 2015, Austin, Texas
- Chin Fang, R. “Les” A. Cottrell, “An Overview of High-performance Parallel Big Data transfers over multiple network channels with Transport Layer Security (TLS) and TLS plus Perfect Forward Secrecy (PFS)”, SLAC Technical Note: SLAC-TN-15-002, April 25, 2015
- Chin Fang, “Using NVMe Gen3 PCIe SSD Cards in High-density Servers for High-performance Big Data Transfer Over Multiple Network Channels”, SLAC Technical Note: SLAC-TN-15-001, February 24, 2015
- Scot Schultz, "Mellanox and Zettar Crush World Record LOSF Performance Using ESnet OSCARS Test Circuit" Mellanox blog, Mellanox Technologies, December 12, 2016