The world faces exponential data growth. As a result, along with storage, computing, and networking, modern IT needs a new pillar of support: data movement at scale and speed. In response, Zettar Inc. delivers a GA-grade, scale-out, petascale-proven, all-in-one, multi-100+Gbps capable hyperscale data distribution software solution, Zettar zx, and aims to make it the foundation of this fourth pillar.
Unlike most other commercial data transfer software, Zettar zx has a modern, ground-breaking design capable of comfortably tackling the aforementioned exponential data growth. It establishes the brand new "hyperscale data distribution" category for modern digital businesses. zx supports both file and object storage. In addition, as a single application it efficiently tackles the following three "seeminly unrelated" data movement needs:
In March 2019, Zettar won the Supercomputing Asia 2019 (SCA19) Data Mover Challenge (DMC), a grueling 2-month long international competition at the highest level. The Zettar team beat out six other elite national teams from the U.S. and Japan (slide 17) by a wide margin.
Zettar is a revenue-supported startup in Palo Alto, California. It has also been awarded grants by both the U.S. National Science Foundation (NSF) and the Department of Energy (DOE) Office of Science.
Zettar zx's performance is unaffected by distance, encryption, and checksumming. This is the goal that numerous parties, both academic and commercial, have struggled to reach for decades but failed. The tremendous value to the business efficiency of all distributed data-intensive enterprises should be evident.
Zettar has deployed its solution at a large global biopharmaceutical company, an European Oil & Gas major, a US DOE Exascale Computing Project (ECP) project, a hyperscale Web property, a well-known research university, and more. Many use cases involve the moving of multiple petabytes of data over distance.
Each end only employs a modest two-node cluster consisting of two inexpensive 1U commodity servers with 4x10Gbps unbonded Ethernet ports (thus 2 x 4 x10Gbps = 80Gbps - the bandwidth cap)
With the same data transfer nodes as the 2017 trial, and the 4 AIC SB122A-PH 1U 10-bay storage servers updated with Intel E5-2699v4 CPUs along with 16 Intel Optane P4800X 375GB SSDs, Zettar transferred, with encryption and checksumming, one petabyte of data in just 29 hours over the same connection. The average transfer rate is 75Gbps, or 94% utilization of the available bandwidth.
The May 2017 trial results visualized
The September 2018 trial results visualized