Performance Download

Download performance examples using the CLI interface to extract PCAP data to downstream systems.

Please use "stream_dump" to list all captures which can be used with

sudo stream_cat -v  <capture name> |  ....

the output of stream_cat is a standard PCAP via the stdout pipe

NOTE: throughput is heavily dependent on the packet size mix of the capture. Lager packet sizes get a better over all throughput

Transport

Physical

Interface

64B

Packet

9200B Jumbo

Packet

IMIX

Packet

Local File System

local

8.8Gbps

Local File System (rclone)

local

2.4Gbps

NFS Remote

10G

5.4Gbps

SSH Pipe

1G

0.48Gbps

SSH Pipe

10G

048Gbps

SSH Pipe (arcfour)

10G

1.2Gbps

NetCat TCP

10G

8.8Gbps

HTTP localhost

local

6.2Gbps

HTTPS localhost

local

3.3Gbps

HTTP remote

1G

0.9Gbps

HTTP remote

10G

4.0Gbps

HTTP remote (MTU 9182)

10G

4.4Gbps

HTTPS remote

10G

1.7Gbpbs

S3 (MINIO Server)

10G

2.4Gbps

Manual local file system

Standard pipe to file = 8.8Gbps using linux pipe to file

Manual Rclone local file system

local file system writes ~ 2.4Gbps

Manual NFS remote filesystem (10G Management)

Commands to write data to an NFS share over a 10G management interface ~ 5Gbps throughput

Manual SSH (1G Management)

Stock SSH over 1G management port = 0.48Gbps

Manual SSH (10G Management)

Stock SSH over 10G management port also ~ 0.48 Gbps

Manual SSH arcfour (10G Management)

Using arcfour cipher "-c arcfour" performance is about 1.2Gbps

Manual unencrypted TCP netcat (10G Management)

using netcat on a 10G Management interface over TCP results in near line rate throughput

HTTP on local host

local host HTTP download ~ 6.2Gbps

HTTPS on local host

local host HTTPS download = 3.3Gbps

HTTP on remote 1G

1G link is the bottleneck ~ 0.9Gbps

HTTP on remote 10G (MTU 1500)

10G link HTTP download ~ 4.0 Gbps

HTTP on remote 10G (MTU 9182)

10G HTTP download ~ 4.4Gbps

HTTPS on remote 10G

10G link HTTPS download ~ 1.7Gbps

netcat remote 10G (1500 MTU)

Remove NGINX web server from the setup, throughput only slightly faster 4.8Gbps

S3 HTTP Push rclone (Minio S3 Server 10G)

Push over HTTP (S3 EP is HTTP ) using a 10G interface

Last updated

Was this helpful?