github.com/alibaba/sealer@v0.8.6-0.20220430115802-37a2bdaa8173/applications/strimzi-kafka/README.md (about)

     1  # Send and receive messages
     2  
     3  ```
     4  kubectl -n kafka run kafka-producer -ti --image=quay.io/strimzi/kafka:0.28.0-kafka-3.1.0 --rm=true --restart=Never -- bin/kafka-console-producer.sh --bootstrap-server my-cluster-kafka-bootstrap:9092 --topic my-topic
     5  ```
     6  
     7  Open other terminal:
     8  
     9  ```
    10  kubectl -n kafka run kafka-consumer -ti --image=quay.io/strimzi/kafka:0.28.0-kafka-3.1.0 --rm=true --restart=Never -- bin/kafka-console-consumer.sh --bootstrap-server my-cluster-kafka-bootstrap:9092 --topic my-topic --from-beginning
    11  ```
    12  
    13  ## Benchmark
    14  
    15  ## hardware
    16  
    17  3 nodes
    18  6 Core Intel Xenon 2.5GHz
    19  6*7200RPM SATA
    20  32G RAM
    21  1Gb Ethernet
    22  
    23  no RAID JBOD style
    24  
    25  ## no comsumer,  all messages are persisted but not read
    26  
    27  821,557 records/sec
    28  78.3 MB/sec
    29  
    30  ## Single producer thread, 3x asynchronous replication
    31  
    32  786,980 records/sec
    33  75.1 MB/sec
    34  
    35  ## Single producer thread, 3x synchronous replication
    36  
    37  421,823 records/sec
    38  40.2 MB/sec
    39  
    40  ## Three producers, 3x async replication
    41  
    42  2,024,032 records/sec
    43  193.0 MB/sec
    44  
    45  we perform just as well after writing a TB of data, as we do for the first few hundred MBs
    46  
    47  ## Single Consumer
    48  
    49  940,521 records/sec
    50  89.7 MB/sec
    51  
    52  ## Three Consumers
    53  
    54  2,615,968 records/sec
    55  249.5 MB/sec
    56  
    57  ## Producer and Consumer
    58  
    59  795,064 records/sec
    60  75.8 MB/sec
    61  
    62  ## Effect of Message Size
    63  
    64  the raw count of records we can send per second decreases as the records get bigger. But if we look at MB/second, we see that the total byte throughput of real user data increases as messages get bigger
    65  
    66  ## End-to-end Latency
    67  
    68  2 ms (median)
    69  3 ms (99th percentile)
    70  14 ms (99.9th percentile)