Compare MinIO vs OpenIO performance using SBK

[kmgowda]

Describe the Issue (Bug/Feature)
Compare MinIO and OpenIO performance using SBK

To Reproduce
make the MinIO and OpenIO 3 nodes setup at least for baremetal setup

use option "-class MinIO" for MinIO performance benchmarking
use option "-class OpenIO" for Redpanda for performance benchmarking
while running sbk use option "-csvfile " to store the results in csv file
use the csv files containing the performance results of MinIO and OpenIO as inputs to sbk-charts to generate the excel file with graphs.

Expected behavior
performance result graphs in grafana or in excel file

Additional context
for Minio examples refer here : https://github.com/kmgowda/SBK/tree/master/driver-minio
for openio example refer here: https://github.com/kmgowda/SBK/tree/master/driver-openio
for sbk-charts examples refer here: https://github.com/kmgowda/SBK#sbk-charts
for grafana examples refer here: https://github.com/kmgowda/SBK#grafana-dashboards-of-sbk

[Amartya-Mahato]

@kmgowda Hi sir i tried both method, right now i have all separate .xlsx and .csv for both Read benchmark and Write benchmark

i also tried grafana to get performance benchmark from my side, from there i created 2 .json files, which showing my results after importing them again in grafana.

how can i share or help with this issure.

[kmgowda]

@Amartya-Mahato Awesome.. please share all the results in this issue.. Also, please share your test setup details also

[Amartya-Mahato]

@kmgowda Sorry for the late, my health was not good.
By test setup details did you mean all steps i went through to get results??

[Amartya-Mahato]

Grafna Results are little different from .xlsx files because i took Grafna results first.

1. Grafna Results snapshot ( recommended ) and i was unable to attach Jason files to this issue, that's why i am attaching direct links.

SBK_MINIO_Benchmark-1647893947525.json	Download
SBK_OPENIO_Benchmark-1647893936911.json	Download

2. Excel Results, you can view results in google sheets or can download it.

OpenIO_Writer_Benchmarks.xlsx	View	Download
OpenIO_Reader_Benchmarks.xlsx	View	Download
MinIO_Writer_Benchmarks.xlsx	View	Download
MinIO_Reader_Benchmarks.xlsx	View	Download

[kmgowda]

@Amartya-Mahato These results are good.. but you should use the sbk-charts application to generate the graphs.
first you should do the benchmarking of openio and minio to generate the .csv files and then these csv files should be supplied to sbk-charts application. Refer to the documents here : https://github.com/kmgowda/SBK/blob/master/sbk-charts.md

[Amartya-Mahato]

After using sbk-charts application new Excel results.

minio_reader_benchmarks.xlsx	Download
minio_writer_benchmarks.xlsx	Download
openio_reader_benchmarks.xlsx	Download
openio_writer_benchmarks.xlsx	Download

[Amartya-Mahato]

Do i have to attach new grafana results again??

[kmgowda]

@Amartya-Mahato The openio and mino numbers need to combined into one xls file; its easy supply both CSV file (1- containting openio results and 2- containing minio results ) to sbk-charts , it will draw graph comparing both openio and minio results.
you have to create to xls files one for comparing openio and minio write operation and another one for comparing read operations.

[Amartya-Mahato]

@kmgowda please check if it's the right format.

openio_minio_reader_results.xlsx	Download
openio_minio_writer_results.xlsx	Download

[kmgowda]

yes this is correct .. please give you test setup details on how you made openio and minio working in your setup?

[Amartya-Mahato]

• For MinIO performance benchmarking following commands were working perfectly fine, with option -csvfile.

1. To get write benchmarks.

./build/install/sbk/bin/sbk -class minio -writers 1 -size 100 -seconds 60 -csvfile file_name_write.csv

2. To get read benchmarks.

./build/install/sbk/bin/sbk -class minio -readers 1 -size 100 -seconds 60 -csvfile file_name_read.csv

---

• For OpenIO performance benchmarking i used docker image and deployed OpenIO first.

As per OpenIO Documentation following commands i used to set it up.

1. To pull Docker Image

docker pull openio/sds:20.04

2. To run image and map the oioswift port ( here i used -d option for detached mode )

docker run -d --name oio-sds -p 6007:6007 openio/sds

i also used this command to know private IP docker inspect -f '{{ .NetworkSettings.IPAddress }}' oio-sds
that's how i set up OpenIO image in my system.

• After that i used following commands to get benchmarking in .csv files.

1. To get write benchmarks.

./build/install/sbk/bin/sbk -class openio -url http://127.0.0.1:6007  -writers 1 -size 100 -seconds 60 -csvfile OpenIo_file_name_write.csv

2. To get read benchmarks.

./build/install/sbk/bin/sbk -class openio -url http://127.0.0.1:6007  -readers 1 -size 100 -seconds 60 -csvfile OpenIO_file_name_read.csv

---

• At last i used sbk-chart application to create .xlsx files.