Тестирование веб-сервера при использовании CMS-системы Energine

Предположительно, система Energine по своим технологиям должна была быть быстрее аналогов. Однако, тесты показывают, что это совсем не так. Данная система оказалась значительно медленнее, чем Joomla (что говорить о phpNuke и Drupal), но всё же значительно быстрей, чем система Битрикс (хотя, в тестах был несоизмеримо разный объём информации...)

Вот результаты теста:

root@titan-r:~# ab -c 5 -n 100000 http://i1.kiev.ua/
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking i1.kiev.ua (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software: nginx/0.4.13
Server Hostname: i1.kiev.ua
Server Port: 80

Document Path: /
Document Length: 4023 bytes

Concurrency Level: 5
Time taken for tests: 4574.631725 seconds
Complete requests: 100000
Failed requests: 5
(Connect: 0, Length: 5, Exceptions: 0)
Write errors: 0
Non-2xx responses: 5
Total transferred: 446779435 bytes
HTML transferred: 402280850 bytes
Requests per second: 21.86 [#/sec] (mean)
Time per request: 228.732 [ms] (mean)
Time per request: 45.746 [ms] (mean, across all concurrent requests)
Transfer rate: 95.38 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 0 228 106.2 205 1613
Waiting: 0 227 106.1 204 1613
Total: 0 228 106.2 205 1613

Percentage of the requests served within a certain time (ms)
50% 205
66% 228
75% 240
80% 250
90% 296
95% 429
98% 591
99% 726
100% 1613 (longest request)

Тестирование веб-сервера при работе CMS-системы Drupal

Система Drupal имеет не сложную структура и работает довольно быстро.
Вот результаты тестирования веб-сервера на базе CMS-системы Drupal (тестировался сайт http://kiev2000.kiev.ua):

root@titan-r:~# ab -c 5 -n 100000 http://kiev2000.kiev.ua/
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking kiev2000.kiev.ua (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software: nginx/0.4.13
Server Hostname: kiev2000.kiev.ua
Server Port: 80

Document Path: /
Document Length: 12624 bytes

Concurrency Level: 5
Time taken for tests: 415.438090 seconds
Complete requests: 100000
Failed requests: 0
Write errors: 0
Total transferred: 1312500000 bytes
HTML transferred: 1262400000 bytes
Requests per second: 240.71 [#/sec] (mean)
Time per request: 20.772 [ms] (mean)
Time per request: 4.154 [ms] (mean, across all concurrent requests)
Transfer rate: 3085.27 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 11 20 7.5 19 153
Waiting: 10 19 7.4 18 152
Total: 11 20 7.5 19 153

Percentage of the requests served within a certain time (ms)
50% 19
66% 21
75% 24
80% 26
90% 31
95% 35
98% 39
99% 43
100% 153 (longest request)

Этот результат в 6-10 раз выще, чем в системе Joomla.

Тестирование одновременных соединений для статической страницы

На статической странице тест одновременных соединений тоже показывает прекрасные результаты. 300 одновременных коннектов, количество которое не проходило в Joomla на статике обработались с лёгкостью. При этом, все процессора были заняты лишь по 10-20%.

Результат тестирования на статической странице 300 одновременных коннектов:
root@titan-r:~# siege -d1 -t1M -c300 rudjuk.kiev.ua
** siege 2.65b1
** Preparing 300 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done. Transactions: 34910 hits
Availability: 100.00 %
Elapsed time: 59.80 secs
Data transferred: 846.01 MB
Response time: 0.01 secs
Transaction rate: 583.78 trans/sec
Throughput: 14.15 MB/sec
Concurrency: 3.33
Successful transactions: 35063
Failed transactions: 0
Longest transaction: 0.16
Shortest transaction: 0.00

Тут количество коннектов ограничено в основном оперативной памятью.

Тестирование получения 1 млн. статических страниц из сервера titan-r

Как и ожидалось, сервер с легкостью "расправился" с 1 млн. статических страниц.
Затратив всего лишь на это около 2,3 минуты!
При этом, процессора сервера были нагружены где-то на 60%. Т.е. оставались ресурсы и на другие задачи.

root@titan-r:~# ab -c 5 -n 1000000 http://www.rudjuk.kiev.ua/rus/programs.htm
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking www.rudjuk.kiev.ua (be patient)
Completed 100000 requests
Completed 200000 requests
Completed 300000 requests
Completed 400000 requests
Completed 500000 requests
Completed 600000 requests
Completed 700000 requests
Completed 800000 requests
Completed 900000 requests
Finished 1000000 requests


Server Software: nginx/0.4.13
Server Hostname: www.rudjuk.kiev.ua
Server Port: 80

Document Path: /rus/programs.htm
Document Length: 50823 bytes

Concurrency Level: 5
Time taken for tests: 139.518835 seconds
Complete requests: 1000000
Failed requests: 0
Write errors: 0
Total transferred: -481607552 bytes
HTML transferred: -716607552 bytes
Requests per second: 7167.49 [#/sec] (mean)
Time per request: 0.698 [ms] (mean)
Time per request: 0.140 [ms] (mean, across all concurrent requests)
Transfer rate: -3371.01 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 10
Processing: 0 0 0.2 0 51
Waiting: 0 0 0.2 0 51
Total: 0 0 0.2 0 51

Percentage of the requests served within a certain time (ms)
50% 0
66% 0
75% 0
80% 0
90% 0
95% 0
98% 0
99% 0
100% 51 (longest request)

Скорость веб-сервера при работе со статической страницей

Я предположил, что скорость статической страницы должна отличаться во много раз по сравнению с динамическими страницами. Т.к. статическая страница обрабатывается только веб-сервером NGINX и до Apache у нас даже не доходит.

Вот результаты проведённого теста на статической странице http://rudjuk.kiev.ua:
root@titan-r:~# ab -c 5 -n 100000 http://www.rudjuk.kiev.ua/rus/programs.htm
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking www.rudjuk.kiev.ua (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software: nginx/0.4.13
Server Hostname: www.rudjuk.kiev.ua
Server Port: 80

Document Path: /rus/programs.htm
Document Length: 50823 bytes

Concurrency Level: 5
Time taken for tests: 13.784814 seconds
Complete requests: 100000
Failed requests: 0
Write errors: 0
Total transferred: 810832704 bytes
HTML transferred: 787332704 bytes
Requests per second: 7254.36 [#/sec] (mean)
Time per request: 0.689 [ms] (mean)
Time per request: 0.138 [ms] (mean, across all concurrent requests)
Transfer rate: 57442.05 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 0 0 0.2 0 30
Waiting: 0 0 0.2 0 30
Total: 0 0 0.2 0 30

Percentage of the requests served within a certain time (ms)
50% 0
66% 0
75% 0
80% 0
90% 0
95% 0
98% 0
99% 0
100% 30 (longest request)

Как видно из результатов скорость статической страницы в 600-700 раз быстрее, чем скорость CMS-системы Битрикс. Скорость статической страницы быстрее в 200-250 раз системы Joomla (Joostina).

Следует предположить, что и огромное количество статических страниц обрабатывается за очень маленькое время. Сейчас проведем тест и увидим результаты.

Тестирование скорости веб-сервера при использовании CMS Битрикс

Провели тест на веб-сервере при работающей CMS-системе Битрикс.
Как и ожидалось скорость данной CMS-системы где-то в 3 раза меньше, чем в той же Joomla. Битрикс нагружает сервер очень сильно. Местами, даже тест вызвал переполнение :)

root@titan-r:~# ab -c 5 -n 100000 http://budmart.nerusoft.com/
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking budmart.nerusoft.com (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software: nginx/0.4.13
Server Hostname: budmart.nerusoft.com
Server Port: 80

Document Path: /
Document Length: 25847 bytes

Concurrency Level: 5
Time taken for tests: 9254.840333 seconds
Complete requests: 100000
Failed requests: 0
Write errors: 0
Total transferred: -1653067296 bytes
HTML transferred: -1710267296 bytes
Requests per second: 10.81 [#/sec] (mean)
Time per request: 462.742 [ms] (mean)
Time per request: 92.548 [ms] (mean, across all concurrent requests)
Transfer rate: -174.43 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 331 462 103.7 445 3993
Waiting: 317 446 102.6 430 3932
Total: 331 462 103.7 445 3993

Percentage of the requests served within a certain time (ms)
50% 445
66% 500
75% 533
80% 555
90% 610
95% 633
98% 658
99% 682
100% 3993 (longest request)

Производительность сайта на Joomla (Joostina)

Решил провести к предыдущему тесту (на системе phpNuke) тест на производительность сайта на баз системы Joomla (Joostina). Данный вариант сайта мы готовим для нашей торговой марки в замен существующего http://nerusoft.com

Результаты теста:
root@titan-r:~# ab -c 5 -n 100000 http://3r.kiev.ua/
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking 3r.kiev.ua (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software: nginx/0.4.13
Server Hostname: 3r.kiev.ua
Server Port: 80

Document Path: /
Document Length: 10422 bytes

Concurrency Level: 5
Time taken for tests: 3487.360345 seconds
Complete requests: 100000
Failed requests: 9951
(Connect: 0, Length: 9951, Exceptions: 0)
Write errors: 0
Total transferred: 1089389537 bytes
HTML transferred: 1042189537 bytes
Requests per second: 28.67 [#/sec] (mean)
Time per request: 174.368 [ms] (mean)
Time per request: 34.874 [ms] (mean, across all concurrent requests)
Transfer rate: 305.06 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 116 173 44.4 168 402
Waiting: 112 167 43.9 162 397
Total: 116 173 44.4 168 402

Percentage of the requests served within a certain time (ms)
50% 168
66% 193
75% 209
80% 219
90% 234
95% 247
98% 269
99% 284
100% 402 (longest request)


Как видно из теста, вариант Joomla у нас более "тяжелый" и длится несколько дольше, чем в случае с phpNuke. Следующий тест мы проведём ещё на системе Битрикс.

Запрос 100 тыс. страниц с сервера titan-r сайта http://nerusoft.com

Запрос 100 тыс. страниц с сервера titan-r сайта http://nerusoft.com:

root@titan-r:~# ab -c 5 -n 100000 http://nerusoft.com/
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking nerusoft.com (be patient)
Completed 10000 requests
Completed 20000 requests
Completed 30000 requests
Completed 40000 requests
Completed 50000 requests
Completed 60000 requests
Completed 70000 requests
Completed 80000 requests
Completed 90000 requests
Finished 100000 requests


Server Software: nginx/0.4.13
Server Hostname: nerusoft.com
Server Port: 80

Document Path: /
Document Length: 94796 bytes

Concurrency Level: 5
Time taken for tests: 3192.320346 seconds
Complete requests: 100000
Failed requests: 0
Write errors: 0
Total transferred: 915365408 bytes
HTML transferred: 889665408 bytes
Requests per second: 31.33 [#/sec] (mean)
Time per request: 159.616 [ms] (mean)
Time per request: 31.923 [ms] (mean, across all concurrent requests)
Transfer rate: 280.02 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 107 159 37.4 154 389
Waiting: 105 156 37.2 152 386
Total: 107 159 37.4 154 389

Percentage of the requests served within a certain time (ms)
50% 154
66% 173
75% 185
80% 192
90% 208
95% 225
98% 248
99% 264
100% 389 (longest request)

Проведение нагрузочного тестирования нашего сервера titan-r

С целью проверки устойчивости нашего сервера к пиковым нагрузкам было проведено ряд тестов. Ниже, мы приводим результаты данных тестов:

Тестирование проводилось на сайте, построенном на CMS-системе php-Nuke торговой марки RS™ http://nerusoft.com.

===== Тестирование с помощью Apache Benchmark =====
# Измерение памяти (ps aux: VSZ "virtual set size" и RSS "resident set size").
# Тестирование ApacheBenchmark (2 раза подряд)

root@titan-r:~# ab -c 5 -n 1000 http://nerusoft.com/
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking nerusoft.com (be patient)
Completed 100 requests
Completed 200 requests
Completed 300 requests
Completed 400 requests
Completed 500 requests
Completed 600 requests
Completed 700 requests
Completed 800 requests
Completed 900 requests
Finished 1000 requests


Server Software: nginx/0.4.13
Server Hostname: nerusoft.com
Server Port: 80

Document Path: /
Document Length: 94796 bytes

Concurrency Level: 5
Time taken for tests: 31.881701 seconds
Complete requests: 1000
Failed requests: 0
Write errors: 0
Total transferred: 95053000 bytes
HTML transferred: 94796000 bytes
Requests per second: 31.37 [#/sec] (mean)
Time per request: 159.409 [ms] (mean)
Time per request: 31.882 [ms] (mean, across all concurrent requests)
Transfer rate: 2911.54 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.0 0 0
Processing: 109 158 37.3 153 313
Waiting: 107 156 37.1 150 310
Total: 109 158 37.3 153 313

Percentage of the requests served within a certain time (ms)
50% 153
66% 172
75% 185
80% 191
90% 208
95% 224
98% 249
99% 267
100% 313 (longest request)


=================================================
# Измерение памяти и израсходованного процессорного времени (ps aux: VSZ, RSS, %CPU, %MEM)
# Перезапуск фреймворка
# Тестирование ApacheBenchmark (2 раза подряд)
ab -c 100 -n 10000 http://nerusoft.com/

root@titan-r:~# ab -c 100 -n 10000 http://nerusoft.com/
This is ApacheBench, Version 2.0.40-dev <$Revision: 1.146 $> apache-2.0
Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
Copyright 2006 The Apache Software Foundation, http://www.apache.org/

Benchmarking nerusoft.com (be patient)
Completed 1000 requests
Completed 2000 requests
Completed 3000 requests
Completed 4000 requests
Completed 5000 requests
Completed 6000 requests
Completed 7000 requests
Completed 8000 requests
Completed 9000 requests
Finished 10000 requests


Server Software: nginx/0.4.13
Server Hostname: nerusoft.com
Server Port: 80

Document Path: /
Document Length: 94796 bytes

Concurrency Level: 100
Time taken for tests: 258.190002 seconds
Complete requests: 10000
Failed requests: 0
Write errors: 0
Total transferred: 950530000 bytes
HTML transferred: 947960000 bytes
Requests per second: 38.73 [#/sec] (mean)
Time per request: 2581.900 [ms] (mean)
Time per request: 25.819 [ms] (mean, across all concurrent requests)
Transfer rate: 3595.22 [Kbytes/sec] received

Connection Times (ms)
min mean[+/-sd] median max
Connect: 0 0 0.3 0 4
Processing: 199 2572 1352.8 2296 38015
Waiting: 196 2564 1350.7 2290 38012
Total: 203 2572 1352.8 2296 38015

Percentage of the requests served within a certain time (ms)
50% 2296
66% 2584
75% 2809
80% 2979
90% 3481
95% 3974
98% 4784
99% 6141
100% 38015 (longest request)




======= Тестирование с помощью http_load ===========
# Измерение памяти и израсходованного процессорного времени.
# Перезапуск фреймворка
# Измерение http_load

http_load -rate 10 -seconds 5 nerusoft.com


======== Тестирование с помощью siege ===========
# Измерение памяти и израсходованного процессорного времени.
# Перезапуск фреймворка
# Тест Siege c 50 одновременными пользователями в течении одной минуты.
siege -d1 -t1M -c50 nerusoft.com

root@titan-r:~# siege -d1 -t1M -c50 nerusoft.com
** siege 2.65b1
** Preparing 50 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 2312 hits
Availability: 100.00 %
Elapsed time: 60.57 secs
Data transferred: 209.03 MB
Response time: 0.79 secs
Transaction rate: 38.17 trans/sec
Throughput: 3.45 MB/sec
Concurrency: 30.30
Successful transactions: 2312
Failed transactions: 0
Longest transaction: 8.86
Shortest transaction: 0.20

================================================
# Тест Siege c 100 одновременными пользователями в течении одной минуты.
siege -d1 -t1M -c100 nerusoft.com

root@titan-r:/etc/apache2# siege -d1 -t1M -c100 nerusoft.com
** siege 2.65b1
** Preparing 100 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 2318 hits
Availability: 100.00 %
Elapsed time: 60.48 secs
Data transferred: 209.56 MB
Response time: 2.02 secs
Transaction rate: 38.33 trans/sec
Throughput: 3.46 MB/sec
Concurrency: 77.44
Successful transactions: 2318
Failed transactions: 0
Longest transaction: 23.29
Shortest transaction: 0.25

======================================================
# Тест Siege c 150 одновременными пользователями в течении одной минуты.
siege -d1 -t1M -c150 nerusoft.com

root@titan-r:/etc/apache2# siege -d1 -t1M -c150 nerusoft.com
** siege 2.65b1
** Preparing 150 concurrent users for battle.
The server is now under siege...
Lifting the server siege.. done.
Transactions: 2337 hits
|Availability: 100.00 %
Elapsed time: 60.47 secs
Data transferred: 211.28 MB
Response time: 3.24 secs
Transaction rate: 38.65 trans/sec
Throughput: 3.49 MB/sec
Concurrency: 125.19
Successful transactions: 2337
Failed transactions: 0
Longest transaction: 25.83
Shortest transaction: 0.26


======================================================
# Тест Siege c 200 одновременными пользователями в течении одной минуты.

siege -d1 -t1M -c200 nerusoft.com

root@titan-r:/etc/nginx# siege -d1 -t1M -c200 nerusoft.com
** siege 2.65b1
** Preparing 200 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 2317 hits
Availability: 100.00 %
Elapsed time: 59.80 secs
Data transferred: 209.47 MB
Response time: 4.41 secs
Transaction rate: 38.75 trans/sec
Throughput: 3.50 MB/sec
Concurrency: 170.79
Successful transactions: 2317
Failed transactions: 0
Longest transaction: 25.17
Shortest transaction: 0.32