Servers launch

• mysql.server start (/etc/my.cnf)
• redis-server redis.conf
• tarantool box.lua

Assumptions

Redis will run without background saves, it listens to localhost:6379. MySql has enough memory and database hs_test. There should be table table_test(int not null auto_increment primary key, str nvarchar(1024)).

It has installed handlersocket plugin, which listens to localhost:9998.

Anonymous access should be enabled.

How to run

1. First you should populate data:

   1. node ./data/redis.js
   2. node ./data/mysql.js
   3. node ./data/tarantool.js

2. Then you just run the test and watch.

Problems

1. node eats a lot CPU by itself. We are not pushing storages to its limits.

Tests

• redis - node-redis library with hiredis
• ioredis - ioredis library with hiredis
• node-handlersocket - node-handlersocket library
• manual-hs - fast and dirty implementation of handlersocket protocol
• tarantool - tarantool-driver library

Results

As we can see from results, not surprisingly, async model is much preferrable for node.js application. Also we see that recommended client for handler-socket can't hold pressure of 500K simultaneous requests and quickly degrade.

In general handlersocket is 4 times slower than redis.

Async test on MacBook Pro 15" early 2013

50k requests:

Forest:benchmarks aensidhe$ node async_test.js
Test 'redis' started
Storage created in 4.614309 ms
Test finished: 50000 ops, 1236.75095 ms, 40428.511496190884 ops/sec

Test 'ioredis' started
Storage created in 2.343461 ms
Test finished: 50000 ops, 813.621708 ms, 61453.62090068521 ops/sec

Test 'node-handlersocket' started
Storage created in 4.943459 ms
Test finished: 50000 ops, 5085.563309 ms, 9831.752543816381 ops/sec

Test 'manual-hs' started
Storage created in 7.801034 ms
Test finished: 50000 ops, 3023.930391 ms, 16534.77214581822 ops/sec

Done

500k requests:

Forest:benchmarks aensidhe$ node async_test.js
Test 'redis' started
Storage created in 4.516182 ms
Test finished: 500000 ops, 10070.649113 ms, 49649.232575739334 ops/sec

Test 'ioredis' started
Storage created in 2.35571 ms
Test finished: 500000 ops, 7759.632168 ms, 64436.04402563738 ops/sec

Test 'node-handlersocket' started
Storage created in 6.440065 ms
Test finished: 500000 ops, 160374.110811 ms, 3117.710193194756 ops/sec

Test 'manual-hs' started
Storage created in 7.724447 ms
Test finished: 500000 ops, 27941.814756 ms, 17894.328065883194 ops/sec

Done

Sync test on MacBook Pro 15" early 2013

Forest:benchmarks aensidhe$ ./test.js
Test 'redis' started
Storage created in 4.564661 ms
Test finished: 500000 ops, 39933.318153 ms, 12520.872873230981 ops/sec

Test 'ioredis' started
Storage created in 2.866795 ms
Test finished: 500000 ops, 47065.871785 ms, 10623.408874354498 ops/sec

Test 'node-handlersocket' started
Storage created in 6.182445 ms
Test finished: 500000 ops, 117044.578581 ms, 4271.876630782844 ops/sec

Test 'manual-hs' started
Storage created in 8.893891 ms
Test finished: 500000 ops, 94308.392798 ms, 5301.755073601504 ops/sec

Done