add benchmark to README

Author: tony612

README.md

@@ -123,6 +123,12 @@ Check [examples](examples) and [interop](interop)(Interoperability Test) for som
 - [x] Data compression
 - [x] Support other encoding(other than protobuf)
 
+## Benchmark
+
+1. [Simple benchmark](examples/helloworld/README.md#Benchmark) by using [ghz](https://ghz.sh/)
+
+2. [Benchmark](benchmark) followed by official spec
+
 ## Sponsors
 
 This project is being sponsored by [Tubi](https://tubitv.com/). Thank you!

benchmark/README.md

@@ -7,6 +7,41 @@ Benchmark implementation followed by [official spec](https://grpc.io/docs/guides
 ```
 $ git clone https://github.com/tony612/grpc.git
 $ cd grpc && git checkout -t origin/elixir-bench
-$ export ELIXIR_GRPC_PATH=$(dirname $(pwd))
+$ git submodule update --init
+$ export ELIXIR_GRPC_PATH= # elixir-grpc path
 $ python tools/run_tests/run_performance_tests.py -l elixir
 ```
+
+## Result
+
+```
+# Elixir
+# Branch improve-perf
+I0707 13:04:20.222163000 4618786240 report.cc:82]                      QPS: 3070.4
+I0707 13:04:20.224064000 4618786240 report.cc:122]                     QPS: 3070.4 (255.9/server core)
+I0707 13:04:20.224079000 4618786240 report.cc:127]                     Latencies (50/90/95/99/99.9%-ile): 305.0/406.1/469.6/733.8/1730.8 us
+I0707 13:04:20.224088000 4618786240 report.cc:137]                     Server system time: 4.72%
+I0707 13:04:20.224097000 4618786240 report.cc:139]                     Server user time:   47.32%
+I0707 13:04:20.224104000 4618786240 report.cc:141]                     Client system time: 7.93%
+I0707 13:04:20.224112000 4618786240 report.cc:143]                     Client user time:   94.19%
+I0707 13:04:20.224119000 4618786240 report.cc:148]                     Server CPU usage: 0.00%
+I0707 13:04:20.224126000 4618786240 report.cc:153]                     Client Polls per Request: 0.00
+I0707 13:04:20.224134000 4618786240 report.cc:155]                     Server Polls per Request: 0.00
+I0707 13:04:20.224142000 4618786240 report.cc:160]                     Server Queries/CPU-sec: 5899.79
+I0707 13:04:20.224149000 4618786240 report.cc:162]                     Client Queries/CPU-sec: 3006.81
+
+# Go
+# It seems there are some problems with Go's benchmark because there's no CPU related metrics
+I0707 12:36:06.782124000 4488484288 report.cc:82]                      QPS: 9525.8
+I0707 12:36:06.783670000 4488484288 report.cc:122]                     QPS: 9525.8 (793.8/server core)
+I0707 12:36:06.783688000 4488484288 report.cc:127]                     Latencies (50/90/95/99/99.9%-ile): 93.8/118.7/139.0/247.9/526.0 us
+I0707 12:36:06.783698000 4488484288 report.cc:137]                     Server system time: 0.00%
+I0707 12:36:06.783707000 4488484288 report.cc:139]                     Server user time:   0.00%
+I0707 12:36:06.783750000 4488484288 report.cc:141]                     Client system time: 0.00%
+I0707 12:36:06.783758000 4488484288 report.cc:143]                     Client user time:   0.00%
+I0707 12:36:06.783764000 4488484288 report.cc:148]                     Server CPU usage: 0.00%
+I0707 12:36:06.783771000 4488484288 report.cc:153]                     Client Polls per Request: 0.00
+I0707 12:36:06.783777000 4488484288 report.cc:155]                     Server Polls per Request: 0.00
+I0707 12:36:06.783783000 4488484288 report.cc:160]                     Server Queries/CPU-sec: inf
+I0707 12:36:06.783790000 4488484288 report.cc:162]                     Client Queries/CPU-sec: inf
+```

examples/helloworld/README.md

@@ -39,3 +39,30 @@ Change the config to:
 ```elixir
 config :grpc, start_server: true
 ```
+
+## Benchmark
+
+Using [ghz](https://ghz.sh/)
+
+```
+$ MIX_ENV=prod iex -S mix
+# Now cowboy doesn't work well with concurrency
+$ ghz --insecure --proto priv/protos/helloworld.proto --call helloworld.Greeter.SayHello -d '{"name":"Joe"}' -z 10s  --concurrency 6 --connections 6 127.0.0.1:50051
+# The result is for branch improve-perf
+Summary:
+  Count:	124239
+  Total:	10.00 s
+  Slowest:	18.85 ms
+  Fastest:	0.18 ms
+  Average:	0.44 ms
+  Requests/sec:	12423.71
+
+# Go
+Summary:
+  Count:	258727
+  Total:	10.00 s
+  Slowest:	5.39 ms
+  Fastest:	0.09 ms
+  Average:	0.19 ms
+  Requests/sec:	25861.68
+```

examples/helloworld/config/dev.exs

@@ -0,0 +1 @@
+use Mix.Config

examples/helloworld/config/prod.exs

@@ -0,0 +1,6 @@
+use Mix.Config
+
+config :grpc, start_server: true
+
+config :logger,
+  level: :warn