Streaming Benchmarks

This repository contains the tools and scripts used to run performance benchmarks for data streaming tools like Conduit and Kafka Connect. The tools are tested under the same conditions using Benchi, to ensure that the results are comparable.

Results

The raw results of the benchmarks can be found in the results directory. Here we are just posting the aggregated results.

Benchmark: MongoDB to Kafka

Click here to see the full results.

This benchmark tests the performance of the data pipeline when reading from a MongoDB source and writing to a Kafka destination.

TODO aggregated results table and graph

Running the benchmarks

To run the benchmarks yourself, you need to have Docker and Docker Compose installed on your machine (see Docker Desktop).

Run all benchmarks using:

make install-tools run-all

The Makefile contains a number of useful targets to make it easy to work with the benchmarks. Use make help to see the available targets.

$ make help
install-tools   Install all tools required for benchmarking.
install-benchi  Install latest version of benchi.
install-csvtk   Install csvtk for processing CSV files.
list            List all benchmarks.
run-all         Run all benchmarks. Optionally add "run-<benchmark-name>" to run a specific benchmark.
run-%           Run a specific benchmark.
rmi-conduit     Remove the Conduit docker image (use when built-in connectors get added or upgraded).