Skip to content

Commit b64082b

Browse files
committed
remove old benchmark results from readme
1 parent 29e114b commit b64082b

File tree

1 file changed

+1
-116
lines changed

1 file changed

+1
-116
lines changed

README.md

Lines changed: 1 addition & 116 deletions
Original file line numberDiff line numberDiff line change
@@ -288,119 +288,4 @@ Ch.RowBinary.encode_rows([[naive], [utc], [taipei]], ["DateTime"])
288288

289289
## Benchmarks
290290

291-
<details>
292-
<summary><code>INSERT</code> 1 million rows <a href="https://github.com/ClickHouse/clickhouse-go#benchmark">(original)</a></summary>
293-
294-
<pre><code>
295-
$ MIX_ENV=bench mix run bench/insert.exs
296-
297-
This benchmark is based on https://github.com/ClickHouse/clickhouse-go#benchmark
298-
299-
Operating System: macOS
300-
CPU Information: Apple M1
301-
Number of Available Cores: 8
302-
Available memory: 8 GB
303-
Elixir 1.14.4
304-
Erlang 25.3
305-
306-
Benchmark suite executing with the following configuration:
307-
warmup: 2 s
308-
time: 5 s
309-
memory time: 0 ns
310-
reduction time: 0 ns
311-
parallel: 1
312-
inputs: 1_000_000 rows
313-
Estimated total run time: 28 s
314-
315-
Benchmarking encode with input 1_000_000 rows ...
316-
Benchmarking encode stream with input 1_000_000 rows ...
317-
Benchmarking insert with input 1_000_000 rows ...
318-
Benchmarking insert stream with input 1_000_000 rows ...
319-
320-
##### With input 1_000_000 rows #####
321-
Name ips average deviation median 99th %
322-
encode stream 1.63 612.96 ms ±11.30% 583.03 ms 773.01 ms
323-
insert stream 1.22 819.82 ms ±9.41% 798.94 ms 973.45 ms
324-
encode 1.09 915.75 ms ±44.13% 750.98 ms 1637.02 ms
325-
insert 0.73 1373.84 ms ±31.01% 1331.86 ms 1915.76 ms
326-
327-
Comparison:
328-
encode stream 1.63
329-
insert stream 1.22 - 1.34x slower +206.87 ms
330-
encode 1.09 - 1.49x slower +302.79 ms
331-
insert 0.73 - 2.24x slower +760.88 ms</code>
332-
</pre>
333-
334-
</details>
335-
336-
<details>
337-
<summary><code>SELECT</code> 500, 500 thousand, and 500 million rows <a href="https://github.com/ClickHouse/ch-bench">(original)</a></summary>
338-
339-
<pre><code>
340-
$ MIX_ENV=bench mix run bench/stream.exs
341-
342-
This benchmark is based on https://github.com/ClickHouse/ch-bench
343-
344-
Operating System: macOS
345-
CPU Information: Apple M1
346-
Number of Available Cores: 8
347-
Available memory: 8 GB
348-
Elixir 1.14.4
349-
Erlang 25.3
350-
351-
Benchmark suite executing with the following configuration:
352-
warmup: 2 s
353-
time: 5 s
354-
memory time: 0 ns
355-
reduction time: 0 ns
356-
parallel: 1
357-
inputs: 500 rows, 500_000 rows, 500_000_000 rows
358-
Estimated total run time: 1.05 min
359-
360-
Benchmarking stream with decode with input 500 rows ...
361-
Benchmarking stream with decode with input 500_000 rows ...
362-
Benchmarking stream with decode with input 500_000_000 rows ...
363-
Benchmarking stream with manual decode with input 500 rows ...
364-
Benchmarking stream with manual decode with input 500_000 rows ...
365-
Benchmarking stream with manual decode with input 500_000_000 rows ...
366-
Benchmarking stream without decode with input 500 rows ...
367-
Benchmarking stream without decode with input 500_000 rows ...
368-
Benchmarking stream without decode with input 500_000_000 rows ...
369-
370-
##### With input 500 rows #####
371-
Name ips average deviation median 99th %
372-
stream with decode 4.69 K 213.34 μs ±12.49% 211.38 μs 290.94 μs
373-
stream with manual decode 4.69 K 213.43 μs ±17.40% 210.96 μs 298.75 μs
374-
stream without decode 4.65 K 215.08 μs ±10.79% 213.79 μs 284.66 μs
375-
376-
Comparison:
377-
stream with decode 4.69 K
378-
stream with manual decode 4.69 K - 1.00x slower +0.0838 μs
379-
stream without decode 4.65 K - 1.01x slower +1.74 μs
380-
381-
##### With input 500_000 rows #####
382-
Name ips average deviation median 99th %
383-
stream without decode 234.58 4.26 ms ±13.99% 4.04 ms 5.95 ms
384-
stream with manual decode 64.26 15.56 ms ±8.36% 15.86 ms 17.97 ms
385-
stream with decode 41.03 24.37 ms ±6.27% 24.39 ms 26.60 ms
386-
387-
Comparison:
388-
stream without decode 234.58
389-
stream with manual decode 64.26 - 3.65x slower +11.30 ms
390-
stream with decode 41.03 - 5.72x slower +20.11 ms
391-
392-
##### With input 500_000_000 rows #####
393-
Name ips average deviation median 99th %
394-
stream without decode 0.32 3.17 s ±0.20% 3.17 s 3.17 s
395-
stream with manual decode 0.0891 11.23 s ±0.00% 11.23 s 11.23 s
396-
stream with decode 0.0462 21.66 s ±0.00% 21.66 s 21.66 s
397-
398-
Comparison:
399-
stream without decode 0.32
400-
stream with manual decode 0.0891 - 3.55x slower +8.06 s
401-
stream with decode 0.0462 - 6.84x slower +18.50 s</code>
402-
</pre>
403-
404-
</details>
405-
406-
[CI Results](https://github.com/plausible/ch/actions/workflows/bench.yml) (click the latest workflow run and scroll down to "Artifacts")
291+
Please see [CI Results](https://github.com/plausible/ch/actions/workflows/bench.yml) (make sure to click the latest workflow run and scroll down to "Artifacts") for [some of our benchmarks.](./bench/) :)

0 commit comments

Comments
 (0)