ishan/one-billion-rows-challenge
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
https://www.morling.dev/blog/one-billion-row-challenge/
9 Commits 1 Branch 0 Tags 42 KiB
Rust 100%
master
Go to file
Ishan Jain f8ab92bf26
clean it up a bit
2024-01-14 03:48:25 +05:30
src clean it up a bit 2024-01-14 03:48:25 +05:30
.gitignore init 2024-01-11 00:23:49 +05:30
Cargo.lock mmap optimization, updated readme 2024-01-11 04:19:30 +05:30
Cargo.toml mmap optimization, updated readme 2024-01-11 04:19:30 +05:30
README.md mmap optimization, updated readme 2024-01-11 04:19:30 +05:30

README.md

One billion row challenge

These tests were run on a machine with r9 5900x, 64gb memory.

  • single threaded, no mmap: 29.7s (4.5s to read the file into memory, 24s to process rows and ~150micros to generate the output)

  • multi threaded, no mmap: read = 4.682276171s processed = 2.057576429s output_gen = 188.113µs

  • multi threaded + mmap: read = 5.75µs processed = 2.144708s output_gen = 276.73µs