amir/filehasher
1
0
Fork 1
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

0 Releases 2 Tags

RSS Feed
  • v5.0 d9098a69a9
    Compare

    Implementing the IO Ring for windows and ui_uring for linux

    amir released this 2026-04-28 19:40:44 +00:00 | 8 commits to main since this release

    Instead of buffered sequential hashing implementing IO Ring/io_uring,
    huge performance gains. The IO Ring is event driven, thread local, uses
    direct disk I/O, bypassing the OS cache completely, registered buffers
    files, it supports bashing multiple submissions and can handle multiple
    files at the same time.

    Hashing small files using XXH3_128bits() instead of the streaming
    pipeline(XXH3_128bits_reset(), XXH3_128bits_update(),
    XXH3_128bits_digest()), this reduses the overhead of creating a state
    and digest, coupled with the IO Ring it improves the hashing of small
    files whose size is inferior to the size of IO Ring buffers

    fixing the xxh_x86dispatch warnings

    Updating the progress printing function

    Implementing a config file

    Writing the README file

    Downloads