Commit Graph

60 Commits

Author SHA1 Message Date
Danny Robson c80269f951 cruft;util: bump 2021-01-23 06:50:16 +10:00
Danny Robson e65958b9aa tools/analyse: explicit size unique_bytes accumulator
This avoids unsigned overflow.
2021-01-23 06:49:49 +10:00
Danny Robson bdc4a09356 tools/analyse: use a deque to avoid expensive reallocations
We can amass a fair amount of allocated memory on some operations, so a
vector resize can exceed the available memory of a system on some
operations.
2021-01-23 06:48:39 +10:00
Danny Robson 6d584b10ec chunk/find: don't hard code the buzhash shift 2021-01-23 06:47:59 +10:00
Danny Robson 0028e5f382 cruft;util: bump 2020-12-31 07:14:41 +10:00
Danny Robson b5e93c15fb analyse: avoid copying the chunk data for duplicate detection 2020-12-29 08:37:32 +10:00
Danny Robson 00dc05ac8f analyse: remove redundant total size calculation 2020-12-29 08:37:11 +10:00
Danny Robson 69cd8079da analyse: delay output file creation until after chunk discovery 2020-12-29 08:36:46 +10:00
Danny Robson 050ade9787 style 2020-12-29 08:36:38 +10:00
Danny Robson aa90c7ef70 comments 2020-12-29 08:36:21 +10:00
Danny Robson f083ff0f64 analyse: correct the argc offset test 2020-12-29 08:01:53 +10:00
Danny Robson c172ee2c40 chunk/param: add a maximum chunk size param 2020-12-29 08:01:40 +10:00
Danny Robson 3ad55453f7 analyse: add directory and recursion support 2020-12-06 11:01:41 +10:00
Danny Robson 8b742647df chunk/find: add forgotten unit 2020-12-06 11:01:12 +10:00
Danny Robson 830fb1f47e chunk/find: remove map in favour of bare queries 2020-12-06 09:34:33 +10:00
Danny Robson db6c4f54a2 emory/chunk/map: move chunking to a free function 2020-12-06 09:17:50 +10:00
Danny Robson 66ec824b44 analyse: start using fmtlib for printing 2020-12-06 09:07:27 +10:00
Danny Robson 8acdab8111 analyse: correct the percentage calculation scale 2020-12-06 09:00:35 +10:00
Danny Robson 139ed04b66 analyse: stub out an output file 2020-12-06 09:00:22 +10:00
Danny Robson 09e4cf63bb analyse: correct the argument count index check 2020-12-06 09:00:03 +10:00
Danny Robson 7902ed93b8 chunk/ostream: add params ostream operator 2020-12-06 08:59:34 +10:00
Danny Robson f2afa2a421 analyse: move default chunk params into params header 2020-12-06 08:48:20 +10:00
Danny Robson 7558c08e7d analyse: provide defaults for bits, window, and minimum 2020-12-06 08:42:01 +10:00
Danny Robson 255beaefa5 cruft;crypto: bump for changes in util 2020-12-06 08:41:22 +10:00
Danny Robson 93343f3ffb analyse: move arg enum closer to usage site 2020-12-06 07:14:05 +10:00
Danny Robson 141acdc600 build: bump 2020-12-06 07:09:18 +10:00
Danny Robson 7f2b4ba8d9 stat: protect acl and xattr from Windows 2020-12-06 07:03:04 +10:00
Danny Robson c1f19faba4 build: move higher level CMake directives to top of file 2020-12-06 07:02:50 +10:00
Danny Robson 6766c75243 build;modules: prefer gitea URLs 2020-12-06 06:59:32 +10:00
Danny Robson f2b8a24b3d cruft;util: bump 2020-12-06 06:23:59 +10:00
Danny Robson 9b6e1e770f analyse: print duplicated count and total size 2020-12-06 06:22:52 +10:00
Danny Robson 35a8420d28 analyse: add chunk equality comparator 2020-12-06 06:22:39 +10:00
Danny Robson b2731f0968 chunk/map: add a windowed buzhash 2020-12-06 06:22:06 +10:00
Danny Robson f4aab7f2c2 store: add old repository code to build 2020-10-04 10:54:18 +11:00
Danny Robson 3367faf2b8 chunk/params: minimal documentation for members 2020-10-04 10:53:48 +11:00
Danny Robson 69447ce54b build; bump dependencies and fix attendant compilation errors 2020-10-04 10:52:50 +11:00
Danny Robson 426a447af3 build: enable CPack 2019-04-27 10:44:50 +10:00
Danny Robson 8b620dc4f5 tools/emory: add stub loader executable 2019-04-27 10:44:33 +10:00
Danny Robson d83601755c emory/fs: initial experiments in xattr iteration 2019-04-26 12:47:04 +10:00
Danny Robson 6ca1fe1670 tools/analyse: use the common API 2019-04-26 11:16:02 +10:00
Danny Robson 54c466f5e5 emory: break comparison tool into distinct units 2019-04-26 11:10:07 +10:00
Danny Robson ff348b4484 cruft/util: bump for bitwise assertions 2019-04-26 10:28:45 +10:00
Danny Robson effa2f6ec1 tools/compare: print number of destination chunks 2019-04-26 10:27:44 +10:00
Danny Robson 394d5c95dc whitespace 2019-04-26 09:46:32 +10:00
Danny Robson 89e898ab20 tools/compare: print full match data 2019-04-26 09:45:43 +10:00
Danny Robson df7b136f24 tools/compare: record the source of the matched blocks 2019-04-26 09:25:41 +10:00
Danny Robson f063bdfd8e tools/compare: allow multiple sources 2019-04-26 09:08:03 +10:00
Danny Robson fd3f1bfc34 acl: add trivial ACL printing 2019-04-25 14:19:55 +10:00
Danny Robson d9f9ca9a43 tools/stat: correctly test errno for buffer doubling 2019-04-25 14:19:30 +10:00
Danny Robson 4d538190f2 tools/stat: break main into functions 2019-04-25 09:22:43 +10:00