6 Commits (293cbf8469775dfd9162e8ae9314365273ab1bda)

Author	SHA1	Message	Date
Romain	293cbf8469	test: make all tests run on Linux + Windows	3 years ago
Romain	7dd714c957	refactor(tests): dynamically generate test folders to check more edge cases	6 years ago
Romain	dd282f92d4	chore(dependencies): update all dependencies to the latest version	6 years ago
Romain	d0bbf94b1c	fix(index): don’t crash when trying to parse exiftool output for a badly encoded file	7 years ago
Romain	cbf8a1f3b4	Don’t index media from Synology thumbnail folders (@eaDir) nor folders starting with “.”	7 years ago
Romain	24b2f9bd7c	Major optimisations: SQLite index + faster disk glob + new exiftool streaming ... 1. Move from a JSON index to a SQLite database. - This allows the indexing to be interrupted & resumed - Updating the index consumes less RAM than loading / saving an entire JSON object - Loading the index consumes less RAM since it can be streamed, only exacting the properties we need every time (instead of loading all EXIF data in memory, only to discard most of it later) - These make a big difference when processing 10,000+ photos 2. Switch from <glob> to a manual <readdir> - Glob would take several hundred or GB of RAM when asked to find several thousand files - Manual approach with <micromatch> library does the same thing in a fraction of the time / memory usage 3. Exiftool optimisations - Run 1 exiftool process per CPU, still in batch mode (divide all files to be read into 1 bucket per CPU) - Stream the exiftool output instead of buffering it in memory	7 years ago