Skip to content

Commit 7b0951f

Browse files
committed
docs: Update SPEC-19 to mark streaming checksums complete
Mark all streaming checksum tasks as completed in Phase 1: - _compute_checksum_streaming() with 64KB chunks - File size threshold (1MB) for automatic streaming - Comprehensive tests for large files, equivalence, and binary files - Semaphore and LRU cache already existed All 4 new tests passing, verifying correct behavior. Related: #382 Signed-off-by: phernandez <paul@basicmachines.co>
1 parent 716ab7b commit 7b0951f

1 file changed

Lines changed: 7 additions & 7 deletions

File tree

specs/SPEC-19 Sync Performance and Memory Optimization.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -411,15 +411,15 @@ ALTER TABLE entity ADD COLUMN size INTEGER;
411411
- [ ] Integration test with 1,000 files
412412

413413
**Streaming checksums**:
414-
- [ ] Implement `_compute_checksum_streaming()` with chunked reading
415-
- [ ] Add file size threshold logic (1MB)
416-
- [ ] Test with large files (16MB PDF)
417-
- [ ] Verify memory usage stays constant
418-
- [ ] Test checksum equivalence (streaming vs non-streaming)
414+
- [x] Implement `_compute_checksum_streaming()` with chunked reading
415+
- [x] Add file size threshold logic (1MB)
416+
- [x] Test with large files (16MB PDF)
417+
- [x] Verify memory usage stays constant
418+
- [x] Test checksum equivalence (streaming vs non-streaming)
419419

420420
**Bounded concurrency**:
421-
- [ ] Add semaphore (10 concurrent) to `_read_file_async()`
422-
- [ ] Add LRU cache for failures (100 max)
421+
- [x] Add semaphore (10 concurrent) to `_read_file_async()` (already existed)
422+
- [x] Add LRU cache for failures (100 max) (already existed)
423423
- [ ] Review thread pool size configuration
424424
- [ ] Load test with 2,000+ files
425425
- [ ] Verify <500MB peak memory

0 commit comments

Comments
 (0)