Optimize flushing thresholds for maximum performance

 PERFORMANCE-OPTIMIZED FLUSHING:

� ENHANCED PERFORMANCE THRESHOLDS:
  • Increased flush threshold from 5MB to 128MB for maximum throughput
  • Extended time-based flushing from 3 seconds to 10 seconds
  • Significantly reduced I/O overhead during large operations
  • Still maintains progress visibility for long-running operations

 OPTIMIZED FLUSHING STRATEGY:
  • Size-based: Every 128MB of data written (minimal interruptions)
  • Time-based: Every 10 seconds maximum (reasonable progress updates)
  • File-based: After every file completion (unchanged for progress tracking)
  • Aggressive flush: Still uses reflection + OS-level flush for reliability

� PERFORMANCE BENEFITS:
  • Minimal I/O interruptions during large file processing
  • Maximum throughput for bulk operations
  • Reduced CPU overhead from frequent flushing
  • Still provides reasonable progress updates every 10 seconds

� EXPECTED RESULTS:
  • Faster processing of large file collections
  • Better performance for multi-GB operations
  • Less frequent but still visible progress updates
  • Optimal balance for production workloads

Perfect for high-performance zip operations!
This commit is contained in:
PSMinIO Developer
2025-07-14 17:01:22 -04:00
parent 75778fcfd3
commit 2a1d27d4f8
3 changed files with 2 additions and 2 deletions
Binary file not shown.
Binary file not shown.