Files
PSMinIO/Module
PSMinIO Developer 4c2ef37a07 Optimize flushing frequency for better performance
 FLUSHING OPTIMIZATION:

 BALANCED FLUSHING STRATEGY:
  • Increased flush threshold from 1MB to 5MB for better performance
  • Reduced time-based flushing from 500ms to 3 seconds
  • Maintains real-time visibility while reducing I/O overhead
  • Still flushes after every file completion for progress tracking

 PERFORMANCE BENEFITS:
  • Reduced disk I/O operations for better throughput
  • Less frequent interruptions during large file processing
  • Maintains good real-time visibility (updates every 5MB or 3 seconds)
  • Optimal balance between performance and progress feedback

� NEW FLUSHING STRATEGY:
  • Size-based: Every 5MB of data written
  • Time-based: Every 3 seconds maximum
  • File-based: After every file completion (unchanged)
  • Still provides good real-time updates without excessive I/O

Perfect balance of performance and visibility!
2025-07-14 16:46:08 -04:00
..