ThreadSafeProgressCollector utility:
Thread-safe progress data collection from background threads
Concurrent queues for progress updates and verbose messages
Safe PowerShell method calls only from main thread
Automatic completion handling and queue processing
MultiLayerProgressReporter for 3-layer progress:
Layer 1: Collection progress (overall files with ETA)
Layer 2: File progress (current file with size info)
Layer 3: Transfer progress (bytes with speed calculation)
Hierarchical progress reporting with parent-child relationships
Real-time speed and ETA calculations
Enhanced New-MinIOObject cmdlet integration:
UploadSingleFileWithProgress method with progress integration
Multi-file upload with comprehensive progress tracking
Background thread safety for progress callbacks
Verbose message queuing and processing
Graceful error handling with progress completion
Progress tracking features:
Real-time transfer speed calculation
Estimated time remaining (ETA) for collections
Hierarchical progress bars in PowerShell
Thread-safe verbose logging
Automatic progress completion on success/failure
Architecture improvements:
Separation of concerns: progress collection vs reporting
Background thread compatibility
Memory-efficient concurrent collections
Comprehensive error handling and cleanup
This provides enterprise-grade progress tracking for large file operations with
detailed visibility into collection, file, and transfer-level progress.
Enhanced New-MinIOObject cmdlet with advanced parameter sets:
Files parameter set: Support for FileInfo[] (single or multiple files)
Directory parameter set: DirectoryInfo with recursive options
Removed redundant SingleFile parameter set (FileInfo[] handles both cases)
Universal BucketDirectory support:
Available for both Files and Directory parameter sets
Handles paths like '/Folder1/Folder2/Folder3' or 'Folder1\\Folder2\\Folder3'
Automatic multilevel bucket directory creation
Enhanced path sanitization with proper forward slash formatting
Advanced directory upload features:
Recursive parameter with MaxDepth control
Flatten parameter to upload all files to bucket root
InclusionFilter and ExclusionFilter ScriptBlock parameters
Force parameter for overwriting existing objects
Comprehensive file collection processing:
Multi-file upload with progress tracking
Automatic object name inference from filenames
Directory structure preservation or flattening
Error handling for individual file failures
PassThru parameter for returning upload results
Enhanced path processing:
Cross-platform path handling (Windows/Unix)
Automatic directory structure creation in buckets
Verbose logging for directory operations
Non-critical error handling for directory creation
Architecture: Built on custom REST API with thread-safe operations and comprehensive error handling.
- Simplified error handling to show only essential information:
* Operation, Message, ExceptionType, InnerExceptionType, InnerExceptionMessage
* Removed system info, stack traces, and operation details for cleaner output
- Started enhancing New-MinIOObject cmdlet with parameter sets:
* SingleFile: Original single file upload functionality
* Files: FileInfo[] support for multiple file uploads
* Directory: DirectoryInfo support with recursive options
- Added new parameters for enhanced functionality:
* BucketDirectory for organizing uploads into nested structures
* Recursive, MaxDepth, Flatten for directory uploads
* InclusionFilter, ExclusionFilter for file filtering
* Force parameter for overwriting existing objects
Next: Complete the parameter set implementation and add multi-layer progress tracking.
- Resolved PowerShell cmdlet method calls from background threads
- Wrapped HTTP operations in Task.Run for proper thread context
- Fixed progress callback threading issues in upload/download
- Enhanced error handling with thread-safe logging
- All functionality now working: connection, buckets, upload, download
- Content verification passing with proper progress tracking
Threading fix ensures PowerShell cmdlet methods are only called from main thread,
eliminating 'WriteObject and WriteError methods cannot be called from outside' errors.
- Created MinIOErrorHandler utility with comprehensive error details
- Captures Message, ExceptionType, InnerException, StackTrace, Timestamp, Machine, ProcessId
- Provides detailed logging with Write-Warning for debugging
- Integrated with MinIOBaseCmdlet ExecuteOperation methods
- Fixed parameter name consistency (BucketName across all cmdlets)
- Supports both terminating and non-terminating error handling
- Automatic error category determination based on exception type
This addresses the requirement for centralized C# error handling that provides
detailed debugging information without requiring manual debug code additions.
- Removed MinIO SDK dependency completely
- Built custom HTTP client with AWS S3 signature v4 support
- Created synchronous operations optimized for PowerShell
- Added real progress reporting during transfers
- Implemented performance metrics in result objects
- Fixed null pointer warnings for code quality
- Removed Write-Host usage from test scripts
- Cleaned up unnecessary DLL dependencies
Available cmdlets:
- Connect-MinIO: Enhanced connection with certificate options
- Get-MinIOBucket: List buckets with sorting and filtering
- New-MinIOBucket: Create buckets with region support
- Test-MinIOBucketExists: Check bucket existence
- Get-MinIOObject: List objects with advanced filtering
- New-MinIOObject: Upload files with real progress
- Get-MinIOObjectContent: Download files with progress
This represents a complete architectural overhaul for better PowerShell compatibility and performance.
- Reorganized project structure with proper directory separation:
* All scripts moved to scripts/ directory (including examples)
* All documentation moved to docs/ directory (except README.md)
* Centralized version management in Version.ps1
- Implemented centralized version management system:
* Version.ps1 provides single source of truth for version information
* Automatic yyyy.MM.dd.HHmm versioning based on build time
* scripts/Update-Version.ps1 updates all version references
* src/Properties/AssemblyInfo.cs for assembly version information
- Enhanced build system:
* scripts/Build.ps1 - Full build with validation and packaging
* scripts/Quick-Build.ps1 - Fast build handling file locking issues
* Removed automatic copy from project file to avoid locking
* Integrated version updates into build process
- Updated PowerShell Gallery publishing:
* scripts/Publish-PSMinIOToGallery.ps1 updated for new structure
* docs/POWERSHELL-GALLERY-RELEASE.md comprehensive publishing guide
* Module manifest updated with proper metadata and release notes
- Updated all documentation and examples:
* README.md updated with PowerShell Gallery installation
* All example scripts updated with correct import paths
* scripts/examples/README.md updated for new location
* docs/PROJECT-STRUCTURE.md documents new organization
- Version updated to 2025.07.11.1151 with centralized management
- All import paths corrected for new structure
- Professional project organization following PowerShell best practices
- Updated README.md with modern feature descriptions and comprehensive overview
- Enhanced docs/USAGE.md with advanced object listing, directory management, and chunked operations
- Created examples/ directory with 6 comprehensive example scripts:
* 01-Basic-Operations.ps1 - Fundamental operations for beginners
* 02-Advanced-Object-Listing.ps1 - Filtering, sorting, and pagination
* 03-Directory-Management.ps1 - Nested directory structures and organization
* 04-Chunked-Operations.ps1 - Large file handling with performance optimization
* 05-Bulk-Operations.ps1 - Batch processing and automation workflows
* 06-Enterprise-Automation.ps1 - Enterprise monitoring, reporting, and compliance
- Added comprehensive examples/README.md with usage patterns and best practices
- Fixed directory creation warnings (now clean verbose logging)
- Implemented missing Get-MinIOObject cmdlet with full filtering/sorting capabilities
- Added timing and performance metrics to all operations
- Enhanced chunked operations with multi-layer progress tracking
- Improved error handling and resource cleanup
- Removed temporary test files and cleaned up repository structure
- All examples use proper PowerShell output (no Write-Host usage)
- Professional logging with timestamps and structured output
- Updated MinIO SDK from 3.1.13 to 5.0.0
- Fixed all compilation errors and warnings for MinIO 5.0.0 compatibility
- Updated API calls to use new Args-based patterns (PutObjectArgs, GetObjectArgs, etc.)
- Fixed type compatibility issues (DateTime, ulong conversions)
- Removed deprecated APIs (WithCancellation, ProgressReport)
- Updated System.Text.Json to 9.0.0 to resolve security vulnerabilities
- Added Module directory to repository with built PSMinIO.dll
- Module is now ready for distribution and testing
- All builds pass with 0 errors and 0 warnings
- Create Demo-ChunkedTransfer.ps1 for showcasing implementation
- Add PSMinIO-TestFunctions.psm1 with test functions
- Add Test-ChunkedModule.ps1 and Quick-Test.ps1 for validation
- Update Build.ps1 to output to Artifacts directory
- Remove unnecessary progress parameters (use standard ProgressAction)
- Add missing using statements for compilation
- Create test manifest PSMinIO-Test.psd1
- Ready for C# compilation and integration testing
PSMinIO Developer