gsadmin/buckit
1
0
Fork 0
mirror of https://github.com/buckit-io/buckit.git synced 2026-09-21 01:53:31 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,288 Commits 19 Branches 19 Tags
eb561e1c052d3f3845e7652a21c8a7485d403df7
Commit Graph

4 Commits

Author SHA1 Message Date
Klaus Post c2eb60df4a bz2: limit max concurrent CPU (#13458) 
Ensure that bz2 decompression will never take more than 50% CPU.
 2021-10-18 08:44:36 -07:00
Klaus Post 5e53f767c4 Use concurrent bz2 decompression (#13360) 
Testing with `mc sql --compression BZIP2 --csv-input "rd=\n,fh=USE,fd=;" --query="select COUNT(*) from S3Object" local2/testbucket/nyc-taxi-data-10M.csv.bz2`

Before 96.98s, after 10.79s. Uses about 70% CPU while running.
 2021-10-14 11:11:07 -07:00
Klaus Post b2c92cdaaa select: Add more compression formats (#13142) 
Support Zstandard, LZ4, S2, and snappy as additional 
compression formats for S3 Select.
 2021-09-06 09:09:53 -07:00
Harshavardhana 1f262daf6f rename all remaining packages to internal/ (#12418) 
This is to ensure that there are no projects
that try to import `minio/minio/pkg` into
their own repo. Any such common packages should
go to `https://github.com/minio/pkg`
 2021-06-01 14:59:40 -07:00