which tools support parallel compress

[l1t]

rar
7zip
gzip?

[Bulat Ziganshin]

rar&7zip

[l1t]

3Q,
why gzip cant?

[Bulat Ziganshin]

pigz = parallel gzip
pbzip2 = parallel bzip2

[l1t]

got pigz = parallel gzip
pbzip2 = parallel bzip2
here
http://www.leszer.net/index.php/my-software.html

[l1t]

pigz is very fast
gzip 390M only 3-5seconds

[joerg]

i think, it is worth to try the new bsc version 2.3.0

see: http://encode.su/threads/586-bsc-new...ing-compressor

downloadable from: http://libbsc.com/downloads.aspx

if you want fast compression, then try the -m2 option ("ST5"): "bsc e inputfile outputfile -m2"

in my tests i am using:

"bsc e inputfile outputfile -m2 -cp -b128"
or "bsc e inputfile outputfile -m2 -cp -b190"
or "bsc e inputfile outputfile -m2 -cp -b232"


if you want to try to use more cores
it seems worth to compare 7-Zip 9.15 beta:

7z.exe a -mx3 -m0=bzip2 g:\archivfile.7z f:\FileBackups\dir1

and

7z.exe a -mx3 -m0=lzma2 g:\archivfile2.7z f:\FileBackups\dir1

best regards

[l1t]

can you tell me why ppmd cant use multi core

[l1t]

bsc is not normal

D:\renkoudmp\1306>time 0<cr
当前时间: 22:06:00.68
输入新时间:

D:\renkoudmp\1306>bsc e d:\renkoudmp\1306\hu1306.dmp d:\renkoudmp\1306\test.bsc -m2 -cp -b128
This is bsc, Block Sorting Compressor. Version 2.3.0. 9 August 2010.
Copyright (c) 2009-2010 Ilya Grebnov <Ilya.Grebnov@libbsc.com>.

d:\renkoudmp\1306\hu1306.dmp compressed 393103360 into 16795257 in 12.371 seconds.

D:\renkoudmp\1306>time 0<cr
当前时间: 22:06:13.10
输入新时间:

[l1t]

it' strange use -f =>fast and better ratio

D:\renkoudmp\1306>time 0<cr
当前时间: 22:08:12.89
输入新时间:

D:\renkoudmp\1306>bsc e d:\renkoudmp\1306\hu1306.dmp d:\renkoudmp\1306\test.bsc -m2 -cp -b190
This is bsc, Block Sorting Compressor. Version 2.3.0. 9 August 2010.
Copyright (c) 2009-2010 Ilya Grebnov <Ilya.Grebnov@libbsc.com>.

d:\renkoudmp\1306\hu1306.dmp compressed 393103360 into 16967258 in 14.040 seconds.

D:\renkoudmp\1306>time 0<cr
当前时间: 22:08:26.96
输入新时间:

D:\renkoudmp\1306>bsc
This is bsc, Block Sorting Compressor. Version 2.3.0. 9 August 2010.
Copyright (c) 2009-2010 Ilya Grebnov <Ilya.Grebnov@libbsc.com>.

Usage: bsc <e|d> inputfile outputfile <switches>

Switches:
-b<size> Block size in megabytes, default: -b25
minimum: -b1, maximum: -b1024
-m<algo> Block sorting algorithm, default: -m3
-m0 Sort Transform of order 3
-m1 Sort Transform of order 4
-m2 Sort Transform of order 5
-m3 Burrows Wheeler Transform
-c<ctx> Contexts for sorting, default: -cf
-cf Following contexts
-cp Preceding contexts
-ca Autodetect (experimental)
-H<size> LZP hash table size in bits, default: -H16
minimum: -H10, maximum: -H28
-M<size> LZP minimum match length, default: -M128
minimum: -M4, maximum: -M255
-f Enable fast compression mode, default: disable
-l Enable LZP, default: enable
-r Enable Reordering, default: disable
-s Enable Segmentation, default: disable
-p Disable all preprocessing techniques
-t Disable parallel blocks processing, default: enable
-T Disable multi-core systems support, default: enable

Switches may be combined into one, like -b128p

D:\renkoudmp\1306>tz

D:\renkoudmp\1306>time 0<cr
当前时间: 22:10:04.43
输入新时间:

D:\renkoudmp\1306>bsc e d:\renkoudmp\1306\hu1306.dmp d:\renkoudmp\1306\test.bsc -m2 -cp -b190 -f
This is bsc, Block Sorting Compressor. Version 2.3.0. 9 August 2010.
Copyright (c) 2009-2010 Ilya Grebnov <Ilya.Grebnov@libbsc.com>.

d:\renkoudmp\1306\hu1306.dmp compressed 393103360 into 15577173 in 12.043 seconds.

D:\renkoudmp\1306>time 0<cr
当前时间: 22:10:16.51
输入新时间:

[Karhunen]

The binaries I know about available for Winboxes are lzop ( lzo parallel ), pigz ( parallel gzip ), ZPAQ of course, and plrzip ( parallel lzip ). IMO, I find LZO to be best for raw disk images ( poor compression, but fast speed ). Suggest you peruse the MOC website which should be http://heartofcomp.altervista.org/MOC/MOC.htm