HFCB: Huge Files Compression Benchmark

[Edison007]

precomp+reflate+delta+bcj2+srep+paq8pxd10
572,098,447

[kaitz]

Again, i think bcj2 is really not helping here.

test.7z is bcj2 filtered/stored
test1.7z is stored
There are 710373298 bytes of exe in vm.dll

Edit:
file used for testing is paq8pxd_v10.exe

paq8pxd_v10 -8  test.7z
Creating archive test.7z.paq8pxd10 with 1 file(s)...

1/1  Filename: test.7z (354766 bytes)
Block segmentation:
 0           | default   |    354766 b [0 - 354765]
Compressed from 354766 to 93606 bytes.


Total 354766 bytes compressed to 93661 bytes.
Time 48.33 sec, used 1699935128 bytes of memory


paq8pxd_v10 -8  test1.7z

1/1  Filename: test1.7z (354412 bytes)
Block segmentation:
 0           | default   |      1107 b [0 - 1106]
 1           | exe       |    266995 b [1107 - 268101]
 2           | default   |     86310 b [268102 - 354411]
Compressed from 354412 to 86977 bytes.


Total 354412 bytes compressed to 87051 bytes.
Time 48.65 sec, used 1716726967 bytes of memory

[Skymmer]

precomp+reflate+delta+bcj2+srep+paq8pxd10
572,098,447

Damn! Damn! DAMN!

[Cyan]

Damn! Damn! DAMN!

barf (special version)
1 byte




OK, I'm trolling....

[Skymmer]

New record is coming

1. precomp 0.4.3 -progonly+ -intense -cn   5 188 081 467
2. reflate (optimal level for every raw)   7 055 933 089
3. srep 3.92 x64 -m5                       3 756 906 254
4. paq8pxd_v10 -8                            570 377 158

This is 3.0% better than my previous personal result. But only 0.3% better than Edison007's result. Honestly speaking I expected a bigger gap.
Also here are the results with delta filter before and after srep.

delta+srep    572 915 135
srep+delta    572 771 214

[Bulat Ziganshin]

pretty obvious, paq contains better own filters than those delta/bcj2

[Edison007]

I tested reflate+precomp+paq8pxd10: 562 MB (589'679'319 bytes)

[comp1]

Time for a new record!

precomp 0.4.3 -pdfbmp+ -progonly+ -cn -intense  5,188,086,255 
              reflate (comp1 Optimal Settings)  7,064,903,945 
                              srep64 3.93a -m5  3,777,560,657 
                   paq8pxd_v16_x64_skbuild -s9    552,338,760

The competition continues!

[Skymmer]

Thats nice! My congrats.

[Bulat Ziganshin]

i've finally found original VMDK files: http://freearc.org/download/testdata...04.1_PE_x86.7z (just concat bagluxpe-s00*.vmdk to produce vm.dll)