Paq8pxd dict

[Darek]

15642246 - enwik8 -x15 -w -e1,english.dic.txt  paq8pxd_v93 14069.03 sec

@kaitz - which english.dic file are you used?

[Darek]

Scores of 4 Corpuses for paq8pxd_v93. The best overall scores for all 4 tests and majority of files!

[Darek]

@kaitz - happy New Year and wish the next will be better!

[kaitz]

paq8pxd_v94

-change jpeg model
-fix/change detection (tiff,text)

​

paq8pxd_v93  -s8 mill.jpg 7132151 4933064  215.93 sec
paq8pxd_v94  -s8 mill.jpg 7132151 4928860  222.67 sec

[Darek]

Scores of my testset for paq8pxd v94. For F.JPG file there is 215 bytes of gain. Other files remains the same.

[kaitz]

​paq8pxd_v95

jpeg model:
         -more context in Map1  (20)
         -more inputs from main context
         -2 main mixer inputs + 1 apm
         -cleanup

                                                Size Compressed   Sec
paq8pxd_v95 -s8 a10.jpg                       842468     618555    43.42 sec 1984 MB
paq8px_v200 -8  a10.jpg                       842468     624597    26.51 sec 2602 MB
paq8pxd_v95 -s8 mill.jpg                     7132151    4910289   350.38 sec 1984 MB
paq8px_v200 -8  mill.jpg                     7132151    4952115   228.65 sec 2602 MB
paq8pxd_v95 -s8 paq8px_v193_4_Corpuses.jpg   3340610    1367528   167.13 sec 1984 MB
paq8px_v200 -8  paq8px_v193_4_Corpuses.jpg   3340610    1513850   105.90 sec 2602 MB
paq8pxd_v95 -s8 DSCN0791.AVI                30018828   19858827  1336.94 sec 1984 MB
paq8px_v200 -8  DSCN0791.AVI                30018828   20171981   992.85 sec 2602 MB

So mill.jpg is 18571 bytes better v95 vs v94.

                                                  Size  Compressed  Sec
paq8pxd_v90 -s8  A10.jpg                         842468    623059    25
paq8px -8        A10.jpg                         842468    624651    36
paq8pxd_v90 -s8  paq8px_v193_4_Corpuses.jpg     3340610   1418082    96
paq8px -8        paq8px_v193_4_Corpuses.jpg     3340610   1513474   142

​

paq8pxd_v93  -s8 mill.jpg 7132151 4933064  215.93 sec
paq8pxd_v94  -s8 mill.jpg 7132151 4928860  222.67 sec

Its slower, im sure nobody cares. Some main context changes have 0 time penalty but improve result some kb.
For a10.jpg new Map1 context add only about 5 sec.

[suryakandau@yahoo.co.id]

Where can I get mill.jpg and dscn0791.avi files? Thank you.. could you upload them here please ?

[kaitz]

No

[Darek]

Scores of my testset and $ Corpuses for paq8pxd v94 and paq8pxd v95.
Good improvements on JPG files and files contains such structures.
A10.JPG file got 618'527 bytes!

[Darek]

Scores of paq8pxd v95 and previous versions for enwik8 and enwik9:

15'654'151 - enwik8 -x15 -w -e1,english.dic by paq8pxd_v89_60_4095, change: 0,00%, time 10422,07s
122'945'119 - enwik9 -x15 -w -e1,english.dic by paq8pxd_v89_60_4095, change: -0,06%, time 100755,31s - best score for paq8pxd versions

15'647'580 - enwik8 -x15 -w -e1,english.dic by paq8pxd_v90, change: -0,04%, time 9670,5s
123'196'527 - enwik9 -x15 -w -e1,english.dic by paq8pxd_v90, change: 0,20%, time 110200,16s

15'642'246 - enwik8 -x15 -w -e1,english.dic by paq8pxd_v95, change: 0,00%, time 10130s- best score for paq8pxd versions (the same as paq8pxd v93 and paq8pxd v94)
123'151'008 - enwik9 -x15 -w -e1,english.dic by paq8pxd_v95, change: 0,00%, time 102009,55s

[moisesmcardona]

@kaitz, I opened another MR https://github.com/kaitz/paq8pxd/pull/15.

Since you added a BZip2 transform, the BZip2 library needed to be added to the CMakeLists so that it can detect it and allow to compile your latest versions