Page 35 of 35 FirstFirst ... 25333435
Results 1,021 to 1,033 of 1033

Thread: Paq8pxd dict

  1. #1021
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    1,261
    Thanks
    790
    Thanked 539 Times in 409 Posts
    Quote Originally Posted by kaitz View Post
    Code:
    15642246 - enwik8 -x15 -w -e1,english.dic.txt  paq8pxd_v93 14069.03 sec
    @kaitz - which english.dic file are you used?

  2. #1022
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    1,261
    Thanks
    790
    Thanked 539 Times in 409 Posts
    Scores of 4 Corpuses for paq8pxd_v93. The best overall scores for all 4 tests and majority of files!
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	paq8pxd_v93_4_Corpuses.jpg 
Views:	28 
Size:	2.93 MB 
ID:	8222  

  3. Thanks:

    LucaBiondi (1st January 2021)

  4. #1023
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    1,261
    Thanks
    790
    Thanked 539 Times in 409 Posts
    @kaitz - happy New Year and wish the next will be better!

  5. Thanks (4):

    kaitz (1st January 2021),LucaBiondi (1st January 2021),schnaader (8th January 2021),xinix (1st January 2021)

  6. #1024
    Member
    Join Date
    May 2008
    Location
    Estonia
    Posts
    529
    Thanks
    219
    Thanked 380 Times in 199 Posts
    paq8pxd_v94
    Code:
    -change jpeg model
    -fix/change detection (tiff,text)

    Code:
    paq8pxd_v93  -s8 mill.jpg 7132151 4933064  215.93 sec
    paq8pxd_v94  -s8 mill.jpg 7132151 4928860  222.67 sec
    Attached Files Attached Files
    KZo


  7. Thanks (4):

    Darek (8th January 2021),Mike (8th January 2021),moisesmcardona (8th January 2021),xinix (7th January 2021)

  8. #1025
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    1,261
    Thanks
    790
    Thanked 539 Times in 409 Posts
    Scores of my testset for paq8pxd v94. For F.JPG file there is 215 bytes of gain. Other files remains the same.
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	paq8pxd_v94_DBA.jpg 
Views:	11 
Size:	852.6 KB 
ID:	8253  

  9. Thanks:

    kaitz (13th January 2021)

  10. #1026
    Member
    Join Date
    May 2008
    Location
    Estonia
    Posts
    529
    Thanks
    219
    Thanked 380 Times in 199 Posts
    paq8pxd_v95
    Code:
    jpeg model:
             -more context in Map1  (20)
             -more inputs from main context
             -2 main mixer inputs + 1 apm
             -cleanup
    Code:
                                                    Size Compressed   Sec
    paq8pxd_v95 -s8 a10.jpg                       842468     618555    43.42 sec 1984 MB
    paq8px_v200 -8  a10.jpg                       842468     624597    26.51 sec 2602 MB
    paq8pxd_v95 -s8 mill.jpg                     7132151    4910289   350.38 sec 1984 MB
    paq8px_v200 -8  mill.jpg                     7132151    4952115   228.65 sec 2602 MB
    paq8pxd_v95 -s8 paq8px_v193_4_Corpuses.jpg   3340610    1367528   167.13 sec 1984 MB
    paq8px_v200 -8  paq8px_v193_4_Corpuses.jpg   3340610    1513850   105.90 sec 2602 MB
    paq8pxd_v95 -s8 DSCN0791.AVI                30018828   19858827  1336.94 sec 1984 MB
    paq8px_v200 -8  DSCN0791.AVI                30018828   20171981   992.85 sec 2602 MB
    So mill.jpg is 18571 bytes better v95 vs v94.
    Quote Originally Posted by kaitz View Post
    Code:
                                                      Size  Compressed  Sec
    paq8pxd_v90 -s8  A10.jpg                         842468    623059    25
    paq8px -8        A10.jpg                         842468    624651    36
    paq8pxd_v90 -s8  paq8px_v193_4_Corpuses.jpg     3340610   1418082    96
    paq8px -8        paq8px_v193_4_Corpuses.jpg     3340610   1513474   142
    Quote Originally Posted by kaitz View Post

    Code:
    paq8pxd_v93  -s8 mill.jpg 7132151 4933064  215.93 sec
    paq8pxd_v94  -s8 mill.jpg 7132151 4928860  222.67 sec
    Its slower, im sure nobody cares. Some main context changes have 0 time penalty but improve result some kb.
    For a10.jpg new Map1 context add only about 5 sec.
    Attached Files Attached Files
    KZo


  11. Thanks (3):

    Darek (14th January 2021),Mike (13th January 2021),moisesmcardona (14th January 2021)

  12. #1027
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    497
    Thanks
    62
    Thanked 90 Times in 70 Posts
    Where can I get mill.jpg and dscn0791.avi files? Thank you.. could you upload them here please ?

  13. #1028
    Member
    Join Date
    May 2008
    Location
    Estonia
    Posts
    529
    Thanks
    219
    Thanked 380 Times in 199 Posts
    No
    KZo


  14. #1029
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    1,261
    Thanks
    790
    Thanked 539 Times in 409 Posts
    Scores of my testset and $ Corpuses for paq8pxd v94 and paq8pxd v95.
    Good improvements on JPG files and files contains such structures.
    A10.JPG file got 618'527 bytes!
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	paq8pxd_v95_4_Corpuses.jpg 
Views:	10 
Size:	3.10 MB 
ID:	8278   Click image for larger version. 

Name:	paq8pxd_v95_DBA_Corpus.jpg 
Views:	6 
Size:	852.0 KB 
ID:	8279  

  15. Thanks:

    kaitz (17th January 2021)

  16. #1030
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    1,261
    Thanks
    790
    Thanked 539 Times in 409 Posts
    Scores of paq8pxd v95 and previous versions for enwik8 and enwik9:

    15'654'151 - enwik8 -x15 -w -e1,english.dic by paq8pxd_v89_60_4095, change: 0,00%, time 10422,07s
    122'945'119 - enwik9 -x15 -w -e1,english.dic by paq8pxd_v89_60_4095, change: -0,06%, time 100755,31s - best score for paq8pxd versions

    15'647'580 - enwik8 -x15 -w -e1,english.dic by paq8pxd_v90, change: -0,04%, time 9670,5s
    123'196'527 - enwik9 -x15 -w -e1,english.dic by paq8pxd_v90, change: 0,20%, time 110200,16s

    15'642'246 - enwik8 -x15 -w -e1,english.dic by paq8pxd_v95, change: 0,00%, time 10130s- best score for paq8pxd versions (the same as paq8pxd v93 and paq8pxd v94)
    123'151'008 - enwik9 -x15 -w -e1,english.dic by paq8pxd_v95, change: 0,00%, time 102009,55s

  17. Thanks:

    kaitz (18th January 2021)

  18. #1031
    Member
    Join Date
    Jun 2009
    Location
    Puerto Rico
    Posts
    271
    Thanks
    159
    Thanked 62 Times in 47 Posts
    @kaitz, I opened another MR https://github.com/kaitz/paq8pxd/pull/15.

    Since you added a BZip2 transform, the BZip2 library needed to be added to the CMakeLists so that it can detect it and allow to compile your latest versions

  19. #1032
    Member
    Join Date
    May 2008
    Location
    Estonia
    Posts
    529
    Thanks
    219
    Thanked 380 Times in 199 Posts
    paq8pxd_v99
    Code:
    -xml/html like content processed separately in wordmodel
    -adjust some wordmodel parameters
    -attempt to detect ISO latin text
    -some changes in detection (cleanup)
    1 thing helps on silesia webster/xml
    2 helps 1bit on most text files (1k loss on enwik8)
    3 helps on silesia samba maybe mozilla and any other text file prev detected as bintext
    4 in tar mode some files are treated as text by extension without confirming (.c,.h,.html,.cpp,.po,.txt), just a bit faster processing. (for examp, linux kernel source tar)
    Attached Files Attached Files
    KZo


  20. Thanks (3):

    Mike (21st January 2021),moisesmcardona (21st January 2021),xinix (22nd January 2021)

  21. #1033
    Member
    Join Date
    May 2008
    Location
    Estonia
    Posts
    529
    Thanks
    219
    Thanked 380 Times in 199 Posts
    Silesia:
    Click image for larger version. 

Name:	px201.vs.pxd99.png 
Views:	26 
Size:	4.2 KB 
ID:	8288
    KZo


  22. Thanks:

    Darek (22nd January 2021)

Page 35 of 35 FirstFirst ... 25333435

Similar Threads

  1. FreeArc compression suite (4x4, Tornado, REP, Delta, Dict...)
    By Bulat Ziganshin in forum Data Compression
    Replies: 554
    Last Post: 26th September 2018, 03:41
  2. Dict preprocessor
    By pat357 in forum Data Compression
    Replies: 5
    Last Post: 2nd May 2014, 22:51

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •