Results 1 to 23 of 23

Thread: Crush v1.3

  1. #1
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts

    Crush v1.3

    this is crush v1.3 based on v1.1 with amazing compression ratio improvements.
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	crushv1.3.PNG 
Views:	135 
Size:	20.7 KB 
ID:	7252  
    Attached Files Attached Files

  2. Thanks (3):

    Amsal (13th January 2020),Entai44 (13th January 2020),RichSelian (29th January 2020)

  3. #2
    Member
    Join Date
    Jan 2020
    Location
    Indonesia
    Posts
    2
    Thanks
    5
    Thanked 0 Times in 0 Posts
    you still have my thanks, great job

  4. #3
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts

    crush v1.4

    improve compression ratio for enwik9 file n decompression time is still fast
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	crushv1.4.PNG 
Views:	82 
Size:	18.8 KB 
ID:	7258  
    Attached Files Attached Files

  5. Thanks:

    Entai44 (15th January 2020)

  6. #4
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts
    Quote Originally Posted by Entai44 View Post
    you still have my thanks, great job
    Thank you

  7. #5
    Member
    Join Date
    Dec 2012
    Location
    japan
    Posts
    165
    Thanks
    31
    Thanked 64 Times in 40 Posts

  8. #6
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts
    Quote Originally Posted by xezz View Post
    ​let me check later

  9. #7
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts
    Quote Originally Posted by suryakandau@yahoo.co.id View Post
    ​let me check later

    this is the result of silesia benchmark, compression time is very fast
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	silesia.PNG 
Views:	124 
Size:	22.1 KB 
ID:	7260   Click image for larger version. 

Name:	silesia1.PNG 
Views:	57 
Size:	14.8 KB 
ID:	7261   Click image for larger version. 

Name:	silesia2.PNG 
Views:	42 
Size:	7.0 KB 
ID:	7262  

  10. #8
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts

    crush v1.5

    improve compression ratio from crush v1.0 size 279491430 bytes to 257210635 bytes (7.97%)
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	crushv1.5.PNG 
Views:	28 
Size:	20.0 KB 
ID:	7266  
    Attached Files Attached Files

  11. #9
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts

    Crush v1.6

    Quote Originally Posted by suryakandau@yahoo.co.id View Post
    improve compression ratio from crush v1.0 size 279491430 bytes to 257210635 bytes (7.97%)

    this is Crush v1.6 with small compression ratio improvement from crush v1.5
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	crushv1.6.PNG 
Views:	35 
Size:	39.6 KB 
ID:	7270  
    Attached Files Attached Files

  12. #10
    Member
    Join Date
    Dec 2012
    Location
    japan
    Posts
    165
    Thanks
    31
    Thanked 64 Times in 40 Posts
    small file compression is worse.

  13. #11
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts
    Quote Originally Posted by xezz View Post
    small file compression is worse.
    compared to bcrush or crush v1.1 ? which small file ?
    crush v1.6 beat bcrush on webster file (silesia benchmark)

  14. #12
    Member jibz's Avatar
    Join Date
    Jan 2015
    Location
    Denmark
    Posts
    124
    Thanks
    106
    Thanked 71 Times in 51 Posts
    Quote Originally Posted by suryakandau@yahoo.co.id View Post
    compared to bcrush or crush v1.1 ? which small file ?
    crush v1.6 beat bcrush on webster file (silesia benchmark)
    Is your version compatible with the original crush format? bcrush with --optimal flag was supposed to be bit-optimal for that format, so if you are beating it with the same data format there must be a bug in bcrush.

  15. #13
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts
    Quote Originally Posted by jibz View Post
    Is your version compatible with the original crush format? bcrush with --optimal flag was supposed to be bit-optimal for that format, so if you are beating it with the same data format there must be a bug in bcrush.
    i don't test it with original crush format so i don't know it compatible or not.
    from bcrush webpage there is the result for silesia benchmark . is it use --optimal flag ? if yes so there is a bug in bcrush because crush v1.6 can beat bcrush on webster file.

  16. #14
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts

    Crush v1.7

    very small improvements, but compression and decompression speed is very fast. decompression time for webster file only 1.17s. is it still pareto frontier ?
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	crushv1.7.PNG 
Views:	28 
Size:	16.8 KB 
ID:	7273  
    Attached Files Attached Files

  17. #15
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts
    Quote Originally Posted by suryakandau@yahoo.co.id View Post
    very small improvements, but compression and decompression speed is very fast. decompression time for webster file only 1.17s. is it still pareto frontier ?
    this is the result for enwik8
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	crushv1.7a.PNG 
Views:	40 
Size:	7.3 KB 
ID:	7275  

  18. #16
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts
    Quote Originally Posted by suryakandau@yahoo.co.id View Post
    this is the result for enwik8

    crush v1.7 beat osdb file too compared to bcrush
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	silesia.PNG 
Views:	40 
Size:	26.7 KB 
ID:	7276  

  19. #17
    Member
    Join Date
    Apr 2015
    Location
    Greece
    Posts
    109
    Thanks
    38
    Thanked 29 Times in 20 Posts
    An other test with enwik8 for bcrush

    Code:
    30017634 bytes
    221m18.11s real   220m57.49s user     0m11.91s system
    Speed is like 7.5KB/s. I looked into the code and i have to admit bcrush's code is very beautiful. The problem is that it uses hash chains which are very slow. It is better to use trees like other compressors.

    EDIT: Also tested crush 1.7. Not compatible with original crush.
    Last edited by algorithm; 19th January 2020 at 22:15.

  20. Thanks (2):

    jibz (20th January 2020),suryakandau@yahoo.co.id (20th January 2020)

  21. #18
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts

    Crush v1.9

    -improve compression ratio
    -compression time fast
    - decompression time fast
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	crushv1.9.PNG 
Views:	27 
Size:	11.7 KB 
ID:	7280  
    Attached Files Attached Files

  22. #19
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts
    this is the result of enwik8 using crush v1.9
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	enwik8.PNG 
Views:	37 
Size:	24.6 KB 
ID:	7281  

  23. #20
    Member
    Join Date
    Dec 2012
    Location
    japan
    Posts
    165
    Thanks
    31
    Thanked 64 Times in 40 Posts
    ​compared with v1.3 and v1.6.test file is http://corpus.canterbury.ac.nz/resou...antrbry.tar.gz


    alice29.txt 55671 57655
    asyoulik.txt 51400 53759
    cp.html 9124 9570
    fields.c 3548 3829
    lcet10.txt 137865 140757
    plrabn12.txt 191857 196300
    sum 14099 15244
    xargs.1 2095 2266

  24. #21
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts
    Quote Originally Posted by xezz View Post
    ​compared with v1.3 and v1.6.test file is http://corpus.canterbury.ac.nz/resou...antrbry.tar.gz


    alice29.txt 55671 57655
    asyoulik.txt 51400 53759
    cp.html 9124 9570
    fields.c 3548 3829
    lcet10.txt 137865 140757
    plrabn12.txt 191857 196300
    sum 14099 15244
    xargs.1 2095 2266

    i improve it just for big file

  25. #22
    Member
    Join Date
    Aug 2015
    Location
    indonesia
    Posts
    377
    Thanks
    55
    Thanked 68 Times in 54 Posts
    Quote Originally Posted by suryakandau@yahoo.co.id View Post
    i improve it just for big file
    this is the silesia benchmark result using crush v1.9
    now it can beat nci file beside osdb n webster file.
    btw @xezz what means by file corrupted: s=-2032 ?
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	silesia1.PNG 
Views:	28 
Size:	23.6 KB 
ID:	7282   Click image for larger version. 

Name:	silesia2.PNG 
Views:	25 
Size:	20.5 KB 
ID:	7283   Click image for larger version. 

Name:	silesia3.PNG 
Views:	30 
Size:	9.8 KB 
ID:	7284  

  26. #23
    Member
    Join Date
    Dec 2012
    Location
    japan
    Posts
    165
    Thanks
    31
    Thanked 64 Times in 40 Posts
    ​may be bad offset. it is larger than current position.

  27. Thanks:

    suryakandau@yahoo.co.id (24th January 2020)

Similar Threads

  1. CRUSH 0.01 is here!
    By encode in forum Data Compression
    Replies: 52
    Last Post: 20th January 2020, 10:37
  2. Crush v1.2
    By suryakandau@yahoo.co.id in forum Data Compression
    Replies: 2
    Last Post: 12th January 2020, 13:33
  3. crush v1.1
    By xezz in forum Data Compression
    Replies: 0
    Last Post: 16th August 2016, 08:54

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •