Results 1 to 26 of 26

Thread: Quad 1.04a has been released! [!]

  1. #1
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    This is a rebirth of Quad! This version has MUCH higher compression ratio and at the same time higher compression speed at the cost of decompression speed. Note that this program in terms of compression ratio vs. compression time is my best creation! Also note that Quad 1.04a requires about 160 MB of free RAM, so you must have at least 256 MB RAM installed.

    Anyway, enjoy!

    Link:
    quad104a.zip (38 KB)


  2. #2
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Awesome! The power is amazing.

  3. #3
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    First results...

    A10.jpg > 830,494
    AcroRd32.exe > 1,305,394
    english.dic > 819,389
    FlashMX.pdf > 3,692,336
    FP.log > 578,101
    MSO97.dll > 1,715,654
    ohs.doc > 784,955
    rafale.bmp > 1,003,503
    vcfiu.hlp > 603,346
    world95.txt > 577,764

    Total = 11,910,936 bytes

    Very quick compression/decompression time!

  4. #4
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    ENWIK8 > 27,712,832 bytes

    This test also returned VERY QUICK compression/decompression time.

  5. #5
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    PHT.psd (6,755,163 Bytes) compresses to 1,014,035 Bytes

    Compression time: 14.453 seconds

    Decompression time: 6.296 seconds

    Awesome speed!

  6. #6
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Very fast and good compression! Good Work!

  7. #7
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quad now has an excellent balance of good compression and amazing speed.

    What next for Quad?

  8. #8
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by LovePimple
    What next for Quad?
    First of all, Ill wait for testing results (MFC, Squeeze Chart 2007, ...).

    After that, who knows, probably Ill write some GUI or 7-Zip/Total Commander Plugin based on new compression...

    Or this engine will be added to PeaZip...

    However, this engine must be carefully tested for both performance and reliability.


  9. #9
    Member
    Join Date
    Dec 2006
    Posts
    611
    Thanks
    0
    Thanked 1 Time in 1 Post
    Thanks!

    12,565,938 bytes
    Compression ~700kB/s, decompression ~800kB/s - that's incredible!

  10. #10
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quote Originally Posted by encode
    Or this engine will be added to PeaZip...
    This is a great little engine but I would much prefer the TC engine added to PeaZip.

  11. #11
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    As I had already said would be fantastic to see also all and two form to you in Peazip why they have high velocity and great jam! If you succeed to little improve the TC speed this it is sure the best one!

  12. #12
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Good news! I invent a new modeling trick of LZ output. With Quad, this trick gives some compression improvement with no speed loss! The compression improvement is depends on data, but in average, this gives nice compression gain. Now I am experimenting with this idea, but even at this stage, this thing shows nice results, for example, improvement on english.dic is over 15 KB!


  13. #13
    Member
    Join Date
    Dec 2006
    Posts
    611
    Thanks
    0
    Thanked 1 Time in 1 Post
    Quote Originally Posted by encode
    Good news! I invent a new modeling trick of LZ output.
    Good work encode

  14. #14
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quote Originally Posted by encode
    Good news! I invent a new modeling trick of LZ output. With Quad, this trick gives some compression improvement with no speed loss! The compression improvement is depends on data, but in average, this gives nice compression gain. Now I am experimenting with this idea, but even at this stage, this thing shows nice results, for example, improvement on english.dic is over 15 KB!
    Thats quite an impressive gain! Hopefully this will improve ENWIK8/9 results.

  15. #15
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    While Im experimenting and thinking about better implementation, look at some testing results:

    Quad 1.05a

    SFC
    A10.jpg: 830,494 bytes
    acrord32.exe: 1,302,718 bytes
    english.dic: 802,917 bytes
    FlashMX.pdf: 3,691,294 bytes
    fp.log: 571,848 bytes
    mso97.dll: 1,713,249 bytes
    ohs.doc: 783,423 bytes
    rafale.bmp: 1,001,231 bytes
    vcfiu.hlp: 600,482 bytes
    world95.txt: 573,489 bytes

    Total: 11,871,145 bytes
    Large Text Benchmark
    ENWIK8: 27,606,392 bytes
    ENWIK9: 238,523,840 bytes
    pht.psd
    pht.psd: 1,012,807 bytes
    I hope this version will be released within 1...3 weeks.


  16. #16
    Member
    Join Date
    Jun 2008
    Location
    G
    Posts
    372
    Thanks
    26
    Thanked 22 Times in 15 Posts
    coool

    I hope you will release in 1 week.

  17. #17
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Its looking good, but is it possible to improve the ENWIK8/9 compression?

  18. #18
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by LovePimple
    Its looking good, but is it possible to improve the ENWIK8/9 compression?
    To achieve higher compression on text files I must use a higher order model. In this case speed will be significantly affected. Also I can improve compression with a larger dictionary and hash table, but since Im making something usable I will not do that.

    Quote Originally Posted by thometal
    I hope you will release in 1 week.
    Im just also experimenting with some other things like improved EXE-filter. In addition, Im very pedantic with my programs...


  19. #19
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Hi!
    Congratulations for QUAD compressor. Its really fast and compresses very good.

    Quote Originally Posted by encode
    Good news! I invent a new modeling trick of LZ output. With Quad, this trick gives some compression improvement with no speed loss!
    This is really impressive!

    Quote Originally Posted by encode
    Im just also experimenting with some other things like improved EXE-filter. In addition, Im very pedantic with my programs...
    What exactly does this exe-filter do? Does it "jmp & call" or do you do additional things like "jxx", tables? But I do understand if you dont want to tell.

    Keep up your amazing work!

    Regards, Chris

  20. #20
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by Christian
    What exactly does this exe-filter do? Does it "jmp & call" or do you do additional things like "jxx", tables?
    Currently, Quad uses an EXE filter similar to CABARC:

    E8/E9 + it checks for valid reference. So, bad commands just ignored. This gives excellent results with single executables, but it works not so well on TAR files with lots of exe and other files.

    Previously, I use in my programs a BCJ like filter:

    E8/E9 + 0/255 checking + reverse bytes. This approach shows better results on TAR files. Probably, Ill use this filter.

    By the way, what kind of filter used in your CCM?


  21. #21
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Quote Originally Posted by encode
    Previously, I use in my programs a BCJ like filter:

    E8/E9 + 0/255 checking + reverse bytes. This approach shows better results on TAR files. Probably, Ill use this filter.

    By the way, what kind of filter used in your CCM?
    I use this method but without the reverse part. I think I should try this out as it might possibly create longer matches.

    Do you gain much by reversing the bytes?

  22. #22
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by Christian
    Do you gain much by reversing the bytes?
    This gives some nice gain, especially on EXE files. Note that in some cases this can even hurt compression. However, Ive found better use this trick.


  23. #23
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    By the point, do you use any kind of auto-detection or fiter is always enabled?

  24. #24
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    No. The filter is always enabled. I don't know if detection is a good/bad thing speed-wise. But since I found that the filter doesn't really hurt compression on non-EXE files I didn't feel like doing any detection.

  25. #25
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by Christian
    No. The filter is always enabled. I dont know if detection is a good/bad thing speed-wise. But since I found that the filter doesnt really hurt compression on non-EXE files I didnt feel like doing any detection.
    Thank you for information!

  26. #26
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Well, Quad's code was significantly changed. I completely rewritten many parts of code, made many speed improvements. Probably, I'll keep some speed improvements at the cost of compression. However, performance at SFC must be 11,8xx,xxx bytes.


Similar Threads

  1. QUAD 1.10 has been released!
    By encode in forum Forum Archive
    Replies: 10
    Last Post: 22nd March 2007, 12:40
  2. QUAD 1.08 has been released!
    By encode in forum Forum Archive
    Replies: 28
    Last Post: 16th March 2007, 12:17
  3. quad 1.03a has been released!
    By encode in forum Forum Archive
    Replies: 23
    Last Post: 7th February 2007, 21:23
  4. quad 1.02a has been released!
    By encode in forum Forum Archive
    Replies: 56
    Last Post: 20th January 2007, 15:03
  5. quad 1.01a has been released!
    By encode in forum Forum Archive
    Replies: 25
    Last Post: 1st January 2007, 22:50

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •