Results 1 to 14 of 14

Thread: PIMPLE2 compression

  1. #1
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    PIMPLE2 is a new data compression engine for the PIM v2 archiver - a further evolution of my CM compression. Its intended to bury PIMPLE v1!

    Its at almost written, now Im testing/tuning it - just thinking how much memory/time I can spend on super-compression without going out of bounds of the real world.

    Check out some results of the test build version of PIMPLE2. Note that probably I will change the memory usage and other parameters as a result the compression can became slightly higher or lower.

    Memory usage: ~140 MB
    PIMPLE2 at SFC
    A10.jpg: 829,961 bytes
    acrord32.exe: 1,179,535 bytes
    english.dic: 559,083 bytes
    FlashMX.pdf: 3,648,878 bytes
    fp.log: 436,647 bytes
    mso97.dll: 1,556,940 bytes
    ohs.doc: 749,606 bytes
    rafale.bmp: 732,003 bytes
    vcfiu.hlp: 502,825 bytes
    world95.txt: 445,213 bytes
    Total: 10,640,691 bytes
    Having said that this is the best thing Ive ever made!

    PIMPLE2 fits in SFC top ten, outperforming CCM and others!

    One thing - its slow. However, its faster than WinUDA or PAQ6...

    Watch for updates!


  2. #2
    Member
    Join Date
    Dec 2006
    Posts
    611
    Thanks
    0
    Thanked 1 Time in 1 Post
    Great!! That's amazing news, encode Is it going to have about same speed as v1?

  3. #3
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Depending on settings of PIMPLE v1. If you use PIMPLE v1 with presets PIMPLE2 slower.

    Comparison:

    MPTRACK.EXE (1,159,172 bytes)

    PIMPLE, Extreme preset: 448,771 bytes, 11 sec
    PIMPLE2: 418,328 bytes, 23 sec

    Two times slower. Anyway, overall, compression is MUCH higher!


  4. #4
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    For example:

    reaktor.exe (14,446,592 bytes)

    PIMPLE, Extreme preset: 1,858,425 bytes
    PIMPLE2: 1,632,466 bytes


  5. #5
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quote Originally Posted by encode
    Its intended to bury PIMPLE v1!
    NOW - This is more like it!

  6. #6
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Very Good job!

  7. #7
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Quote Originally Posted by encode
    PIMPLE2 fits in SFC top ten, outperforming CCM and others!
    Damn it!! ... Just joking, good job Ilia!

    Now, youve just to speed it up some more. But Im sure you will - the algorithm is still very young.

  8. #8
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by Christian
    But Im sure you will - the algorithm is still very young.
    Yepp... However, it belongs to PIMPLE/TC legacy - i.e. I collect all my ideas in one place focusing on compression only. To be honest, compression still can be higher, but speed... - each compression improvement makes PIMPLE2 2X and more times slower. So, at some point my goal is to find a HIGH compression with reasonable time. In addition, I think I will keep memory usage below 200 MB or something - so users with just say 256 MB of RAM can use it. Note that with PIM2/PPMd (var I) I use the same parameters as WinZip 11 make use (order 16, 64 MB, restart model). This is one of the best settings for PPMd - a higher model size can hurt compression on binary data, rebuilding model takes too much time... And so with PIMPLE2, it uses only a few models which keeps statistics in very compact way and with higher amounts of memory usage we even can loose the copression. Anyway, Im under experiments...

  9. #9
    Tester

    Join Date
    May 2008
    Location
    St-Petersburg, Russia
    Posts
    182
    Thanks
    3
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by encode
    Total: 10,640,691 bytes
    Great!
    9th plase in SFC Top 10! (it beats CCM!)
    Wait for release!

  10. #10
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Testing... But I'm unhappy with speed. Even TC is much faster, especially with highly redundant data.

    What I've done with PIMPLE2 is I removed any LZ layers as a result I loose speed and gain compression - adding a new Match model.

    In addition, PIMPLE2 has a new Sparse model - which gives very nice compression gain and 2X speed loss.

    Again, I can't understand how Chris make his CCM so fast? If it uses many models, etc.

    Chris, maybe you share with us about your secret?

    I compared PIMPLE2 to PAQ1 - and PAQ1 is faster!

    Anyway, I have some ideas to check...

  11. #11
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 779 Times in 486 Posts
    How is PIMPLE2? I see it benchmarked on maximumcompression.com but no release?

  12. #12
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    It was released some time ago and available here:
    pimple2.zip


  13. #13
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts

  14. #14
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 779 Times in 486 Posts
    OK, thanks. I didn't see the original link.

Similar Threads

  1. PIMPLE2 is here!
    By encode in forum Forum Archive
    Replies: 10
    Last Post: 8th August 2007, 18:51

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •