Page 1 of 2 12 LastLast
Results 1 to 30 of 47

Thread: PIM 2.00 (alpha) is here!!!

  1. #1
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Okay, this' the biggest update of PIM ever!

    What's new, highlights:
    + Added the brand new PIM2 archive format featuring Store/PPMd compression and CRC32 checking
    + Fixed a bug with ZIP archives crash
    + Improved ZIP-file handling - now you can view encrypted ZIP archives (encrypted files marked with "+" symbol)
    + Now PIM will skip existing files during extraction
    + Many code optimizations and improvements
    + Improved GUI, Vista styled menu icons

    Enjoy!

    Note that this is just an alpha release! Be careful, program can contain bugs. Do not use it for important data and after each compression operation check an archive integrity (Test command)!

    Please, check it for:
    + Compatibility with PIM v1.x
    + ZIP file support, including with ZIP files produced with WinRAR (InfoZIP) and WInZIP 10/11 (BZip2/PPMd)

    Post your comments, impressions and suggestions here!

    Link:
    pim200.zip (362 KB)


  2. #2
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Seem a well done job, compliment, but I expected me that the compression I inserted LZPM!

  3. #3
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Awesome! Thanks Ilia!

  4. #4
    Member
    Join Date
    Jan 2007
    Location
    Moscow
    Posts
    239
    Thanks
    0
    Thanked 3 Times in 1 Post
    Nice minimalistic interface. But i'd like to see big buttons line

  5. #5
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by Black_Fox (KGB Forum)
    Could you make it so that the archive is not solid and files can be separately added and extracted? Especially for extracting only some files this would greatly reduce time needed!
    ...
    By the way, PIM v2 uses non solid archives, and this can be very useful with slow CM compression (upcoming PIMPLE2). You can simply extract any file - no need to extracting all previous files. For example if you have a large archive and you need just one file - you can get it fast!


  6. #6
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    What's next:
    + I think I will add the LZPM compression as the main compression of PIMv2. The unreleased LZPM 0.07 will be used (which includes E8/E9 transformer similar to QUAD). With tunable parameter like Max optimise lookhead (Longest optimised match) and fast decompression it's a good candidate.
    + PPMd will kept for good overall and high text compression.
    + WIll wait with PIMPLE2 adding - algorithm too young!
    + I will continue improving ZIP file support.
    + Step-by-step will add the RAR-archive support (at least browsing support - for fun)
    + Some small GUI improvements
    Huge list...

  7. #7
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    FANTASTIC NOTICE !

  8. #8
    Tester

    Join Date
    May 2008
    Location
    St-Petersburg, Russia
    Posts
    182
    Thanks
    3
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by encode
    fast decompression its a good candidate
    Great!

  9. #9
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    I like your plans!

  10. #10
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Another variant is LZMA. But, it's slower at compression. However, it shows very good perormance on binary data - and combining LZMA/PPMd (auto algo switching)...

    In coparison, LZPM is my own compression technology. It has a fast compression (mode 0) and fast decompression (much like LZMA). It can be used as a replacement for Deflate - thus I call it modern LZ. Actualy it uses ROLZ. Can I call it ROLZ in my archiver?

    Post your ideas here!

  11. #11
    Tester

    Join Date
    May 2008
    Location
    St-Petersburg, Russia
    Posts
    182
    Thanks
    3
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by encode
    combining LZMA/PPMd (auto algo switching)
    It seems to me, it will be great if youll include both lzma and lzpm in Pim (with settings for choice method)

  12. #12
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    I like the idea of adding LZMA!

  13. #13
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    LZMA is very good Idea!

  14. #14
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    + Some small GUI changes (WinRAR like file list)
    + Fixed bug with an encrypted zip file which contains a directory entries
    + Added a nice feature:
    If compressed size is longer than original - file will be just stored with no compression. Of course super small files (< 8 bytes) not compressed. (PPMd cannot compress a file less than 8 bytes long).

    It's funny, but WinZip 11 has no such feature - compressed file can be larger than original.

  15. #15
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Got some problems adding LZPM (memory allocation inside a thread). Will delay LZPM adding. Instead, later, will try to add something different like LZMA/BZip2 or even Deflate.
    And currently will keep compression as is, but keep improving GUI, features, and support for ZIP and other archives.

  16. #16
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Tested various exe-filters with PPMd. One of the best is simplest E8 transformer.

    Some testing results:

    reaktor.exe (14,446,592 bytes):

    PIM 2.01 (alpha): 2,059,104 bytes
    PIM 2.01 (alpha) + EXEFLT: 1,951,068 bytes

    A nice gain. Maybe I should add this filter to PIM. Note that in this case you can control it's usage via settings dialog (Use EXE-filter option or something like that).

    NOTE: IF I'LL ADD SUCH FEATURE, I'LL PROBABLY BREAK COMPATIBILITY WITH CURRENT ALPHA. BE PREPARED - DO NOT USE AN ALPHA VERSIONS - THEY INTEDED FOR TESTING PURPOSES ONLY!

  17. #17
    Member Vacon's Avatar
    Join Date
    May 2008
    Location
    Germany
    Posts
    523
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Hello everyone,

    thank you for warning!
    But breaking compatibility with an earlier ALPHA shouldn't be a problem. I personaly consider them as "proof-of-concept"-versions.
    Breaking compatibility with earlier FINAL could be more serious...
    Anyway: your plans sound interesting.

    Best regards!

  18. #18
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by Vacon
    Breaking compatibility with earlier FINAL could be more serious...
    Note that the PIM v1 compatibility will be untouched. Its only about an alpha version - thats why I call it alpha...

  19. #19
    Member Vacon's Avatar
    Join Date
    May 2008
    Location
    Germany
    Posts
    523
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Hello everyone,

    Quote Originally Posted by encode
    Note that the PIM v1 compatibility will be untouched.
    Thats good news!

    Quote Originally Posted by encode
    ...thats why I call it alpha...
    I guess "beta" and "alpha" nowadays get new definitions, as many programmers (Igor with 7-zip for instance) call their new releases "beta" allthough its allmost "final".
    But with definition "alpha" all my red-lights go on ->
    I need not to have _every_ experience myself...
    Good luck with evoluting PIM 2!

  20. #20
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    I guess I will keep compatibility. Instead of adding a new transformType field I added a new method called ExePPMd.

    Currently I'm searching/testing for the best EXE-filter. Also I'm thinking how to call a new option in settings dialog. However, current test-filter works!

    Check out a screenshot:



  21. #21
    Member Vacon's Avatar
    Join Date
    May 2008
    Location
    Germany
    Posts
    523
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Hello everyone,

    since we are takling about the effect of evolution and compatibility:
    what about an SFX-modul?
    It could help archiving data and keep access even if next-generation programs loose compatibility (if OS supports the sfx-exe).

    Bestr regards!

  22. #22
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Well, like I said, PIM2 is too young and too many features already in TODO list...

    I'm working on compression, archive handling...

    By the way, probably I'll add not just generic EXE-filter, but something advanced... (separate streams for calls/jumps, defragmentation, etc)

  23. #23
    Member Vacon's Avatar
    Join Date
    May 2008
    Location
    Germany
    Posts
    523
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Hello everyone,

    was just a question!
    Haste makes waste, so don't loose your aim!

    Best regards!

  24. #24
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts

  25. #25
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    In addition, I think I'll change the main compression from PPMd var. I to PPMd var J. (latest). This will break compatibiliry with latest alpha. Anyway, var. J has better comression!

  26. #26
    Member
    Join Date
    Dec 2006
    Posts
    611
    Thanks
    0
    Thanked 1 Time in 1 Post
    Good idea... why does winzip use var. I, when there's (according to readme) a bug?

  27. #27
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by Black_Fox
    why does winzip use var. I, when theres (according to readme) a bug?
    I think when WinZip developers added PPMd, PPMd var J was still unreleased. - i.e. in that times var. I was the latest. For example, 7-Zip and RAR also uses old versions of PPMd.

  28. #28
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    (Note that each version of PPMd is incompatible with others)

  29. #29
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Also, I'll probably remove ZIP PPMd decompression, to override chaos in PIM's source code. I think these days I should seriously focus on PIM's main compression. Using PPMd var.J + EXE filter will give PIM modern power since:
    Naturally, all MM data already compressed - here, if PIM cannot compress it will just store a file.
    PPMd shows supreme performance - it has really high text compression, and good binary compression. With an EXE transformer EXE compression even further improved.
    PPMd works better with non-solid mode - since outdated statistics often hurts compression, especially if you compress lots of different files. This is one of the reason why PIM v2 uses non-solid mode.

    So anyways, soon, I'll release a version with PPMd var. J. Later a new version with EXE-transformer. I just need make more experiments with EXEFLT to grab the best!

  30. #30
    Member Vacon's Avatar
    Join Date
    May 2008
    Location
    Germany
    Posts
    523
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Hello everyone,

    Quote Originally Posted by encode
    ...Ill probably remove ZIP PPMd decompression...
    hmm, wouldnt that remove (at least partial) compatibility with WinZip 11 which was one of your aims? At least decompression could be a fine feature, or have I missed something? How wide is PPMd spread in zip-files / how many people use it actually?

    Best regards!

Page 1 of 2 12 LastLast

Similar Threads

  1. M03 alpha
    By michael maniscalco in forum Data Compression
    Replies: 6
    Last Post: 10th October 2009, 01:31
  2. Replies: 9
    Last Post: 28th June 2007, 15:02
  3. PIM 2.00 (alpha) overview
    By encode in forum Forum Archive
    Replies: 21
    Last Post: 8th June 2007, 14:41

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •