Page 1 of 3 123 LastLast
Results 1 to 30 of 77

Thread: PIM 2.01 (beta) is here!

  1. #1
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts

  2. #2
    Member Vacon's Avatar
    Join Date
    May 2008
    Location
    Germany
    Posts
    523
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Thank you Ilia!

  3. #3
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Good results in all file type! Best fo BMP!

  4. #4
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Awesome!

  5. #5
    Tester

    Join Date
    May 2008
    Location
    St-Petersburg, Russia
    Posts
    182
    Thanks
    3
    Thanked 0 Times in 0 Posts
    Great! BMP filter is one of the best!
    What about adding in future special filter for WAV?

  6. #6
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    I tried a few WAV-filters, with PPMd they give just a small gain. Overall, it's not worth it. Note that PPMd (and all PPM-based algorithms) works not so good on analog/noisy data. Probably, some day, I'll add an advanced WAV filter or even specialized WAV compression.

  7. #7
    Tester

    Join Date
    May 2008
    Location
    St-Petersburg, Russia
    Posts
    182
    Thanks
    3
    Thanked 0 Times in 0 Posts
    Cool! Good luck with your experiments!

  8. #8
    Tester

    Join Date
    May 2008
    Location
    St-Petersburg, Russia
    Posts
    182
    Thanks
    3
    Thanked 0 Times in 0 Posts

  9. #9
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Thank you!

  10. #10
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 779 Times in 486 Posts

  11. #11
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Thank you Matt!

  12. #12
    Member
    Join Date
    Dec 2006
    Posts
    611
    Thanks
    0
    Thanked 1 Time in 1 Post
    Thanks encode! It performs generally better than v1.50 with exception of my Photoshop file, which gets compressed 1,7MB worse

    Another question: Do all PNG saving programs use zlib compression (only those 4 or so possible outputted files)? I tried to compress my test PNG firstly as a PNG and secondly resaved to BMP -> PIM compressed png to 237kB and bmp to 136kB! So if there was a way to restore original PNG back from BMP, it could boost compression a lot sometimes

  13. #13
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by Black_Fox
    exception of my Photoshop file, which gets compressed 1,7MB worse
    PIM 1.x make use of LZP. This file contains some sort of two copies of the same picture - LZ just copies first string, pure PPM cant do that.

    Quote Originally Posted by Black_Fox
    So if there was a way to restore original PNG back from BMP, it could boost compression a lot sometimes
    Many times I tested my algos against widespread lossless ones like GIF or PNG. My algos just more progressive compared to RLE, LZW or Deflate. Not sure about Deflate, but with RLE/LZW I think it is possible to restore bit-to-bit identical image without an extreme computation.

  14. #14
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    By the way, currently I'm working on 2.02 beta, along with some surprise features, I will add the most missed feature - opening file inside an archive - i.e. double-click on a file will automatically extracts and runs it. Just a question, where should PIM extract these files:
    1. Current folder (which contains current archive)
    2. Temp folder (standard Windows temp dir)


  15. #15
    Member
    Join Date
    Dec 2006
    Posts
    611
    Thanks
    0
    Thanked 1 Time in 1 Post
    Temp folder surely And if you could add one more feature, please: When dropping file onto PIM's window with opened archive inside, don't "open archive", but "add file".

  16. #16
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by Black_Fox
    When dropping file onto PIMs window with opened archive inside, dont "open archive", but "add file".
    When I add ability to add a file to an existing archive I will do so.

  17. #17
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    What I've done already with PIM v2.02:
    + I removed all junk/ballast features, including QUAD/QUAKE PAK archives support. Firstly, to increase the performance of the main format. Note that PIM is not bundled software like IZArc which has insane number of supported archive formats and hasn't own format. PIM is about own high-performance archive format. In other words it's about compression.
    So, with new version I focused on main archive format. For example, I already rewrote the archive handling routines, including ZIP ones in favor to improve performance.
    having said that I tried to add RAR and LHA support these days.
    RAR - has too many features and add full support is not a trivial task. Note that all archive/compression routines was written by myself from scratch, including ZIP ones. I implemented the listing of a RAR archive - it works some how. After I refuse that.
    LHA - has 3 level of headers. First was supported by old archivers, then an updated version of header became, and after again author changed specifications. So, now LHA is very strange and buggy format. I wrote a version for LHA with Level 0 headers all works fine, including my own implementation of CRC16 checksum used with LHA archives. In addition, I played with decompression for Store/Frozen-5 methods, again all works fine. Anyway, today Header-2 Level is standard (It's funny but WinAce creates LZH/LHA archives with Level 0 header). Finally, I drop this idea with LHA archives. Having said that compression of LHA is poor, plus CRC16 instead of CRC32, plus buggy specs...
    Anyway, what I've done with PIM:
    + Removed options for enabling/disabling executable/true color compression. Each time PIM will automatically detect file type and perform algo selection.
    + Added TIFF file compression. Now PIM can read TIFF files (Both IBM and MAC types, and if picture in RGB 24-bit format use special compression). For example waterloo test-set consists of tiff files.
    Results:
    PIM 2.01: 4,573,834 bytes
    PIM 2.02: 3,583,184 bytes
    A nice gain, isn't it?
    + Added open file inside an archive feature, mentioned above.
    + Small GUI changes.
    Continue working...


  18. #18
    qqwertyy
    Guest
    2616175616 CS counter-strike-1.6 custom_maps
    1142055900 CS-1.6.pim pim-2.0.1b PPMd executable true_color
    1103985468 CS-1.6.7z p7zip-4.47b 7za a -t7z -mx=9 -md=32m -ms=off

    зы
    Deflate64 is not supported in zip files

  19. #19
    Tester

    Join Date
    May 2008
    Location
    St-Petersburg, Russia
    Posts
    182
    Thanks
    3
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by encode
    + Added TIFF file compression. Now PIM can read TIFF files (Both IBM and MAC types, and if picture in RGB 24-bit format use special compression)
    coool!!!

  20. #20
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by qqwertyy
    Deflate64 is not supported in zip files
    I will add the Deflate64 support to upcoming PIM 2.02!

  21. #21
    Member
    Join Date
    Jun 2007
    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Nice job with PIM so far.

    However, is it going to be possible to add files to existing archives in the near future? I can't manage to do that in PIM 2.01 beta.

  22. #22
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Stuck in the middle with Deflate64!!! Damn algo! To few info about this rare creature. 7-Zip uses custom implementation. I make use of modified zlib, but zlib wont support Deflate64, it has a patch named InfBack9, but callbacks... its buggy...

    Quote Originally Posted by Alex
    However, is it going to be possible to add files to existing archives in the near future?
    It is possible. Furthermore, I already tested such feature, it worked, but sometimes worked buggy. These days I will retest such thing!

  23. #23

  24. #24
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Thanks! I will additionally dig for info! Info-Zip supports Deflate64. By the way WinRAR uses Info-Zip.

  25. #25
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    X. Enhanced Deflating - Method 9
    --------------------------------

    The Enhanced Deflating algorithm is similar to Deflate but
    uses a sliding dictionary of up to 64K. Deflate64(tm) is supported
    by the Deflate extractor.

    [This description is inofficial. It has been deduced by Info-ZIP from
    close inspection of PKZIP 4.x Deflate64(tm) compressed output.]

    The Deflate64 algorithm is almost identical to the normal Deflate algorithm.
    Differences are:

    - The sliding window size is 64k.

    - The previously unused distance codes 30 and 31 are now used to describe
    match distances from 32k-48k and 48k-64k.
    Extra
    Code Bits Distance
    ---- ---- -----------
    .. .. ...
    29 13 24577-32768
    30 14 32769-49152
    31 14 49153-65536

    - The semantics of the "maximum match length" code #258 has been changed to
    allow the specification of arbitrary large match lengths (up to 64k).
    Extra
    Code Bits Lengths
    ---- ---- ------
    ... .. ...
    284 5 227-258
    285 16 3-65538

    Whereas the first two modifications fit into the framework of Deflate,
    this last change breaks compatibility with Deflate method 8. Thus, a
    Deflate64 decompressor cannot decode normal deflated data.

  26. #26
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Found info how to use InflateBack/InflateBack9!

  27. #27
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quote Originally Posted by encode
    Found info how to use InflateBack/InflateBack9!
    Excellent!

  28. #28
    Member
    Join Date
    Jun 2007
    Posts
    7
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by encode
    Found info how to use InflateBack/InflateBack9!
    Very nice!

  29. #29
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Victory!

    Added Deflate64 support!

    In addition, I optimized ZIP BZip2 decompression.

  30. #30
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quote Originally Posted by encode
    Added Deflate64 support!

Page 1 of 3 123 LastLast

Similar Threads

  1. PIM 2.40 BETA is here!
    By encode in forum Data Compression
    Replies: 19
    Last Post: 26th February 2009, 18:39
  2. PIM v2.41 BETA is here!
    By encode in forum Data Compression
    Replies: 33
    Last Post: 19th July 2008, 23:11
  3. PIM 1.25 beta is here!
    By encode in forum Forum Archive
    Replies: 22
    Last Post: 3rd October 2006, 19:27
  4. PIM 1.20 beta is here!
    By encode in forum Forum Archive
    Replies: 20
    Last Post: 25th September 2006, 13:37
  5. PIM 1.05 beta is here!
    By encode in forum Forum Archive
    Replies: 11
    Last Post: 14th August 2006, 17:24

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •