Page 2 of 3 FirstFirst 123 LastLast
Results 31 to 60 of 66

Thread: FP8 (= Fast PAQ8)

  1. #31
    Administrator Shelwien's Avatar
    Join Date
    May 2008
    Location
    Kharkov, Ukraine
    Posts
    3,423
    Thanks
    223
    Thanked 1,053 Times in 565 Posts
    For threads/TLS there're keywords in modern compilers - like __thread and __declspec(thread)
    (simply have to add it to all static vars),
    but I still think that the problem is caused by floats.

  2. #32
    Member
    Join Date
    Jun 2012
    Location
    Poland
    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts
    1. Awesome work, Jan and Matt! I didn't really think PNG can be beaten nor that JPEGs can be compressed loselessy so much!
    2. FP8 is faster and usually makes smaller files than PAQ8O
    3. Neither PAQ8O nor FP8 can handle BMPs with OS/2 headers
    4. It would be great to add model to unRLE. This could reduce size of TGA and BMP twice! As far as I know there are only 2 popular ways to compress images to RLE: compress whole lines or entire image at once. So repacking to RLE BMP/RLE TGA should be quite easy.
    5. Unpacking PNG to BMP would be awesome but I guess packing it back into PNG could be hardcore because of many PNG "compression filters" (not sure if this is valid term)



  3. #33
    Member
    Join Date
    Jan 2013
    Location
    Location
    Posts
    4
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by Jan Ondrus View Post
    bug fix in jpegmodel
    should be a little slower with a little better compression ratio.
    Attached Files:
    File Type: zip fp8_v3.zip (139.4 KB, 631 views)
    Is this test build? Confirming because, its not listed at http://dhost.info/paq8/

  4. #34
    Programmer Jan Ondrus's Avatar
    Join Date
    Sep 2008
    Location
    Rychnov nad Kněžnou, Czech Republic
    Posts
    278
    Thanks
    33
    Thanked 137 Times in 49 Posts
    Quote Originally Posted by hofner View Post
    Is this test build? Confirming because, its not listed at http://dhost.info/paq8/
    No, I just forgot put it there. Now it should be ok...

  5. #35
    Member
    Join Date
    Jan 2013
    Location
    Location
    Posts
    4
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Thanks!

  6. #36
    Member
    Join Date
    Jul 2014
    Location
    Mars
    Posts
    180
    Thanks
    124
    Thanked 11 Times in 10 Posts
    [fp8_v3.cpp:4219]: (warning) %ld in format string (no. 1) requires 'long' but the argument type is 'int'.
    [fp8_v3.cpp:4225]: (warning) %ld in format string (no. 1) requires 'long' but the argument type is 'int'.
    [fp8_v3.cpp:3784] -> [fp8_v3.cpp:3872]: (warning) Either the condition 'if(in)' is redundant or there is possible null pointer dereference: in.
    [fp8_v3.cpp:4186] -> [fp8_v3.cpp:4185]: (warning) Either the condition '!archive' is redundant or there is possible null pointer dereference: archive.

    while compiling with gcc above 4.8.1 gives err:

    In member function 'void Array<T, ALIGN>::resize(int)': etc.
    Last edited by necros; 26th January 2016 at 14:33.

  7. #37
    Programmer Jan Ondrus's Avatar
    Join Date
    Sep 2008
    Location
    Rychnov nad Kněžnou, Czech Republic
    Posts
    278
    Thanks
    33
    Thanked 137 Times in 49 Posts

    fp8_v4

    Quote Originally Posted by Stephan Busch View Post
    Dear Jan,

    thank you very much for that new feature in paq8px_v70.
    Can you please also put AntiZ in your FP8?
    Here is version with zlib recompression as requested by Stephan Busch...
    Attached Files Attached Files

  8. Thanks (5):

    Cyan (12th March 2016),moisesmcardona (6th January 2019),necros (19th March 2016),schnaader (14th March 2016),Stephan Busch (13th March 2016)

  9. #38
    Member
    Join Date
    Jun 2013
    Location
    Sweden
    Posts
    150
    Thanks
    9
    Thanked 25 Times in 23 Posts
    I would like som help with this error (while trying creating win x64 compile):

    Z:\>c++ fp8_v4.cpp -DWINDOWS -lz -Wall -Wextra -O3 -static -static-libgcc -m64 -ofp8x64.exe
    fp8_v4.cpp:613:18: fatal error: zlib.h: No such file or directory
    compilation terminated.

    Z:\>DIR

    Volume in drive Z is unlabeled Serial number is 5566:7788
    Directory of Z:\*

    2016-03-12 17:59 165 697 fp8_v4.cpp
    2016-03-12 17:59 555 495 fp8_v4.exe
    2016-03-12 22:05 87 883 zlib.h

    Since I dont know which version of zlib.h i need, I just downloaded the first one I found.

  10. #39
    Member
    Join Date
    Sep 2015
    Location
    Italy
    Posts
    250
    Thanks
    109
    Thanked 146 Times in 107 Posts
    fp8_v4.ccp, line 613:
    #include <zlib.h>
    It search zlib.h in your c++ include directory, to display the directory:
    set include
    You can copy zlib.h in the c++ include directory or change line 613 to
    #include "zlib.h"
    (search .h files also in the current directory)
    Bye
    Mauro

  11. #40
    Programmer schnaader's Avatar
    Join Date
    May 2008
    Location
    Hessen, Germany
    Posts
    571
    Thanks
    219
    Thanked 205 Times in 97 Posts
    Result for Silesia Open Source Compression Benchmark:

    Code:
      Silesia dicke mozil   mr   nci ooff  osdb reym samba  sao webst x-ray  xml Compressor -options
    --------- ----- ----- ---- ----- ---- ----- ---- ----- ---- ----- ----- ---- -------------------
     35457761  2077  9458 2131  1040 1548  2166  866  2586 4281  5372  3635  291 fp8_v4 -8
    
     33307593  1893  9565 2020   838 1338  2020  770  2591 3767  4689  3568  244 cmix v8
     37586201  2078 11224 2132  1060 1549  2167  866  2887 4283  5410  3635  291 fp8_v3 -7
    Test system: Intel i5 M520 @ 2.4 GHz, 4 GB RAM.

    Decompression OK, total time: about 3086 seconds (51 minutes) for compression, 2950 seconds (49 minutes) for decompression.
    http://schnaader.info
    Damn kids. They're all alike.

  12. #41
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    876
    Thanks
    474
    Thanked 175 Times in 85 Posts
    FP8_v4 shows impressive results and it also seems to be a bit faster than FP8_v3.
    Very well done, Jan.
    I'll put the results online later.
    Could you also please include LZSS recompression from PAQ8PXX_v17
    and since PAQ8PXD_v12 both record and wav model is used only when needed - can you please include that too??
    In PAQ8PXD_v10 they state to have fixed the JPEG error of FP8 - is it fixed here too?

  13. #42
    Programmer Jan Ondrus's Avatar
    Join Date
    Sep 2008
    Location
    Rychnov nad Kněžnou, Czech Republic
    Posts
    278
    Thanks
    33
    Thanked 137 Times in 49 Posts
    Quote Originally Posted by Stephan Busch View Post
    FP8_v4 shows impressive results and it also seems to be a bit faster than FP8_v3.
    Very well done, Jan.
    I'll put the results online later.
    Could you also please include LZSS recompression from PAQ8PXX_v17
    and since PAQ8PXD_v12 both record and wav model is used only when needed - can you please include that too??
    In PAQ8PXD_v10 they state to have fixed the JPEG error of FP8 - is it fixed here too?
    I plan to put base64 transformation from pxd version and new gif precompression first into paq8px_v72.
    No idea about JPEG error. Do you have file where it crash or not work properly?

  14. Thanks:

    Stephan Busch (16th March 2016)

  15. #43
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    876
    Thanks
    474
    Thanked 175 Times in 85 Posts
    No I don't have such a file. I was just reading what changes where done in PAQ8PXD versions
    and thought about what would be useful in your versions from my point of view.

    it is described here - but I don't know if they use FP8 code to fix PAQ8PXD or the other way round.
    http://encode.su/threads/1464-Paq8pxd-dict/page2

  16. #44
    Member
    Join Date
    May 2008
    Location
    Estonia
    Posts
    414
    Thanks
    155
    Thanked 245 Times in 134 Posts
    Quote Originally Posted by Stephan Busch View Post
    No I don't have such a file. I was just reading what changes where done in PAQ8PXD versions
    and thought about what would be useful in your versions from my point of view.

    it is described here - but I don't know if they use FP8 code to fix PAQ8PXD or the other way round.
    http://encode.su/threads/1464-Paq8pxd-dict/page2
    Problem was with next jpeg file. First file compressed fine but next was not compressed with jpeg model. FP8 should work fine.
    KZo


  17. #45
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    876
    Thanks
    474
    Thanked 175 Times in 85 Posts
    Dear jan,

    can you please also add your GIF recompressor of PAQ8PX to FP8?
    There are also some audio parts in .IT, .MPTM, .XM and .SF2 that are not detected by FP8
    and some JPEG that cannot be detected inside camera raw. Please check that when you have time.

  18. #46
    Programmer Jan Ondrus's Avatar
    Join Date
    Sep 2008
    Location
    Rychnov nad Kněžnou, Czech Republic
    Posts
    278
    Thanks
    33
    Thanked 137 Times in 49 Posts

    fp8_v5

    imported some changes from paq8px_v76b version (gif recompression, base64 recompression, jpeg improvements from mpais)
    Attached Files Attached Files

  19. Thanks (5):

    Christoph Diegelmann (12th July 2017),Darek (11th July 2017),Mike (10th July 2017),moisesmcardona (6th January 2019),Stephan Busch (10th July 2017)

  20. #47
    Member
    Join Date
    May 2012
    Location
    United States
    Posts
    324
    Thanks
    182
    Thanked 53 Times in 38 Posts
    Following Shelwien's suggestions from paq8px thread, here is a faster version compiled with GCC 7.0.

    Could potentially be even faster though...
    Attached Files Attached Files

  21. Thanks:

    Darek (13th July 2017)

  22. #48
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    962
    Thanks
    573
    Thanked 397 Times in 295 Posts
    Quote Originally Posted by comp1 View Post
    Following Shelwien's suggestions from paq8px thread, here is a faster version compiled with GCC 7.0.

    Could potentially be even faster though...
    I've got an error "Application was not run properly (0xc000007b)" and crash...
    Which kind of zlib1.dll are you use?

  23. #49
    Member
    Join Date
    May 2012
    Location
    United States
    Posts
    324
    Thanks
    182
    Thanked 53 Times in 38 Posts
    Quote Originally Posted by Darek View Post
    I've got an error "Application was not run properly (0xc000007b)" and crash...
    Which kind of zlib1.dll are you use?
    Try this...If this also does not work then I will investigate my compilation error further.

    Let me know if this works.
    Attached Files Attached Files

  24. #50
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    876
    Thanks
    474
    Thanked 175 Times in 85 Posts
    For me, both compiles of comp1 are working , but the speed improvement is not as good compared to Jan's compile.

    eng.txt from bibles testset:

    fp8_v5_jan = 76.94 sec
    fp8_v5_comp1 = 71.38 sec

  25. #51
    Member
    Join Date
    May 2012
    Location
    United States
    Posts
    324
    Thanks
    182
    Thanked 53 Times in 38 Posts
    Glad it worked for you Stephan. I was hoping the speed increase would be greater.

  26. #52
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    962
    Thanks
    573
    Thanked 397 Times in 295 Posts
    Quote Originally Posted by comp1 View Post
    Try this...If this also does not work then I will investigate my compilation error further.

    Let me know if this works.
    The same result
    I think my zlib1.dll could be wrong...

  27. #53
    Member
    Join Date
    Apr 2009
    Location
    here
    Posts
    203
    Thanks
    170
    Thanked 109 Times in 65 Posts
    here's one with no zlib dependency, but i have not tested it at all... well, it didn't crash here on a quick test.

    it's built with gcc 7.1

    /edit: also added a gcc 7.0 build
    Attached Files Attached Files

  28. Thanks:

    Darek (14th July 2017)

  29. #54
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    962
    Thanks
    573
    Thanked 397 Times in 295 Posts
    Quote Originally Posted by load View Post
    here's one with no zlib dependency, but i have not tested it at all... well, it didn't crash here on a quick test.

    it's built with gcc 7.1
    Thanks, but I can't open this rar archive. Could you use 7zip to compress it?

  30. #55
    Administrator Shelwien's Avatar
    Join Date
    May 2008
    Location
    Kharkov, Ukraine
    Posts
    3,423
    Thanks
    223
    Thanked 1,053 Times in 565 Posts
    Code:
      8.128s 8.081s:  fp8_v5.exe -8 book1 (x64)
      8.939s 8.846s:  fp8_v5_gcc63_x32.exe -8 book1
      8.097s 7.972s:  fp8_v5_gcc63_x64.exe -8 book1
      8.814s 7.972s:  fp8_v5_gcc70_x32.exe -8 book1
      8.143s 7.987s:  fp8_v5_gcc70_x64.exe -8 book1
      8.924s 8.861s:  fp8_v5_gcc71_x32.exe -8 book1
      8.128s 7.893s:  fp8_v5_gcc71_x64.exe -8 book1
      8.487s 8.517s:  fp8_v5_ic18_x32.exe -8 book1
      8.237s 8.080s:  fp8_v5_ic18_x64.exe -8 book1
      7.847s 8.018s:  fp8_v5_gcc71_x64_PGO.exe -8 book1
      8.206s 8.236s:  fp8_v5_ic18_x32_PGO.exe -8 book1
      7.957s 7.816s:  fp8_v5_ic18_x64_PGO.exe -8 book1
    Attached Files Attached Files

  31. Thanks (3):

    Darek (13th July 2017),Simorq (18th December 2017),Stephan Busch (14th July 2017)

  32. #56
    Member
    Join Date
    Dec 2008
    Location
    Poland, Warsaw
    Posts
    962
    Thanks
    573
    Thanked 397 Times in 295 Posts
    Strange thing - for both compilations (Load and Shelwien) on the compression level -8 there is a much slower WAVes compression - 5-6 times than in -4 option. Other kind of files are similar speed at any compression levels.

  33. #57
    Programmer Jan Ondrus's Avatar
    Join Date
    Sep 2008
    Location
    Rychnov nad Kněžnou, Czech Republic
    Posts
    278
    Thanks
    33
    Thanked 137 Times in 49 Posts

    fp8_v6

    imported some improvements from paq8px_v98 version
    Attached Files Attached Files

  34. Thanks (9):

    Darek (19th August 2017),kaitz (19th August 2017),kassane (7th December 2017),Mike (19th August 2017),moisesmcardona (6th January 2019),necros (25th February 2019),pinguin2 (23rd January 2018),Simorq (18th December 2017),Stephan Busch (19th August 2017)

  35. #58
    Member
    Join Date
    Jun 2013
    Location
    Sweden
    Posts
    150
    Thanks
    9
    Thanked 25 Times in 23 Posts
    Now that fp8 is further developed and future versions may not be compatible with the older, I would like you to add version number to file extension so I know which version to use then extract.

  36. #59
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    876
    Thanks
    474
    Thanked 175 Times in 85 Posts
    @Jan

    Dear Jan, would you please add support for more than 2 GB on FP8?

  37. #60
    Member
    Join Date
    Jun 2013
    Location
    Sweden
    Posts
    150
    Thanks
    9
    Thanked 25 Times in 23 Posts
    I dont know if its a bug or feature, but if I compress "fp8 -7 game game\*" i expect to get game.fp8 as output, and i do. But fp8 also compress all files in folder twice - with and without path (game\) so 22 files become 44.

Page 2 of 3 FirstFirst 123 LastLast

Similar Threads

  1. PAQ8 - Download Page
    By Jan Ondrus in forum Data Compression
    Replies: 7
    Last Post: 7th October 2010, 22:14
  2. Inline assembly routines for paq8
    By Shelwien in forum Data Compression
    Replies: 24
    Last Post: 26th August 2009, 23:22
  3. deflate model for paq8?
    By kaitz in forum Data Compression
    Replies: 2
    Last Post: 6th February 2009, 21:48
  4. PAQ8 tests
    By kaitz in forum Forum Archive
    Replies: 4
    Last Post: 17th January 2008, 15:03
  5. PeaZip v1.3 now with PAQ8 support!
    By LovePimple in forum Forum Archive
    Replies: 29
    Last Post: 9th February 2007, 16:58

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •