Page 7 of 9 FirstFirst ... 56789 LastLast
Results 181 to 210 of 265

Thread: Experimental new ZCM file compressor!

  1. #181
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    No problem !

    I'll release a new version soon

  2. The Following User Says Thank You to Nania Francesco For This Useful Post:

    joerg (15th May 2014)

  3. #182
    Member
    Join Date
    May 2008
    Location
    Germany
    Posts
    410
    Thanks
    37
    Thanked 60 Times in 37 Posts
    @nania:
    by the way your program zcm version 091a and version 091b works like a charm for me
    - compress and uncompress my datafile correctly
    - i have used only the standard syntax without any extra switches:
    "zcm a archivefile datafile" and "zcm x archivefile"
    and it compress my datafile (oracle-dmp-file) better then 7zip (max compression) - in one word - it is wonderful

    but, for using "zcm" in a regular backup-process
    - it seems neccessary for me
    to save the original filedate and original filetime of the datafile within the archivefile

    @nania: is there any chance to solve this?

    best regards

  4. #183
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Dear joerg thank you for the compliments.
    With regard to the fact that it is not an archiver with all the features that you said (filetime, filedate, empty folder) will remedy shortly. I intend to build a structure that can use it for all my future plans. I had some problems that I couldn't easily resolve as if you consider well, each individual file must have all the data you've pointed out.


    For now you'll want to compress a TAR file

  5. #184
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    ZCM 0.92 released!

    I had to remove from the search buffer 128 MB

    News:
    - New CM core!
    - More stable !
    - Corrected some bugs

    Only from:
    http://heartofcomp.altervista.org/

    @Matt
    Please if possible test ZCM in LTCB and 10GB Benchmark's
    Last edited by Nania Francesco; 17th May 2014 at 00:02.

  6. The Following User Says Thank You to Nania Francesco For This Useful Post:

    PiPPoNe92 (18th July 2014)

  7. #185
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    LTCB results. http://mattmahoney.net/dc/text.html#1629
    Testing 10GB now.

  8. The Following User Says Thank You to Matt Mahoney For This Useful Post:

    Nania Francesco (17th May 2014)

  9. #186
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Thanks for all test Matt!
    I did the interventions for multi-processing correcting some bugs, I think should succeed the test 10GB as from me with 4 core works perfectly
    Last edited by Nania Francesco; 17th May 2014 at 06:06.

  10. #187
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    Nice improvement using 1 thread. http://mattmahoney.net/dc/10gb.html
    2969410664 4545 3875 4 zcm 0.92 -m7 -t1 -r -s
    3234943741 4312 3804 4 zcm 0.90 -m7 -t1 -r -s

  11. The Following User Says Thank You to Matt Mahoney For This Useful Post:

    Nania Francesco (17th May 2014)

  12. #188
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    This time my choice to change the structure of the data analysis gave its fruit. The program is a little slower because I used a unique hash for search latest buffer 2 UNSIGNED LONG while before they used two different types. It will be difficult to improve but it's not called the last word. The program has achieved the great giants of compression but ZPAQ is always very powerful.

  13. #189
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    I also tested on 10GB with 2 threads.

    2969410664 4545 3875 4 zcm 0.92 -m7 -t1 -r -s
    3278149230 3694 3042 4 zcm 0.92 -m7 -t2 -r -s

  14. The Following User Says Thank You to Matt Mahoney For This Useful Post:

    Nania Francesco (18th May 2014)

  15. #190
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Thanks Matt !

  16. #191
    Member
    Join Date
    May 2008
    Location
    Germany
    Posts
    410
    Thanks
    37
    Thanked 60 Times in 37 Posts
    @nania: can you compile a linux-version (for example redhat 6.x) of your wonderful compression program in the near future?

    if it is too difficult to implement all features, so may be you can implement only a few features

    "-t1 = only one task" and "-m4 = only method 4"

    best regards
    Joerg

  17. The Following User Says Thank You to joerg For This Useful Post:

    Intensity (3rd August 2015)

  18. #192
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    I am testing in Ubuntu using Wine 1.6. Works OK.

  19. #193
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    I realize that creating an interesting archiver requires me to release a full version of all the features of archiver. Definitely do not want to make the mistake that I made with other archiver's which I have released which do not maintain backward compatibility and does not allow to store folder empty or full attributes (date and time).

  20. The Following User Says Thank You to Nania Francesco For This Useful Post:

    Bulat Ziganshin (23rd May 2014)

  21. #194
    Member
    Join Date
    May 2008
    Location
    Germany
    Posts
    410
    Thanks
    37
    Thanked 60 Times in 37 Posts
    @nania:
    thanks for your answers.
    ---
    archiver requires me to release a full version of all the features of archiver
    ... maintain backward compatibility .. store .. filetime, filedate, empty folder ..
    ---

    Of course it would be wonderful to have such a full zcm-archiver

    further you wrote: "For now .. compress a TAR file"

    I have tested it with a tar-file and with a zip-file (without internal compression)

    the result is a archivefile.tar.zcm and a archivefile.zip.zcm

    and the result is for me okay

    @matt: thank you very much for your hint "using wine"


    best regards
    Joerg

  22. #195
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    for the moment I am leaving to work at ZCM because I'm dedicating a new compressor LZ77 decompression with great speed (type LZ4, ZHUFF etc) and with a simple Bytecoder seems to get good results.
    Last edited by Nania Francesco; 28th May 2014 at 12:28.

  23. #196
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts

    X64 MANIA

    Version 0.92 release x64 compatible with the 32 bit version. Adding only option-m8 that requires maximum 2.9 GB!

    @Matt
    Please test this version in LTCB and 10GB benchmarks!
    Attached Files Attached Files

  24. The Following 2 Users Say Thank You to Nania Francesco For This Useful Post:

    Biozynotiker (3rd July 2014),Stephan Busch (4th July 2014)

  25. #197
    Member
    Join Date
    Aug 2008
    Location
    Planet Earth
    Posts
    776
    Thanks
    63
    Thanked 270 Times in 190 Posts
    enwik8 19,700,970 bytes, 27.788 sec. - 28.336 sec., zcm_x64 -m8 -t1
    enwik9 160,848,538 bytes, 243.064 sec. - 248.084 sec. , zcm_x64 -m8 -t1

    enwik8 21,582,135 bytes, 6.447 sec. - 6.317 sec., zcm_x64 -m8 -t8
    enwik9 170,176,223 bytes, 53.018 sec. - 53.137 sec., zcm_x64 -m8 -t8

  26. The Following User Says Thank You to Sportman For This Useful Post:

    Nania Francesco (4th July 2014)

  27. #198
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    873
    Thanks
    460
    Thanked 175 Times in 85 Posts
    So far, ZCM_x64 is 400 sec faster than the 32-bit variant on the squeezeChart testset.
    But I think timer.exe is not taking the correct timings.. Which timers do you use?

  28. The Following User Says Thank You to Stephan Busch For This Useful Post:

    Nania Francesco (4th July 2014)

  29. #199
    Member
    Join Date
    Aug 2008
    Location
    Planet Earth
    Posts
    776
    Thanks
    63
    Thanked 270 Times in 190 Posts
    Quote Originally Posted by Stephan Busch View Post
    Which timers do you use?
    I used AcuTimer v2.0 for that test.

    I redid tests (two times each) with zcm 32-bit and 64-bit versions in WinZpaq benchmark mode (.NET stopwatch timings):

    enwik8 19,700,970 bytes, 27.786 sec. - 28.329 sec., ZCM - 8 - 1 - zcm 0.92 64-bit
    enwik8 19,700,970 bytes, 27.788 sec. - 28.329 sec., ZCM - 8 - 1 - zcm 0.92 64-bit

    enwik8 19,803,545 bytes, 27.213 sec. - 27.125 sec., ZCM - 7 - 1 - zcm 0.92 32-bit
    enwik8 19,803,545 bytes, 27.015 sec. - 27.089 sec., ZCM - 7 - 1 - zcm 0.92 32-bit

    enwik9 160,848,538 bytes, 243.582 sec. - 248.075 sec., ZCM - 8 - 1 - zcm 0.92 64-bit
    enwik9 160,848,538 bytes, 243.925 sec. - 248.403 sec., ZCM - 8 - 1 - zcm 0.92 64-bit

    enwik9 163,246,657 bytes, 240.857 sec. - 240.637 sec., ZCM - 7 - 1 - zcm 0.92 32-bit
    enwik9 163,246,657 bytes, 240.858 sec. - 240.777 sec., ZCM - 7 - 1 - zcm 0.92 32-bit

    enwik8 21,582,135 bytes, 6.287 sec. - 6.076 sec., ZCM - 8 - 8 - zcm 0.92 64-bit
    enwik8 21,582,135 bytes, 6.130 sec. - 6.239 sec., ZCM - 8 - 8 - zcm 0.92 64-bit

    enwik8 21,582,135 bytes, 6.324 sec. - 6.083 sec., ZCM - 7 - 8 - zcm 0.92 32-bit
    enwik8 21,582,135 bytes, 6.309 sec. - 6.346 sec., ZCM - 7 - 8 - zcm 0.92 32-bit

    enwik9 170,176,223 bytes, 53.112 sec. - 52.361 sec., ZCM - 8 - 8 - zcm 0.92 64-bit
    enwik9 170,176,223 bytes, 53.733 sec. - 53.415 sec., ZCM - 8 - 8 - zcm 0.92 64-bit

    enwik9 170,176,223 bytes, 53.363 sec. - 53.298 sec., ZCM - 7 - 8 - zcm 0.92 32-bit
    enwik9 170,176,223 bytes, 53.300 sec. - 53.801 sec., ZCM - 7 - 8 - zcm 0.92 32-bit

  30. The Following User Says Thank You to Sportman For This Useful Post:

    Nania Francesco (4th July 2014)

  31. #200
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    873
    Thanks
    460
    Thanked 175 Times in 85 Posts
    Dear Sportman.. could you please provide a download link for AcuTimer 2.0? I didn't find it.

  32. #201
    Member
    Join Date
    Aug 2008
    Location
    Planet Earth
    Posts
    776
    Thanks
    63
    Thanked 270 Times in 190 Posts
    Quote Originally Posted by Stephan Busch View Post
    could you please provide a download link for AcuTimer 2.0?
    Attached Files Attached Files

  33. The Following User Says Thank You to Sportman For This Useful Post:

    Stephan Busch (5th July 2014)

  34. #202
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    ZCM 0.92x64
    @Matt
    Please test this version in LTCB and 10GB benchmarks!

  35. #203
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    The 64 bit version compresses the same but is a little faster. http://mattmahoney.net/dc/text.html#1629

    Edit: likewise on 10GB: http://mattmahoney.net/dc/10gb.html
    Last edited by Matt Mahoney; 8th July 2014 at 06:23.

  36. The Following User Says Thank You to Matt Mahoney For This Useful Post:

    Nania Francesco (8th July 2014)

  37. #204
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Thanks Matt for all test, but option -m8 not work?

  38. #205
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    The help message says -m0 ... -m7 so I didn't try -m8.

  39. #206
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    873
    Thanks
    460
    Thanked 175 Times in 85 Posts
    maybe he meant -t8

  40. #207
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Excuse me Matt x64 version is not official !

  41. #208
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    x64 -m8 has better compression, close to Pareto frontier on 10GB system 4. Since it is not official do you want me to remove it?
    http://mattmahoney.net/dc/10gb.html

  42. The Following User Says Thank You to Matt Mahoney For This Useful Post:

    Nania Francesco (9th July 2014)

  43. #209
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    You can also leave. I meant 'not official release' because not inserted into my site. This version was a kind of experiment, considering that I have no great experience with 64-BIT versions.

  44. #210
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    Nice improvement on LTCB. It now beats nanozipltcb so it makes the Pareto frontier.
    http://mattmahoney.net/dc/text.html#1610

  45. The Following User Says Thank You to Matt Mahoney For This Useful Post:

    Nania Francesco (10th July 2014)

Page 7 of 9 FirstFirst ... 56789 LastLast

Similar Threads

  1. FLASHZIP file Compressor!
    By Nania Francesco in forum Data Compression
    Replies: 170
    Last Post: 6th December 2013, 23:35
  2. dcs-bwt - Experimental Burrows-Wheeler Compressor
    By Arkanosis in forum Data Compression
    Replies: 2
    Last Post: 25th June 2008, 03:53
  3. Fpaq0pv3 file Compressor
    By Nania Francesco in forum Forum Archive
    Replies: 13
    Last Post: 7th April 2008, 17:20
  4. CCM file compressor
    By LovePimple in forum Forum Archive
    Replies: 54
    Last Post: 22nd February 2007, 01:13
  5. FPAQ file compressor
    By LovePimple in forum Forum Archive
    Replies: 5
    Last Post: 1st November 2006, 23:48

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •