Page 1 of 4 123 ... LastLast
Results 1 to 30 of 108

Thread: CCM 1.2x branch

  1. #1
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Hi everyone!
    This 'branch' includes a new model. Speed is lower, Memory usage is up to 210M and ratio improved a bit on most files. But don't worry, I won't increase memory usage much more.
    At the moment three of CCM's models are always on. This costs speed. It's possible that I'll add a dynamic model switcher or even a commandline switch to turn off some of these. But before this there're still a couple of other things I want to look into.

    Download 1.20a

    If there are any problems please report them.

  2. #2
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Thanks!

    ccm120a.zip (14 KB)
    ccm120g.zip (43 KB)

  3. #3
    Member
    Join Date
    Mar 2007
    Location
    Ghent
    Posts
    56
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Tanks, to me this is the most promising new archiver
    Testing in progress...

  4. #4
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    CCM 1.20

    A10.jpg > 831.337
    AcroRd32.exe > 1.187.181
    english.dic > 498,849
    FlashMX.pdf > 3.667.884
    FP.LOG > 437.964
    MSO97.DLL > 1.585.763
    ohs.doc > 764.687
    rafale.bmp > 764.728
    vcfiu.hlp > 528.831
    world95.txt > 475.737
    TOTAL=10.742.961
    Enwik8=21.350.295
    Very Good Work! Need more faster!

  5. #5
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Awesome! Thanks Chris!

  6. #6
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Thank you all for your nice comments! Special thanks to Encode for giving CCM a home!
    Quote Originally Posted by Nania Francesco Antonio
    english.dic > 498,849
    Can anyone confirm this result? Maybe its from an older version?

  7. #7
    Member
    Join Date
    Mar 2007
    Location
    Ghent
    Posts
    56
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Testing finished:
    http://uclc.info/

  8. #8
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Quote Originally Posted by JohanDeBock
    Testing finished:
    http://uclc.info/
    Thanks a lot! Damn, youre fast!

  9. #9
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quote Originally Posted by Christian
    Can anyone confirm this result?
    I get 477,233 bytes..

  10. #10
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    A10.jpg > 831.337
    AcroRd32.exe > 1.187.181
    english.dic > 477.233
    FlashMX.pdf > 3.667.884
    FP.LOG > 437.964
    MSO97.DLL > 1.585.763
    ohs.doc > 764.687
    rafale.bmp > 764.728
    vcfiu.hlp > 528.831
    world95.txt > 475.737
    TOTAL=10721345
    Enwik8=21.350.295
    Enwik9=182.784.655
    Excuse Me Christian !

  11. #11
    Member
    Join Date
    Mar 2007
    Location
    Ghent
    Posts
    56
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by Christian
    Thanks a lot! Damn, youre fast!
    I use a well oiled system

  12. #12
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Quote Originally Posted by Nania Francesco Antonio
    Excuse Me Christian !
    Theres no need to apologize. It couldve been a bug. Therefore, thank you very much for retesting!
    Quote Originally Posted by LovePimple
    I get 477,233 bytes..
    Phew, at first I thought that a bug crawled in.

  13. #13
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    My test results...

    A10.jpg > 831,337
    AcroRd32.exe > 1,187,181
    english.dic > 477,233
    FlashMX.pdf > 3,667,884
    FP.LOG > 437,964
    MSO97.DLL > 1,585,763
    ohs.doc > 764,687
    rafale.bmp > 764,728
    vcfiu.hlp > 528,831
    world95.txt > 475,737

    Total = 10,721,345 bytes

    Awesome!

  14. #14
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    ok, you guys are fooling with me. That's the results of 1.17e.

  15. #15
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quote Originally Posted by Christian
    ok, you guys are fooling with me. Thats the results of 1.17e.
    Just a genuine mistake! There was a copy of 1.17e in my test folder.

    And I ran the test TWICE!!!

  16. #16
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Hehe... and I was beginning to think that you and Nania schemed a conspiracy.

  17. #17
    Member
    Join Date
    Dec 2006
    Posts
    611
    Thanks
    0
    Thanked 1 Time in 1 Post
    Nice to see a new version of my favourite experimental compressor

  18. #18
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 779 Times in 486 Posts

  19. #19
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Thank you very much for your time, Matt!

  20. #20
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Hi guys!

    Here's an easter egg from me. I just had a funny idea how to speed up modeling in general. And what's even more funny, it worked. Sadly, no compression related changes.

    Besides, there have been requests to reintroduce a faster profile. Thus, there are 2 versions again. CCMx is comparable to 1.20a. And CCM without x is comparable to 1.16c. The faster profile just has one model less. Of course, both versions use the latest filter framework.

    Some results from my machine (on ENWIK:

    CCM 1.20a: -> 21.350.292 at 646.588 B/s
    CCMx1.20c: -> 21.310.301 at 790.508 B/s (22% faster than 1.20a)
    CCM 1.16c: -> 22.570.847 at 953.789 B/s
    CCM 1.20c: -> 22.570.403 at 1.109.940 B/s (16% faster than 1.16c)

    -CCMx is still slower than 1.16c (as expected)
    -on MFC-efficiency-list CCM (without x) should take place THREE away from WinRAR!

    Download 1.20c: <u>I have a bug. Use my bigger brother.</u>

    Enjoy,

    Christian

  21. #21
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    876
    Thanks
    472
    Thanked 175 Times in 85 Posts
    What a cool easter egg

    Tests are aleady running.. Thanks heaps Christian!

  22. #22
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Fantastic! Thanks Chris!

    Mirror: Download

  23. #23
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Quote Originally Posted by Stephan Busch
    Tests are aleady running.. Thanks heaps Christian!
    Im sorry to say this, but I just found a bug in the image width detection.
    I was testing some real images (not rafale) and the new version was somewhat slow and ratio was lower as expected. I forgot to initialize a sum variable on which a later decision is based. Funny, that this comes up now after such a long time. Btw. this bug didnt affect stability in any way.
    Damn, now I know why CCM has been slower on some images.


    Anyway, heres the fixed version.

    Download 1.20d http://www.mytempdir.com/1286551

  24. #24
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quick test...


    CCM v1.20c

    A10.jpg > 831,353
    AcroRd32.exe > 1,193,678
    english.dic > 499,565
    FlashMX.pdf > 3,672,133
    FP.LOG > 451,862
    MSO97.DLL > 1,593,068
    ohs.doc > 766,924
    rafale.bmp > 773,533
    vcfiu.hlp > 537,801
    world95.txt > 499,359

    Total = 10,819,276 bytes


    CCMx v1.20c

    A10.jpg > 831,334
    AcroRd32.exe > 1,187,092
    english.dic > 477,132
    FlashMX.pdf > 3,667,586
    FP.LOG > 438,006
    MSO97.DLL > 1,585,445
    ohs.doc > 764,650
    rafale.bmp > 764,796
    vcfiu.hlp > 528,574
    world95.txt > 475,574

    Total = 10,720,189 bytes

    Will test the fixed version!

  25. #25
    Member
    Join Date
    Dec 2006
    Posts
    611
    Thanks
    0
    Thanked 1 Time in 1 Post
    Thanks Christian! 1.20c has become very fast!
    EDIT: Your fix finally answers my concerns why the hell was "normal" version compressing better than the "extra" one

  26. #26
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    876
    Thanks
    472
    Thanked 175 Times in 85 Posts
    Yep, that' what I wanted to post now.. Anyway, CCM 1.20cx
    has a marvelous speed improvement. Very well done
    The results are online now.

  27. #27
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quick test...

    CCM v1.20d

    A10.jpg > 831,353
    AcroRd32.exe > 1,193,678
    english.dic > 499,565
    FlashMX.pdf > 3,672,133
    FP.LOG > 451,862
    MSO97.DLL > 1,593,068
    ohs.doc > 766,924
    rafale.bmp > 773,533
    vcfiu.hlp > 537,801
    world95.txt > 499,359

    Total = 10,819,276 bytes


    CCMx v1.20d

    A10.jpg > 831,334
    AcroRd32.exe > 1,187,092
    english.dic > 477,132
    FlashMX.pdf > 3,667,586
    FP.LOG > 438,006
    MSO97.DLL > 1,585,445
    ohs.doc > 764,650
    rafale.bmp > 764,796
    vcfiu.hlp > 528,574
    world95.txt > 475,574

    Total = 10,720,189 bytes

    Quick compression times!

  28. #28
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Thank you very much for testing!

    Quote Originally Posted by Black_Fox
    Your fix finally answers my concerns why the hell was "normal" version compressing better than the "extra" one
    Hehe... the same happend on my side. I was compressing a bitmap and thought... Whats that!?
    This feature can be seen on Stephans bitmap, too.

    But I dont think theres much room for further speed improvements. CCM still is a context mixing algorithm and its extremly bound by memory bandwidth.
    LZ speed is out of reach. Luckily compression ratio of LZ is out of reach, too.

    Im looking forward to some more results. I hope, that Werner finds time to test both versions in his next tests.

  29. #29
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quick test with ENWIK8...

    Test Machine: AMD Sempron 2400+

    CCM v1.17e - a 'multimedia' file-to-file compressor - Mar 14 2007 **
    Compressed Size = 22,426,686 bytes
    Compression Time = 00:05:52.453


    CCM v1.20a - a 'multimedia' file-to-file compressor - Mar 21 2007 ***
    Compressed Size = 21,350,295 bytes
    Compression Time = 00:09:03.203


    CCM v1.20d - 'multimedia' file compressor - Apr 7 2007 (easter edition)
    Compressed Size = 22,570,405 bytes
    Compression Time = 00:04:28.484


    CCMx v1.20d - 'multimedia' file compressor - Apr 7 2007 (easter edition)
    Compressed Size = 21,310,303 bytes
    Compression Time = 00:07:00.156

  30. #30
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Quote Originally Posted by LovePimple
    Compression Time = 00:04:28.484...
    00:07:00.156

    Wow, the difference is much bigger than on my system (57% vs. 40%). Luckily, ENWIK8 is some kind of a worst case because it makes heavy use of the highest order model (which is missing in fast profile). Btw. how fast is 1.20a on your machine?

    The last one switches the lights off... Good night!

Page 1 of 4 123 ... LastLast

Similar Threads

  1. CCM decompiling
    By Shelwien in forum Data Compression
    Replies: 13
    Last Post: 17th August 2009, 21:47
  2. CCM 1.3x
    By Christian in forum Forum Archive
    Replies: 67
    Last Post: 25th April 2008, 21:22
  3. CCM 1.25 is here!
    By Christian in forum Forum Archive
    Replies: 84
    Last Post: 16th November 2007, 11:00
  4. CCM(x) multithreaded ?
    By SvenBent in forum Forum Archive
    Replies: 2
    Last Post: 15th September 2007, 16:29
  5. CCM - 1.1.x branch
    By Christian in forum Forum Archive
    Replies: 105
    Last Post: 20th March 2007, 00:50

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •