Page 1 of 2 12 LastLast
Results 1 to 30 of 37

Thread: That nasty slug is back

  1. #1
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Hi all!

    This slug has not much in common with the old one. It's a complete redesign. Only the name is the same because I was to lazy to think of another one.
    That damn slug has become even slower (what do you expect, it's a slug) but does work more thoroughly. On my system its speed is comparable to "thor e3" - sometimes faster, sometimes slower. But its compression is better most of the time. The ratio is in-between e3 and e4.

    Seriously, many things are lackluster. e.g. the IO-handling is stupid. Or the handling of already compressed data is naive. But the algorithmic concept is nice. Slug isn't LZ77 anymore - it borrows some aspects from ROLZ and adds some magic to it. It still uses semi-dynamic huffman as backend.
    I think that I can extend the 'ROLZ' further to provide higher compression at a slight speed hit. But on the other hand, maybe the next version will already use another concept.

    If you find any bugs/errors please let me know.
    I'm looking forward to some numbers from the benchmarkers. Besides, I tried adding slug to 'metacompressor.com'. Does anybody know what todo with the field 'code'?

    Slug 1.2

  2. #2
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    From:
    http://encode.su/forums/index.php?ac...um=1&topic=677

    Quote Originally Posted by Bulat Ziganshin
    code is LongNightsDebugging

  3. #3
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,507
    Thanks
    742
    Thanked 665 Times in 359 Posts
    i will prefer if slug had various compression modes - old one, new one

  4. #4
    Member
    Join Date
    Sep 2007
    Location
    Denmark
    Posts
    873
    Thanks
    49
    Thanked 106 Times in 84 Posts
    Slug... is it faster/slower than RZM and CCMx ?

  5. #5
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    MOC Test
    178.337.382 B
    COMP =10,044 DEC=10,965 EFF.=130,54 (Number.1)

  6. #6
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Quote Originally Posted by encode
    code is LongNightsDebugging
    Thanks Ilia. It worked like a charm. And I already thought that my browser might be incompatible or something.

    Quote Originally Posted by Bulat Ziganshin
    i will prefer if slug had various compression modes - old one, new one
    I just named it Slug because I couldnt come up with a decent name. Aside from the name, Slug 1.1x and 1.2 have nothing in common - the huffman coder was redesigned, too. It would be like combining RZM and CCM.

    Quote Originally Posted by SvenBent
    Slug... is it faster/slower than RZM and CCMx ?
    Much faster, but compression is much worse, too.

    Quote Originally Posted by Nania Francesco Antonio
    MOC Test
    178.337.382 B
    COMP =10,044 DEC=10,965 EFF.=130,54 (Number.1)
    Thanks for the ultra fast update, Francesco!! The result is really nice.

  7. #7
    Member Fallon's Avatar
    Join Date
    May 2008
    Location
    Europe - The Netherlands
    Posts
    158
    Thanks
    14
    Thanked 10 Times in 5 Posts
    Quote Originally Posted by Christian
    Its a complete redesign. Only the name is the same because I was to lazy
    laziest googlesearch: synonyms online
    http://synonyms.memodata.com/
    http://www.synonym.com/
    search: slug or another name
    fling, hit, bullet,
    search: fling
    fling (n.)
    1.the act of flinging
    2.a brief indulgence of your impulses
    3.a usually brief attempt"he took a crack at it" "I gave it a whirl"
    fling (v.)
    1.throw with force or recklessness"fling the frisbee"

  8. #8
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Thanks Chris!

    Mirror: Download

  9. #9
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Thanks for the mirror, Lovepimple!

    Here is a new version. I only extended the symbol-coder. This should impove ratio a bit in most cases. Speed should be about the same. Additionally, as a compensation for the missing readme I added some contact info to Slug.

    Slug 1.21

    About the name again. I just called this one slug, because I thought one stupid compressor name is enough. Additionally, it fits in the same niche - light and fast compression.

  10. #10
    Member
    Join Date
    May 2008
    Location
    England
    Posts
    325
    Thanks
    18
    Thanked 6 Times in 5 Posts
    A Slug is also slow, slimey, eats your plants/vegetables and you can kill it by putting salt on it

  11. #11
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts


    The ambiguousness of Slug was the reason why I chose it in the first place.

  12. #12
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Thanks Chris!

    Mirror: Download

  13. #13
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quick test...

    SLUG v1.21

    A10.jpg > 843,835
    AcroRd32.exe > 1,904,663
    english.dic > 1,081,834
    FlashMX.pdf > 3,889,783
    FP.LOG > 1,101,238
    MSO97.DLL > 2,317,140
    ohs.doc > 907,716
    rafale.bmp > 1,294,689
    vcfiu.hlp > 836,592
    world95.txt > 814,442

    Total = 14,991,932 bytes


    THOR 0.96a e3

    A10.jpg > 842,840
    AcroRd32.exe > 1,942,444
    english.dic > 986,092
    FlashMX.pdf > 3,890,204
    FP.LOG > 1,221,332
    MSO97.DLL > 2,385,868
    ohs.doc > 935,456
    rafale.bmp > 1,510,988
    vcfiu.hlp > 969,760
    world95.txt > 1,123,920

    Total = 15,808,904 bytes


    THOR 0.96a e4

    A10.jpg > 841,780
    AcroRd32.exe > 1,830,220
    english.dic > 969,772
    FlashMX.pdf > 3,826,376
    FP.LOG > 935,016
    MSO97.DLL > 2,241,704
    ohs.doc > 879,948
    rafale.bmp > 1,281,236
    vcfiu.hlp > 773,044
    world95.txt > 851,256

    Total = 14,430,352 bytes

  14. #14
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Another quick test...

    Test file: ENWIK8

    Test machine: AMD Sempron 2400+, Windows XP SP2

    SLUG v1.21
    Compressed Size: 35,357,328 bytes
    Elapsed Time: 7.059 Seconds


    THOR v0.96a e3
    Compressed Size: 41,531,628 bytes
    Elapsed Time: 5.031 Seconds


    THOR v0.96a e4
    Compressed Size: 35,795,184 bytes
    Elapsed Time: 14.203 Seconds

  15. #15
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    876
    Thanks
    472
    Thanked 175 Times in 85 Posts
    The decision of what name a compressor gets is only up to the author. Thor reminds me of the celtic god of thunder, Tornado is both an ugly storm and a war machine, rings is what most people wear on their fingers..

    Actually I find those names much more innovative than straight technical ones such as PPMd.

    Also, processor and platform names like the upcoming Intel Nehalem with QuickPath sound mystical..

  16. #16
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,507
    Thanks
    742
    Thanked 665 Times in 359 Posts
    ... and 4x4 reminds about hard-core vehicle - slow, heavy, but highly reliable (that's so far from my program )

    thanks, Stephan, this sounds so incredible!

  17. #17
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Thanks for the update Stephan!

    Quote Originally Posted by Stephan Busch
    Actually I find those names much more innovative than straight technical ones such as PPMd.
    I agree. Still, imo long names like crazyBigElephant shouldnt be used neither.


    Slug 1.23

    Changelog:
    I fixed a feature of the huffman coder. Resampling of the alphabet was done at a bad time (which degraded compression slightly). Speed should be identical.

  18. #18
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,507
    Thanks
    742
    Thanked 665 Times in 359 Posts
    Quote Originally Posted by Christian
    Still, imo long names like crazyBigElephant shouldnt be used neither.
    once i had in program DancingElephant class it was about making multithreading in DOS environment which explains its name

  19. #19
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    Quote Originally Posted by Bulat Ziganshin
    it was about making multithreading in DOS environment which explains its name
    DancingOneLeggedLeftFootedWalrus would have been quite accurate, too.

  20. #20
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Quote Originally Posted by Christian
    Slug 1.23

    Changelog:
    I fixed a feature of the huffman coder. Resampling of the alphabet was done at a bad time (which degraded compression slightly). Speed should be identical.
    Awesome!

    Mirror: Download

  21. #21
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,507
    Thanks
    742
    Thanked 665 Times in 359 Posts
    Quote Originally Posted by Stephan Busch
    rings is what most people wear on their fingers..
    and Nania is our Lord Of Rings

  22. #22
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    EDIT: removed version. After some more testing it seems that the context change produced more cache misses. So, it wasn't worth it.

    Removed 1.24

  23. #23
    Member
    Join Date
    Dec 2006
    Posts
    611
    Thanks
    0
    Thanked 1 Time in 1 Post
    Thanks Christian, I'll try to look at it before the end of the week

  24. #24
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    And here comes Slug 1.24 - some internal changes. Ratio is about the same. Actually, compression of all my testsets (~3G) takes ~11M less space. But the speed is a little bit faster than 1.23 again - at least if I look at my results and those at metacompressor. I'm sorry for flooding the charts there. And I'm sorry for the awful web hoster - at least there are no cats.

    Download Slug 1.24

  25. #25
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Quote Originally Posted by Christian
    at least there are no cats
    I like cats!

  26. #26
    Moderator

    Join Date
    May 2008
    Location
    Tristan da Cunha
    Posts
    2,034
    Thanks
    0
    Thanked 4 Times in 4 Posts
    Thanks Chris!

    Mirror: Download

  27. #27
    Member
    Join Date
    Dec 2006
    Posts
    611
    Thanks
    0
    Thanked 1 Time in 1 Post
    Quote Originally Posted by Christian
    at least there are no cats
    Thanks for the new version. Well, USA and such are cool, but there are 200 slots for whole Czech republic Ill stick to LovePimples site, I guess, since I currently dont know about any filehost, that works everywhere fast, without limits and without blurred cats
    EDIT: Found a way, there are Firefox extensions to circumvent this

  28. #28
    Programmer
    Join Date
    Feb 2007
    Location
    Germany
    Posts
    420
    Thanks
    28
    Thanked 153 Times in 18 Posts
    I finally created a tiny homepage to put an end to this web hosting nuisance with all their ads and cats and stuff. Sorry again, I did not know that megaupload is working that bad in eastern countries.

    Slug's Homepage

  29. #29
    Member
    Join Date
    Jan 2007
    Location
    Moscow
    Posts
    239
    Thanks
    0
    Thanked 3 Times in 1 Post
    You'd better close <H2> tag in "i_navi.htm" if it's possible, otherwise Opera becomes insane

  30. #30
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    Christian
    By the way, can you briefly explain what means "distant variation of a ROLZ compression engine". Is it pure ROLZ or it's an LZ77 with some tricks? If it's about special tricks can you post some hints?

Page 1 of 2 12 LastLast

Similar Threads

  1. IzArc is back
    By Vacon in forum Data Compression
    Replies: 4
    Last Post: 2nd March 2011, 00:50
  2. -Delete back in srep
    By SvenBent in forum Data Compression
    Replies: 0
    Last Post: 13th December 2009, 21:36
  3. CCM, RZM , Slug and Blizzard ?
    By Nania Francesco in forum Data Compression
    Replies: 1
    Last Post: 14th August 2009, 01:57
  4. That awesome slug is back!
    By LovePimple in forum Data Compression
    Replies: 32
    Last Post: 6th March 2009, 15:47
  5. SLUG 1.x
    By Christian in forum Forum Archive
    Replies: 18
    Last Post: 28th April 2007, 16:14

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •