Page 3 of 3 FirstFirst 123
Results 61 to 65 of 65

Thread: Google: Compress Data More Densely with Zopfli

  1. #61
    Member
    Join Date
    Apr 2011
    Location
    Russia
    Posts
    168
    Thanks
    163
    Thanked 9 Times in 8 Posts
    Transplant Huffman optimization from brotli
    https://github.com/MegaByte/zopfli/tree/brotli_huffman

  2. #62
    Member
    Join Date
    Apr 2011
    Location
    Russia
    Posts
    168
    Thanks
    163
    Thanked 9 Times in 8 Posts
    Interesting fact

    zopfli_huffman.png (578.6 KB)
    brotli_huffman.png (615.7 KB)
    pngout.png (573.0 KB)

    there is a lot of such examples.

    fhanau, pay attention to it
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	brotli_huffman.png 
Views:	194 
Size:	615.7 KB 
ID:	4155   Click image for larger version. 

Name:	pngout.png 
Views:	159 
Size:	573.0 KB 
ID:	4156   Click image for larger version. 

Name:	zopfli_huffman.png 
Views:	177 
Size:	578.6 KB 
ID:	4157  

  3. #63
    Member
    Join Date
    Apr 2011
    Location
    Russia
    Posts
    168
    Thanks
    163
    Thanked 9 Times in 8 Posts
    Code:
    $ time /c/Users/Lorents/Desktop/zopfli-gcc.exe --i10 /c/Users/Lorents/Desktop/enwik8
    
    real    4m11.807s
    user    0m0.000s
    sys     0m0.000s
    
    $ time /c/Users/Lorents/Desktop/zopfli-vc.exe --i10 /c/Users/Lorents/Desktop/enwik8
    
    real    4m55.000s
    user    0m0.000s
    sys     0m0.000s
    MSVC:
    Code:
    CFLAGS = /W2 /O2 /Ox /Ot /Ob2 /Gw /Gy /GL /arch:SSE2 /fp:fast /MT
    CXXFLAGS = $(CFLAGS) /TP /EHsc
    GCC:
    Code:
    CFLAGS = -W -Wall -Wextra -ansi -pedantic -lm -O3 -Wno-unused-function
    CXXFLAGS = -W -Wall -Wextra -ansi -pedantic -O3
    tell me, how to increase performance of MSVC?
    Last edited by lorents17; 3rd July 2016 at 22:17.

  4. #64
    Member
    Join Date
    Aug 2014
    Location
    United States
    Posts
    38
    Thanks
    5
    Thanked 23 Times in 10 Posts
    Quote Originally Posted by lorents17 View Post
    Code:
    $ time /c/Users/Lorents/Desktop/zopfli-gcc.exe --i10 /c/Users/Lorents/Desktop/enwik8
    
    real    4m11.807s
    user    0m0.000s
    sys     0m0.000s
    
    $ time /c/Users/Lorents/Desktop/zopfli-vc.exe --i10 /c/Users/Lorents/Desktop/enwik8
    
    real    4m55.000s
    user    0m0.000s
    sys     0m0.000s
    MSVC:
    Code:
    CFLAGS = /W2 /O2 /Ox /Ot /Ob2 /Gw /Gy /GL /arch:SSE2 /fp:fast /MT
    CXXFLAGS = $(CFLAGS) /TP /EHsc
    GCC:
    Code:
    CFLAGS = -W -Wall -Wextra -ansi -pedantic -lm -O3 -Wno-unused-function
    CXXFLAGS = -W -Wall -Wextra -ansi -pedantic -O3
    tell me, how to increase performance of MSVC?
    Did you try this patch? https://github.com/google/zopfli/pull/102

  5. Thanks:

    lorents17 (3rd July 2016)

  6. #65
    Member
    Join Date
    Aug 2015
    Location
    Urbana, IL
    Posts
    159
    Thanks
    10
    Thanked 162 Times in 90 Posts
    Quote Originally Posted by lorents17 View Post
    Interesting fact

    zopfli_huffman.png (578.6 KB)
    brotli_huffman.png (615.7 KB)
    pngout.png (573.0 KB)

    there is a lot of such examples.

    fhanau, pay attention to it
    brotli_huffman: 630.526B
    zopfli_huffman: 592.493B
    ECT -10060: 592.014B
    pngout.png: 586.754B

    ECT's OptimizeHuffmanForRle() is based on brotli's, but modified so that it does not refuse the optimization when there is a low number of codes. But pngout is still beating it because it has superior blockspllitting. It's a pity that it is closed-source, I'd really like to know how it works.
    Last edited by fhanau; 9th July 2016 at 09:55. Reason: Fixed pngout size

Page 3 of 3 FirstFirst 123

Similar Threads

  1. loseless data compression method for all digital data type
    By rarkyan in forum Random Compression
    Replies: 244
    Last Post: 23rd March 2020, 16:33
  2. Google released Snappy compression/decompression library
    By Sportman in forum Data Compression
    Replies: 11
    Last Post: 16th May 2011, 12:31
  3. Interested in Google-Wave?
    By Vacon in forum The Off-Topic Lounge
    Replies: 2
    Last Post: 29th November 2009, 19:11
  4. Compress-LZF
    By spark in forum Data Compression
    Replies: 2
    Last Post: 16th October 2009, 00:08
  5. Did you know the google hashmap
    By thometal in forum Forum Archive
    Replies: 0
    Last Post: 4th February 2007, 15:21

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •