View Poll Results: What should I release next?

Voters
16. You may not vote on this poll
  • Improved LZ4X

    3 18.75%
  • Improved ULZ

    3 18.75%
  • Improved ULZ with a large window

    10 62.50%
Page 4 of 4 FirstFirst ... 234
Results 91 to 101 of 101

Thread: LZ4X - An Optimized LZ4 Compressor

  1. #91
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts

    Talking

    Updated to LZ4X v1.30!
    The newest version features a much faster decoder. I replaced the lame byte-by-byte copy with a fast copy128, at last!
    Enjoy new release!
    Attached Files Attached Files

  2. Thanks (4):

    Cyan (27th November 2016),Mike (27th November 2016),Samantha (27th November 2016),Simorq (27th November 2016)

  3. #92
    Member
    Join Date
    Nov 2016
    Location
    Iceland
    Posts
    1
    Thanks
    0
    Thanked 1 Time in 1 Post

    ZFS, OPENZFS, BTRFS

    Quote Originally Posted by encode View Post
    License: Public Domain. Updated to LZ4X v1.30!
    The newest version features a much faster decode.
    When i reed you'r post that LZ4X is faster than original LZ4, and Your post about it's license (not GPL). My first thunk was: Did you already commited this peace of code for example to Oracle/ZFS source tree , to Linux -> Oracle/BTRFS source tree etc. BSD/Apple source tree etc. Because if you do - We all could be happy of your work..

    Actually the great revolution (i think) in compression is Zstandard and new entropy algorithm invented in Poland (is i know, on some university?) standardized by Facebook (or maybe im mixing two different things). But still LZ4 is one of greatest "inventions" - useful compromise. So i hope (because i haven't reed all posts) You preserve compatibility with this standard. And I hope you commited (or will commit) to ZFS source tree?

  4. Thanks:

    encode (30th November 2016)

  5. #93
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    Well, I think Optimal Parsing within original LZ4 package ruined the LZ4X idea.
    Now I have an improved core of a fast bytewise LZ77 (ULZ/LZ4X).
    My question is:
    Look at the thread's poll

  6. #94
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    To revive my LZ4X, I (re)added the Brute mode (new -9) to the LZ4X once again, so now it compresses slightly higher than LZ4 -l -12 or smallz4 (<= 8 MB files). It will be released within a few weeks.


  7. Thanks (2):

    Cyan (7th November 2018),Mike (7th November 2018)

  8. #95
    Member jibz's Avatar
    Join Date
    Jan 2015
    Location
    Denmark
    Posts
    116
    Thanks
    96
    Thanked 69 Times in 49 Posts
    Sounds great!

    Do you know if the posts from the past two weeks will be back? there was some good discussion going on about optimal parsing in the BriefLZ thread I think.

  9. #96
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    Too much's going on in the LZ4 field so, please test this version instead:
    Attached Files Attached Files

  10. Thanks (4):

    Cyan (11th November 2018),introspec (10th November 2018),jibz (10th November 2018),Mike (10th November 2018)

  11. #97
    Member jibz's Avatar
    Join Date
    Jan 2015
    Location
    Denmark
    Posts
    116
    Thanks
    96
    Thanked 69 Times in 49 Posts
    A quick test runs gives the exact same output size as blz4 --optimal on all files of the Canterbury and Silesia corpora, with much faster compression. Great job!

  12. Thanks:

    encode (10th November 2018)

  13. #98
    Member
    Join Date
    Apr 2017
    Location
    United Kingdom
    Posts
    58
    Thanks
    48
    Thanked 23 Times in 15 Posts
    I also did some tests (Calgary, Canterbury, selected Silesia files, as well as much my bunch of ZX Spectrum-related test files).
    The resulting file sizes are all the same for lz4x ver.1.49b and for blz4 ver.0.1.0. I was not able to find a file on which the results will be different.
    I am guessing lz4x is the new default .lz4 compressor for me now

  14. Thanks:

    encode (13th November 2018)

  15. #99
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    Yet another beta to test. This version features speed improvements - some redundant computations were eliminated. The problem with the worst case with the match optimizer now solved - only the match finder may hang.
    Attached Files Attached Files

  16. Thanks (2):

    introspec (14th November 2018),Mike (14th November 2018)

  17. #100
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    Okay, the LZ4X v1.50 has been released:
    https://github.com/encode84/lz4x


  18. Thanks (8):

    avitar (14th November 2018),comp1 (16th November 2018),Cyan (14th November 2018),introspec (14th November 2018),jibz (14th November 2018),Mike (14th November 2018),svpv (14th November 2018),xcrh (15th November 2018)

  19. #101
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    Updated to v1.60! New version features overrun protection in the decoder + some small code changes!

    https://github.com/encode84/lz4x


  20. Thanks (4):

    algorithm (26th March 2019),Cyan (26th March 2019),introspec (29th March 2019),Mike (26th March 2019)

Page 4 of 4 FirstFirst ... 234

Similar Threads

  1. LZF - Optimized LZF compressor
    By encode in forum Data Compression
    Replies: 39
    Last Post: 28th March 2019, 20:49
  2. Optimized LZSS compressor
    By encode in forum Data Compression
    Replies: 11
    Last Post: 13th February 2014, 23:51
  3. M1 - Optimized demo coder
    By toffer in forum Data Compression
    Replies: 189
    Last Post: 22nd July 2010, 00:49
  4. lzop optimized compile
    By M4ST3R in forum Download Area
    Replies: 1
    Last Post: 30th June 2009, 22:31
  5. 7zip >> Sfx optimized - 23,7 kb
    By Yuri Grille. in forum Data Compression
    Replies: 22
    Last Post: 12th April 2009, 22:33

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •