Results 1 to 2 of 2

Thread: ENWIK13 Download

  1. #1
    Member BetaTester's Avatar
    Join Date
    Dec 2010
    Location
    Brazil
    Posts
    43
    Thanks
    0
    Thanked 3 Times in 3 Posts

    Lightbulb ENWIK13 Download

    ENWIK13 is 5TB text archive - 10^(12,7) bytes

    31GB in 7z compression
    http://download.wikimedia.org/enwiki...history.xml.7z

    update to "Large Text Compression Benchmark" ...

  2. #2
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 779 Times in 486 Posts
    And 280 GB with bzip2. So now we have 2 numbers for the benchmark. I suppose the huge compression ratio for 7zip (160 to 1) is because the set has every version of every page with only minor differences between versions. 7zip has a much bigger buffer than bzip2 (900 KB max).

    But I think I'll stick with 1 GB. Testing takes long enough as it is.

Similar Threads

  1. PAQ8 - Download Page
    By Jan Ondrus in forum Data Compression
    Replies: 7
    Last Post: 7th October 2010, 22:14
  2. A lot of Compress Algorith to download , here
    By Yuri Grille. in forum Data Compression
    Replies: 2
    Last Post: 20th April 2009, 21:56
  3. Redline: Gang Warfare 2066 download - re-up!
    By encode in forum Forum Archive
    Replies: 3
    Last Post: 15th December 2007, 15:17

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •