Results 1 to 7 of 7

Thread: is there 7-zip smart dictionary size tool ?

  1. #1
    Member
    Join Date
    Sep 2007
    Location
    Denmark
    Posts
    916
    Thanks
    57
    Thanked 113 Times in 90 Posts

    is there 7-zip smart dictionary size tool ?

    We have a lot ( well at least a few) 7-zip brute force tools. but do we have one that does multiple different dictionary sizes and pics the one with the smallest dictionary/solid blocksize that is within X% of the best compressed one?
    I really don't want to use a 1.5GB dictionary if its only gives me e.g. 15 bytes smaller files compared to one with only 256MB dictionary

    Or maybe a tool that does solid blocks based on file extension.
    Last edited by SvenBent; 12th March 2020 at 15:31.

  2. #2
    Member
    Join Date
    May 2008
    Location
    Kuwait
    Posts
    346
    Thanks
    37
    Thanked 37 Times in 22 Posts
    Such mechanism already exist in 7z GUI.. set the dictionary size to your maximum that your pc system can support then compress different data sizes like 64mb, 128mb, 256mb, 512mb, 1024mb,...etc and check the dictionary size used..

  3. #3
    Member
    Join Date
    Jun 2018
    Location
    Yugoslavia
    Posts
    51
    Thanks
    6
    Thanked 2 Times in 2 Posts
    try option "-mqs" for sorting by extension/type. otherwise, you could make a .tar with custom order.
    I doubt any tool can give precise estimate without actually compressing.
    I chose dictionary, so that unpacked data fits in it if it can.

  4. #4
    Member
    Join Date
    Aug 2016
    Location
    Russia
    Posts
    104
    Thanks
    6
    Thanked 70 Times in 37 Posts
    Quote Originally Posted by SvenBent View Post
    Or maybe a tool that does solid blocks based on file extension.
    Smart7z plugin.

  5. Thanks:

    SvenBent (12th March 2020)

  6. #5
    Member
    Join Date
    May 2008
    Location
    Kuwait
    Posts
    346
    Thanks
    37
    Thanked 37 Times in 22 Posts
    Quote Originally Posted by Aniskin View Post
    Smart7z plugin.
    don't forget to disable wavpack plugin to maintain 7-zip compatibility.

  7. Thanks:

    SvenBent (12th March 2020)

  8. #6
    Member
    Join Date
    Sep 2007
    Location
    Denmark
    Posts
    916
    Thanks
    57
    Thanked 113 Times in 90 Posts
    @ maadjordan

    I didnt explain well.
    I have a big data set but I want to strike a balance between fast decompression individual files. so if increasing thedictiornary/solid bloc size from 256 to e.g 1GB only reduces the files with mere 1-2% i would prefer the files with less dictiornary/solid block size. if the gaing was e.g. 5% or more I would prefer the keep the smaller files.

  9. #7
    Member
    Join Date
    May 2008
    Location
    Kuwait
    Posts
    346
    Thanks
    37
    Thanked 37 Times in 22 Posts
    you need to test your data partially with different Dictionary size then use the best suitable to you for the complete data. 7-zip does not have a method to trial compression on various parts of your data and suggest which method is best. It was used before on old GUI programs but has disappeared.

Similar Threads

  1. which tool has the samllest size/orignal size * time
    By l1t in forum Data Compression
    Replies: 7
    Last Post: 27th August 2010, 06:10
  2. bzip2 dictionary size
    By Wladmir in forum Data Compression
    Replies: 3
    Last Post: 7th April 2010, 16:09
  3. Does rep support >2GB Dictionary size ?
    By SvenBent in forum Data Compression
    Replies: 12
    Last Post: 6th June 2009, 00:08
  4. Noob question about dictionary size (and about rep)
    By SvenBent in forum Data Compression
    Replies: 1
    Last Post: 23rd January 2009, 00:35
  5. Dictionary to Archive Size Question
    By GipFace in forum Data Compression
    Replies: 6
    Last Post: 21st January 2009, 17:03

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •