Results 1 to 2 of 2

Thread: Noob question about dictionary size (and about rep)

  1. #1
    Member
    Join Date
    Sep 2007
    Location
    Denmark
    Posts
    873
    Thanks
    49
    Thanked 106 Times in 84 Posts

    Noob question about dictionary size (and about rep)

    I'm a totally wrong when i think of the dictionary size as the amount of data a compressor searches for compressable patterns/repetitions?

    so that
    a: identical bytes sequences father away then dict size does not get compressed together

    b: there is no need for a bigger dict then the data you are compression (512mb dict on 64mb file)


    If this is correct should REP automatically adjust dict size down of the file is to small to avoid higher then necessary resource usage ?
    or is there no differences as the dictionary size is not fully used ?
    e.g 1gb dict on 512m file vs only using 512m dict.

  2. #2
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,507
    Thanks
    742
    Thanked 665 Times in 359 Posts
    >I'm a totally wrong when i think of the dictionary size as the amount of data a compressor searches for compressable patterns/repetitions?

    it's better to ask algo author what he means saying about dictionary in lz77 group of algos, it's exactly what you said

    >f this is correct should REP automatically adjust dict size down of the file

    yes. patches are welcome

Similar Threads

  1. bzip2 dictionary size
    By Wladmir in forum Data Compression
    Replies: 3
    Last Post: 7th April 2010, 17:09
  2. Does rep support >2GB Dictionary size ?
    By SvenBent in forum Data Compression
    Replies: 12
    Last Post: 6th June 2009, 01:08
  3. Dictionary to Archive Size Question
    By GipFace in forum Data Compression
    Replies: 6
    Last Post: 21st January 2009, 18:03
  4. REP and Delta fails with big files
    By SvenBent in forum Data Compression
    Replies: 14
    Last Post: 23rd November 2008, 20:41
  5. Replies: 1
    Last Post: 18th April 2007, 20:36

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •