Results 1 to 5 of 5

Thread: files reordering

  1. #1
    Member
    Join Date
    Jun 2018
    Location
    Yugoslavia
    Posts
    58
    Thanks
    8
    Thanked 3 Times in 3 Posts

    files reordering

    I've added another script to my project:

    https://gitlab.com/pklat/reiso

    its reorder.pm

    it tries to find similar files, so that tar+7z later can provide best compression. the output is a file list which can be fed to tar with '--files-from=FILE'
    this is done by compressing every two files!
    since there could be many combinations, this is of course very very slow!!!
    I might try to optimize it later.

    please edit the script options first, if you wanna try it.

    sorry, if this idea has already been used.

    thanks.

  2. #2
    Member CompressMaster's Avatar
    Join Date
    Jun 2018
    Location
    Lovinobana, Slovakia
    Posts
    195
    Thanks
    56
    Thanked 15 Times in 15 Posts
    Hello pklat,

    I have question about your script - is your script able to process also already compressed files such as JPG or PDF?

    What about EXE/GUI implementation? I am not very familiar with perl scripting...

    thanks.

    Best regards,
    CompressMaster
    Last edited by CompressMaster; 14th July 2018 at 21:04.

  3. #3
    Member
    Join Date
    Jul 2014
    Location
    Mars
    Posts
    197
    Thanks
    135
    Thanked 13 Times in 12 Posts
    +1 for gui

  4. #4
    Member
    Join Date
    Jun 2018
    Location
    Yugoslavia
    Posts
    58
    Thanks
    8
    Thanked 3 Times in 3 Posts
    hi.
    thanks for the replies.
    this is mainly intended for backup, where you got a lot of small files.
    I doubt .jpg would benefit as it is already heavily compressed and two jpegs don't have much similarities. pdf might be better in that matter.

    I have made the script for a specific case:
    I've got a tar.gz backup of 8 debian servers ( same version of debian).
    there are a lot of duplicates and similar files; the idea is to put them all into one huge .tar in best possible order, so that 7z or similar with large dict size can pack them better. as it is, iirc, 7z only sorts files by extension.

    I'll try to make gui later, but this is for Linux.

  5. #5
    Member CompressMaster's Avatar
    Join Date
    Jun 2018
    Location
    Lovinobana, Slovakia
    Posts
    195
    Thanks
    56
    Thanked 15 Times in 15 Posts
    Could I request you for GUI for Windows (or at least command line) of your script? I´m using only Windows platform...

    Thanks.

    Best regards,
    CompressMaster
    Last edited by CompressMaster; 19th July 2018 at 17:44.

Similar Threads

  1. convert swf files to avi files
    By Jabilo in forum The Off-Topic Lounge
    Replies: 15
    Last Post: 13th April 2020, 06:41
  2. Decompress some files
    By Wuschte in forum Data Compression
    Replies: 0
    Last Post: 16th December 2015, 15:46
  3. Deduplication X-Files
    By Bulat Ziganshin in forum Data Compression
    Replies: 18
    Last Post: 21st May 2013, 21:21
  4. BWT alphabet reordering
    By Matt Mahoney in forum Data Compression
    Replies: 9
    Last Post: 3rd September 2011, 23:49
  5. Alphabet Reordering for BWT
    By Shelwien in forum Data Compression
    Replies: 3
    Last Post: 31st May 2009, 03:32

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •