Results 1 to 5 of 5

Thread: files reordering

  1. #1
    Member
    Join Date
    Jun 2018
    Location
    Yugoslavia
    Posts
    38
    Thanks
    6
    Thanked 1 Time in 1 Post

    files reordering

    I've added another script to my project:

    https://gitlab.com/pklat/reiso

    its reorder.pm

    it tries to find similar files, so that tar+7z later can provide best compression. the output is a file list which can be fed to tar with '--files-from=FILE'
    this is done by compressing every two files!
    since there could be many combinations, this is of course very very slow!!!
    I might try to optimize it later.

    please edit the script options first, if you wanna try it.

    sorry, if this idea has already been used.

    thanks.

  2. #2
    Member
    Join Date
    Jun 2018
    Location
    Slovakia
    Posts
    171
    Thanks
    46
    Thanked 11 Times in 11 Posts
    Hello pklat,

    I have question about your script - is your script able to process also already compressed files such as JPG or PDF?

    What about EXE/GUI implementation? I am not very familiar with perl scripting...

    thanks.

    Best regards,
    CompressMaster
    Last edited by CompressMaster; 14th July 2018 at 22:04.

  3. #3
    Member
    Join Date
    Jul 2014
    Location
    Mars
    Posts
    189
    Thanks
    133
    Thanked 12 Times in 11 Posts
    +1 for gui

  4. #4
    Member
    Join Date
    Jun 2018
    Location
    Yugoslavia
    Posts
    38
    Thanks
    6
    Thanked 1 Time in 1 Post
    hi.
    thanks for the replies.
    this is mainly intended for backup, where you got a lot of small files.
    I doubt .jpg would benefit as it is already heavily compressed and two jpegs don't have much similarities. pdf might be better in that matter.

    I have made the script for a specific case:
    I've got a tar.gz backup of 8 debian servers ( same version of debian).
    there are a lot of duplicates and similar files; the idea is to put them all into one huge .tar in best possible order, so that 7z or similar with large dict size can pack them better. as it is, iirc, 7z only sorts files by extension.

    I'll try to make gui later, but this is for Linux.

  5. #5
    Member
    Join Date
    Jun 2018
    Location
    Slovakia
    Posts
    171
    Thanks
    46
    Thanked 11 Times in 11 Posts
    Could I request you for GUI for Windows (or at least command line) of your script? I´m using only Windows platform...

    Thanks.

    Best regards,
    CompressMaster
    Last edited by CompressMaster; 19th July 2018 at 18:44.

Similar Threads

  1. convert swf files to avi files
    By Jabilo in forum The Off-Topic Lounge
    Replies: 13
    Last Post: 26th October 2016, 12:39
  2. Decompress some files
    By Wuschte in forum Data Compression
    Replies: 0
    Last Post: 16th December 2015, 16:46
  3. Deduplication X-Files
    By Bulat Ziganshin in forum Data Compression
    Replies: 18
    Last Post: 21st May 2013, 22:21
  4. BWT alphabet reordering
    By Matt Mahoney in forum Data Compression
    Replies: 9
    Last Post: 4th September 2011, 00:49
  5. Alphabet Reordering for BWT
    By Shelwien in forum Data Compression
    Replies: 3
    Last Post: 31st May 2009, 04:32

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •