Results 1 to 3 of 3

Thread: (hyper)compression of very huge folder

  1. #1
    Member
    Join Date
    Jul 2013
    Location
    somwhere in the planet
    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    (hyper)compression of very huge folder

    hi,
    I've been for a year searching to compress my folders of 3d-engine work that weights from 2 to 20 GB, and inside theses folders there are between 60000 and 2000 files each, with sizes variating from 10 Bytes to 6GB, with many many variations but many small files.
    I got a GT70-0NC with 12 GB of RAM, and I was wondering if you could give me advices on how to have the maximum compression on these folder (without the compression during 10 years or so), and in the end this would give a self extracting .exe... I ran 7zip with best compression option on a reference folder that had it go from 4 549 650 183 to 2 438 200 673 bytes ...
    any suggestion to improve??? scrpts/programms to test it on the folder?
    thank you for reading,have a nice day..

  2. #2
    Member
    Join Date
    Sep 2007
    Location
    Denmark
    Posts
    916
    Thanks
    57
    Thanked 113 Times in 90 Posts
    i had a similiar project 55.5222 files in 889 folders tree (11.4 gb)
    the best way i got it was to pipe shar srep and then 7-zip

    i did
    shar a - <foldername1> <foldername2> | srep - HugePatch.srep

    and it gave my one huge srep file that i compressed with 7-zip.
    got it down to 3.66GB ( about 1 third of original size)
    Last edited by SvenBent; 28th August 2013 at 19:53.

  3. #3
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,257
    Thanks
    307
    Thanked 795 Times in 488 Posts
    Have you tried zpaq? (not self extracting, sorry)

Similar Threads

  1. HFCB: Huge Files Compression Benchmark
    By Bulat Ziganshin in forum Data Compression
    Replies: 129
    Last Post: 6th January 2015, 14:31
  2. Huge files sharing
    By Bulat Ziganshin in forum Download Area
    Replies: 4
    Last Post: 30th April 2012, 19:43
  3. NanoZip huge efficiency issue
    By m^2 in forum Data Compression
    Replies: 9
    Last Post: 10th September 2008, 21:51

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •