Page 2 of 3 FirstFirst 123 LastLast
Results 31 to 60 of 75

Thread: Packet archiver 1.0 released

  1. #31
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    @ Matt
    I checked with Winmerge that folders that do not contain files are not created and also with zpaq confirmed but I don't understand how it can be 300 MB of difference on UBUNTU!
    The test shall be deemed to have always exceeded?
    Thanks for all test!
    Last edited by Nania Francesco; 15th December 2013 at 14:08.

  2. #32
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Are to work to the next version of packet that will include support for file/folder attributes and folder compression. I hope to put this version with full support for file names.

  3. #33
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Please Help !

    struct FileInfo
    {
    DWORD fileAttr;
    int64_t filetime;
    };

    void SetFolderDateTime(char *szFilePath, FileInfo info)
    {
    HANDLE hFile = CreateFile(szFilePath,
    GENERIC_READ|GENERIC_WRITE,FILE_SHARE_READ|FILE_SH ARE_WRITE,
    NULL,
    OPEN_EXISTING,
    FILE_FLAG_BACKUP_SEMANTICS,
    NULL);

    if(hFile == INVALID_HANDLE_VALUE)
    return 1;

    if (info.filetime>0)
    {
    SYSTEMTIME st;
    FILETIME ft;
    st.wYear=info.filetime/10000000000LL%10000;
    st.wMonth=info.filetime/100000000%100;
    st.wDayOfWeek=0; // ignored
    st.wDay=info.filetime/1000000%100;
    st.wHour=info.filetime/10000%100;
    st.wMinute=info.filetime/100%100;
    st.wSecond=info.filetime%100;
    st.wMilliseconds=0;
    SystemTimeToFileTime(&st, &ft);
    if (!SetFileTime(hFile, &ft, &ft, &ft)) printf( "SetFileTime error %d\n");
    }
    CloseHandle(hFile);
    SetFileAttributes(
    szFilePath,
    info.fileAttr
    );
    }


    FileInfo GetFolderDateTime(char *szFilePath)
    {
    DWORD dwAttr;
    dwAttr = GetFileAttributes(szFilePath);
    FILETIME ftCreated;
    FILETIME ftModified;
    FILETIME ftAccessed;

    // open the file/folder
    HANDLE hFile = CreateFile(szFilePath,
    GENERIC_READ|GENERIC_WRITE,FILE_SHARE_READ|FILE_SH ARE_WRITE,
    NULL,
    OPEN_EXISTING,
    FILE_FLAG_BACKUP_SEMANTICS,
    NULL);
    FileInfo info;

    if(hFile == INVALID_HANDLE_VALUE) return;
    SYSTEMTIME st;
    int64_t edate=0;
    bool bVal =GetFileTime(hFile,&ftCreated,&ftAccessed,&ftModif ied);
    if (FileTimeToSystemTime(&ftModified, &st))edate=st.wYear*10000000000LL+st.wMonth*100000 000LL+st.wDay*1000000+st.wHour*10000+st.wMinute*10 0+st.wSecond;


    CloseHandle(hFile);
    info.fileAttr=dwAttr;
    info.filetime=edate;
    return info;
    }
    This is the code that I use for the Directory and the first extraction of the archive does not always applies the changes to the modified date.
    The decompressor applies the above code considering that if I unpack a single file I have to have all the attributes of the folder, subfolder, and files!
    What is the solution?
    Last edited by Nania Francesco; 23rd December 2013 at 12:10.

  4. #34
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    In zpaq I have to make a separate pass to update directory dates and empty directories after all files are extracted. Otherwise when you extract a file it updates the date of the directory containing it. You can look at function makepath() in zpaq.cpp but it looks like you are doing the same thing.

  5. The Following User Says Thank You to Matt Mahoney For This Useful Post:

    Nania Francesco (24th December 2013)

  6. #35
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Packet archiver 1.2 released

    - new core !
    - better compression!

    link:
    http://heartofcomp.altervista.org/index.htm
    Good testing....!

  7. The Following User Says Thank You to Nania Francesco For This Useful Post:

    Skymmer (21st July 2015)

  8. #36
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    Big improvement on 10GB http://mattmahoney.net/dc/10gb.html (system 4)
    Code:
     Size       Compress  Extract Sys  Program version  Options
     ---------- -------- -------- ---  ---------------  --------
     2954727653     3568      328*  4  packet 1.2       -r -mx -b512 -h4
     3314339844     7442      440   4  packet 1.1       -r -mx -b512 -h4
    However it seems to ignore the output argument and extracts to just the saved names, like "packet x archive.packet out" does not extract to out.

    Edit: nice improvement on LTCB too. http://mattmahoney.net/dc/text.html#2049
    Last edited by Matt Mahoney; 21st July 2015 at 05:47.

  9. The Following User Says Thank You to Matt Mahoney For This Useful Post:

    Nania Francesco (21st July 2015)

  10. #37
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Thanks Matt for all test!

    However it seems to ignore the output argument and extracts to just the saved names, like "packet x archive.packet out" does not extract to out.
    Could you explain more precisely I don't understand well the problem of decompression. Thanks!

  11. #38
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    When packet uses part of the old code of version 1.1 and suffers from the problems of the previous version. However in the future I plan to use the code structure that is more complete LZA and stable.

  12. #39
    Member Skymmer's Avatar
    Join Date
    Mar 2009
    Location
    Russia
    Posts
    681
    Thanks
    37
    Thanked 168 Times in 84 Posts
    The worst thing about Packet (and almost all other Nania's tools) is the files\directories treatment.

    1. Input file cannot be larger than signed int (2147483647 bytes). I don't know if its also true for total size of input data and size of resulting archive.
    2. If you define input as d:\data or d:\data\* then recursion does work but the whole path is saved in archive.
    3. d:\data\*.* works too but recursion doesn't works in this case.
    4. d:\data\*.someextension doesn't works at all.
    5. The only way to create archive with full content of d:\data with directory structure preserved but excluding storage of data prefix is the following:
    Code:
    @echo off
    set dir=g:\TEMP3\Data
    set cur=%cd%
    cd /d "%dir%"
    "%cur%\packetx64.exe" a -r "%cur%\TEST.packet" *
    6. As mentioned by Matt, during decompression the output path is ignored if its defined as relative path. Decompressed data goes to the current directory in this case.
    But it works if the full output path is given: packetx64.exe x TEST.packet d:\test\unp
    A little trick for relative decompression works too: packetx64.exe x TEST.packet "%cd%\unp"

  13. #40
    Member Skymmer's Avatar
    Join Date
    Mar 2009
    Location
    Russia
    Posts
    681
    Thanks
    37
    Thanked 168 Times in 84 Posts
    Just a minor addition.
    I have been pointed to the fact that the beggining of my previous post can be treated as some kind of anger. Actually I didn't wanted to say that Nania's programs are bad or something like this. Actually his programs are always welcomed in my compression collection, so I just reported the bugs and called them worst, because they make the overall impression a little bit worse

  14. #41
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    Thanks for explanation. I was using a relative path to extract. What I do is:

    packetx64.exe a -r -mx -b512 -h4 usb/10gb.packet 10gb 10gb
    packetx64.exe x usb/10gb.packet tmp

    I am testing in Ubuntu using Wine. usb is a symbolic link to an external USB drive. 10gb is the 10GB benchmark directory in /home/matt/10gb which I run from /home/matt
    (so it works for archives larger than 2 GB, although the largest file is smaller).
    I was expecting to extract to /home/matt/tmp/10gb or as sometimes happens with Nania's archivers when the full path name is saved, to /home/matt/tmp/home/matt/10gb
    Instead, it overwrites /home/matt/10gb if I don't rename it.

    All of the files are extracted correctly. But file dates and empty directories are not restored (like his other archivers). That's OK because I don't require that for the 10GB benchmark.

  15. #42
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    I'm at work on version 2.0 of packet which will compress even empty folders and restore the features of folders and files (creation date etc). See you soon!

  16. The Following 3 Users Say Thank You to Nania Francesco For This Useful Post:

    Matt Mahoney (30th July 2016),Samantha (30th July 2016),Stephan Busch (29th July 2016)

  17. #43
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Before releasing the 2.0 version with which I not edit more compression core to maintain compatibility and handles the problem of file names and folders UTF16, release soon a version 1.9 which represents the capabilities!

  18. The Following User Says Thank You to Nania Francesco For This Useful Post:

    comp1 (19th August 2016)

  19. #44
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    I released version 1.9 of packet representing a step ahead (of course in my opinion).
    Notes:
    - I have changed and improved the core;
    - better compression for all file types;
    - better parsing of many file types;
    - compress even empty folders and restore the features of folders and files (creation date etc).
    - removed TXT filter;


    link:
    http://heartofcomp.altervista.org/index.htm
    Good testing....!

  20. The Following 6 Users Say Thank You to Nania Francesco For This Useful Post:

    Bulat Ziganshin (21st August 2016),Cyan (24th August 2016),load (19th August 2016),Mike (19th August 2016),Samantha (20th August 2016),Stephan Busch (19th August 2016)

  21. #45
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    While not using filters or particular pre-codings that use Pcompress and Freearc, Packet got in WCC 2015-2016 a result similar to ZPAQ!!

    @Matt-@ Stephan
    At this point expect the results of your benchmark for confirmations!

  22. #46
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Huge Files Compression Benchmark results:

    option: a -r -s -v -h7 -b5 -mx
    Compressed 4244176896 bytes to 957429386 bytes
    Global Time encoding = 2389.062 = 00:39:49.062 = 100%
    Global Time decoding = 89.888 = 00:01:29.888 = 100%
    Compression Ratings OS1 test
    option: a -r -s -v -h7 -b5 -mx
    Compressed 500000000 bytes to 92029531 bytes
    Global Time encoding = 318.834 = 00:05:18.834
    Global Time decoding= 10.077 = 00:00:10.077

  23. #47
    Tester
    Stephan Busch's Avatar
    Join Date
    May 2008
    Location
    Bremen, Germany
    Posts
    873
    Thanks
    462
    Thanked 175 Times in 85 Posts
    using Packet 1.9 with -s -r -v h9 -b5 -mx shows big compression improvements;
    Packet 1.9 climbs up the practical chart to rank 28 which is above Tangelo and between LPAQ variants.
    So far, there seem to be no errors.
    Impressive work, Francesco. Thank you very much.

    On older Packet I wrote "LZ77 + Huffman + filter" in the field of algorithms used -
    is that still true for the current version?

  24. #48
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Thanks Stephan ,
    I am very happy with this news, I worked the last four months to this version and I hope the results see

    On older Packet I wrote "LZ77 + Huffman + filter" in the field of algorithms used -
    is that still true for the current version?
    There is no compatibility unfortunately, Does not use Huffman but only range coding and direct bit i/o in memory !

  25. The Following User Says Thank You to Nania Francesco For This Useful Post:

    Stephan Busch (21st August 2016)

  26. #49
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    @Matt
    Please if possible test Packet on L.T.C.B. and 10GB Benchmark !

  27. #50
    Member
    Join Date
    Dec 2015
    Location
    Russia
    Posts
    18
    Thanks
    2
    Thanked 1 Time in 1 Post
    Can i compress\decompress folder with saving subfolders\files structure?
    It's support utf-8 (cyrilic, russian)? And can be used as command line archiver instead 7z\rar?

    I can help you with some tests, but i'm not coder, just advanced user..

  28. #51
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Your help is welcome

  29. #52
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Can i compress\decompress folder with saving subfolders\files structure?
    It's support utf-8 (cyrilic, russian)? And can be used as command line archiver instead 7z\rar?

    I can help you with some tests, but i'm not coder, just advanced user
    What did I need to understand is what kind of variable "string", "wchar" etc I need to access the file list. There is nothing impossible but I have to rewrite some code again!

  30. #53
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    My personal opinion is that you would join forces to create and make available at least a standard archiver with uncompressed copy of data and then everyone could put inside your compressor or coding! joining forces you could get a highly effective archiver!

  31. The Following User Says Thank You to Nania Francesco For This Useful Post:

    Stephan Busch (24th August 2016)

  32. #54
    Member
    Join Date
    Dec 2015
    Location
    Russia
    Posts
    18
    Thanks
    2
    Thanked 1 Time in 1 Post
    But 7z\rar etc (command line versions) processing folders structure and files without any problems. Why strong new and perspective compressors can not do it? your tool, and from many others from here.. zstd from Cyan etc..
    Of corse i can use batch script for processing subcontent of folder, but this sh.t

  33. #55
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    @Matt
    Please if possible test Packet on L.T.C.B. and 10GB Benchmark !

  34. #56
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    @Matt
    Please if possible test Packet on L.T.C.B. and 10GB Benchmark !
    Problems!

  35. #57
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 778 Times in 485 Posts
    Small improvement on LTCB using a larger hash table. Decompression is faster. http://mattmahoney.net/dc/text.html#2044

    The "l" list command crashes (page fault) under Ubuntu/Wine, both 32 and 64 bit versions, but compress and extract are OK. List works OK in Windows.

  36. The Following User Says Thank You to Matt Mahoney For This Useful Post:

    Nania Francesco (6th September 2016)

  37. #58
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    Thanks Matt !
    10 GB Benchmark result's ?

  38. #59
    Member Samantha's Avatar
    Join Date
    Apr 2016
    Location
    italy
    Posts
    38
    Thanks
    31
    Thanked 7 Times in 4 Posts
    Hi Francesco, I tested the new packet v1.9 with FA support, but I get continuous crash of compressor with any method of compression or any files I use with the errorelevel = -1073741819.
    Unlike the old version packet v1.2 that works perfectly.

    Click image for larger version. 

Name:	Packet1.2.png 
Views:	66 
Size:	45.5 KB 
ID:	4630Click image for larger version. 

Name:	Packet1.9.png 
Views:	78 
Size:	42.4 KB 
ID:	4631

    Config arc.ini ...

    Code:
    [External compressor:packet]
    ;header = 0
    packcmd   = packet a -mx -b512 -h4 -v -r $$arcpackedfile$$.tmp $$arcdatafile$$.tmp  
    unpackcmd = packet x -v $$arcpackedfile$$.tmp $$arcdatafile$$.tmp   
    datafile   = $$arcdatafile$$.tmp
    packedfile = $$arcpackedfile$$.tmp
    First Test Packet1.2 = OK

    Second Test Packet1.9 = Crash

    Code:
    -○- [ CMD Bench.Test.Info v0.0.6c ] -○- Compressed Archive Completed At -○- 06/09/2016 14:13:26
    ==================================================================================================================================================
     ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ CONFIGURATION - ARGUMENTS - OPTIONS ] ○
    
                 Arc         202,1°MB           45,3°MB       22,41 %             12°Files    00:01:49:629   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" 
                                                                                                             -mprecomp+msc+srep64+delta+exe2+packet 
    ==================================================================================================================================================
    
    -○- [ CMD Bench.Test.Info v0.0.6c ] -○- Compressed Archive Completed At -?- 06/09/2016 14:18:00
    ==================================================================================================================================================
     ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ CONFIGURATION - ARGUMENTS - OPTIONS ] ○
    
                 Arc         202,1°MB          Error°MB       Error %             12°Files    00:02:31:887   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" 
                                                                                                             -mprecomp+msc+srep64+delta+exe2+packet 
    ==================================================================================================================================================
    I hope you have a solution. Ciao e Grazie.


  39. #60
    Tester
    Nania Francesco's Avatar
    Join Date
    May 2008
    Location
    Italy
    Posts
    1,565
    Thanks
    220
    Thanked 146 Times in 83 Posts
    In italiano:
    Guarda che la versione 1.9 utilizza una sintassi di comando diversa dalla versione 1.2

    la massima compressione si ha con l'opzione
    packet a -r -s -mx -h7 -b5 archive file/dir
    Look at the version 1.9 uses a different command syntax from version 1.2

    the maximum compression occurs with the option
    packet a -r -s -mx -h7 -b5 archive file/dir

Page 2 of 3 FirstFirst 123 LastLast

Similar Threads

  1. Data compression for stream with small packet
    By alpha_one_x86 in forum Data Compression
    Replies: 1
    Last Post: 6th May 2012, 18:51
  2. PACKET 0.91a compressor is online !
    By Nania Francesco in forum Data Compression
    Replies: 8
    Last Post: 7th August 2009, 16:49
  3. PACKET v.0.01 new fast compressor !
    By Nania Francesco in forum Data Compression
    Replies: 45
    Last Post: 19th June 2008, 01:44
  4. KGB Archiver 2 released!
    By LovePimple in forum Forum Archive
    Replies: 1
    Last Post: 11th February 2007, 20:30

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •