Packet archiver 1.0 released

[Nania Francesco]

Packet archiver 1.9 represents, in my opinion, a great step forward in data compression, as it can reach levels of compression before reserved for pure archiver's (7ZIP, PAQ8, CCM, CCMX, WINRAR) equipped with a powerful and fast Core CM (based on context modeling) but with performance from standard LZ77 compessor.
Of course I added a bit range compression algorithm, powerful and innovative.
I entered the control of file CRC32 method which allows more security in data. Because for me is cause for great pride this program I removed the possibility of compressing multi task in that in the future I would like to create a multi-threaded version!
Until version 2.0 do not guarantee the compatibility of the later.
Remember that this is still a beta version!
I hope in the future to release an Open Source version!

only from http://heartofcomp.altervista.org/index.htm

good test!

[just a worm]

Are there already test results for the compression method published somewhere?

[Nania Francesco]

YES!

http://encode.su/threads/1535-WCC-Wo...Incoming/page3

[Sportman]

Are there already test results for the compression method published somewhere?

I did only compression tests at Matt 10gb benchmark folder:
4,677,844,032 bytes 2124.643 sec -m0
4,573,249,469 bytes 3997.251 sec -m4

[Nania Francesco]

@Matt
Please if possible test Packet on LCTB !

[Sportman]

Remove

[Stephan Busch]

Packet 1.0 needs 2.5 hours for compressing the audio testset is not yet finished - is that normal?

[Nania Francesco]

As soon as I can check to verify and release in case a new version. Actually it is so!

[Matt Mahoney]

I am traveling so no testing for 2 weeks until I get home to use my test machine. However I can post results from your tests. I added results to 10gb. Decompression times would help. I guess these would be faster. http://mattmahoney.net/dc/10gb.html

Is there a version of flashzip that doesn't need an admin password to run or a command line version?

[Nania Francesco]

The administrator password is not really necessary. Explain, from DOS it should work without problems, serves as the GUI Program (WFlashzip.exe) leaning in an external program requires this (flashzip.exe) did not block that usually (> =win7) puts each new downloaded ".exe" file!

The block usually remove them manually with the menu that appears with the right mouse button!

[Nania Francesco]

@Stephan Busch

C:\>timer packet a -r -s -v -mx0 c:\pro.zcm d:\test\squeeze\wav\

Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
Packet archiver v.1.0.....

Archive is c:\pro.zcm
compress.. d:/test/squeeze/wav/[acapella].wav 36245448 to 30097379
compress.. d:/test/squeeze/wav/[blues].wav 39886856 to 31887911
compress.. d:/test/squeeze/wav/[downtempo].wav 128217728 to 104281830
compress.. d:/test/squeeze/wav/[folk].wav 37222796 to 31167298
compress.. d:/test/squeeze/wav/[hiphop].wav 54773420 to 42061427
compress.. d:/test/squeeze/wav/[house].wav 50151468 to 39041172
compress.. d:/test/squeeze/wav/[jazz].wav 38514112 to 32925768
compress.. d:/test/squeeze/wav/[orchestral].wav 22932044 to 14969311
compress.. d:/test/squeeze/wav/[pop].wav 34773624 to 30780724
compress.. d:/test/squeeze/wav/[reggae].wav 37990672 to 31687018
compress.. d:/test/squeeze/wav/[rock].wav 38215342 to 34335964
compress.. d:/test/squeeze/wav/[trance].wav 87755684 to 74664353
Compressed 606679194 bytes to 497900155 bytes
Kernel Time = 0.920 = 00:00:00.920 = 0%
User Time = 177.029 = 00:02:57.029 = 92%
Process Time = 177.950 = 00:02:57.950 = 92%
Global Time = 192.396 = 00:03:12.396 = 100%

C:\>timer packet x c:\pro.zcm c:\proco\
Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
Packet archiver v.1.0.....
Archive=c:\pro.zcm Wild=* DEST=c:\proco\\
Kernel Time = 0.483 = 00:00:00.483 = 2%
User Time = 19.749 = 00:00:19.749 = 97%
Process Time = 20.233 = 00:00:20.233 = 99%
Global Time = 20.265 = 00:00:20.265 = 100%

All verified with Filecompare.exe ! Packet is only LZ77 file compressor!
compression of BMP,WAV etc is very slow operation with option -mx9

[Stephan Busch]

with -mx9 switch the compression of wav testset took about 32.000 sec - so with this switch Packet 1.0 is too slow for practical chart

[Nania Francesco]

waiting to resolve the problem...
please test Packet archiver v.1.0 with option -mx6!

[Matt Mahoney]

Tested on LTCB. http://mattmahoney.net/dc/text.html#2325

[Nania Francesco]

Packet archiver 1.1 release in online for download ...

Packet 1.1 represents, in my opinion, a great step forward in data compression, as it can reach levels of compression before reserved for pure archiver's (7ZIP, PAQ8, CCM, CCMX, WINRAR) equipped with a powerful and fast Core CM (based on context modeling) but with performance from standard LZ77 compessor. Of course I added a bit range compression algorithm, powerful and innovative. I entered the control of file CRC32 method which allows more security in data. Because for me is cause for great pride this program I removed the possibility of compressing multi task in that in the future I would like to create a multi-threaded version!
Until version 2.0 do not guarantee the compatibility of the later. I hope in the future to release an Open Source version!

Remember that this is still a beta version!


only from http://heartofcomp.altervista.org/PACKET/home.htm

good test!

[FatBit]

Dear Mr. Nania,

something is wrong. I am not able to run program Packet Archiver 1.1 on Win XP SP3 Czech version. I obtained message "It is not valid win32 application." Is it possible to fix?

Best regards,

FatBit

[Nania Francesco]

This version of packet 1.1 is x86 compatible but slow (10-15%)

Although slower should work.
Give me confirmation please

[FatBit]

Dear Mr. Nania,

thank you for your answer and interest. Program has started but then some error has occured. I have only 512 MB RAM + Win XP SP3 Czech 32 bit.

Best regards,

FatBit

[Nania Francesco]

512 MB ram? no problem !
my best setting is:
packet a -r -mx -b64 -h0 archive folder (or file) -> require 128 MB

[Nania Francesco]

Packet 1.1 vs 10GB benchmark on Intel Core i7 920, 2.66 GHz, 4+4 HT, 6 GB, Win7.

C:\>packet a -r -v -m0 -b512 -h4 f:\pro.zcm c:\10gb\
...................
Final compress... 10000000000 to 3629637937 Bytes

Compressed 79431 files, Time: 1335.9s

C:\>packet x f:\pro.zcm f:\test\10gb\
Packet 1.1 free Archiver by Francesco A. NANIA only for testing.
Ultra LZ77 compression.
Archive is f:\pro.zcm
Time: 479.7s Extracted 79431 file(s).

[GOZARCK]

HI Francesco Nania, i made test from megui folder,

compressing packet 1.1:

packet a -r -v -mx9 -b512 -h4

Final compress... 257807473 to 51286575 Bytes
Compressed 782 files, Time: 204.8s

----- compress with 50% of all cores. how to compress with 80 or 90 % of all cores?

--------------------------------------------------------------------------------------------------------------------------------

Using storing+srep:m3f:mem256mb+dispack070+delta+lzma:17 6mb:normal:bt4:256

Writing directory: 149.58 secs Found 110 directory names: 149.59 secs
Directory written: 149.59 secs100%
Compressed 782 files, 257,807,473 => 46,641,383 bytes. Ratio 18.0%
Compression time: cpu 232.25 secs, real 149.62 secs. Speed 1,723 kB/s
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
thanks

[Nania Francesco]

With Packet 1.1 the best option is -mx and not -mx9!
Packet 1.1 is not multi-task or multithreaded program!

[Nania Francesco]

Packet 1.1 vs 10GB benchmark on Intel Core i7 920, 2.66 GHz, 4+4 HT, 6 GB, Win7.
you point out that with the official version the commands -m6-m8 and -mx go in crush in "10 GB test" .. packetx86.exe work nice! fix the problem in the next official release!

C:\>packet a -r -m9 -b512 -h4 c:\pro.zcm f:\test\10gb\
......................
Final compress... 10000000000 to 3008160754 Bytes

Compressed 79431 files, Time: 4891.5s

C:\>timer packet x c:\pro.zcm f:\proco\

Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
Packet 1.1 free Archiver by Francesco A. NANIA only for testing.
Ultra LZ77 compression.
Archive is c:\pro.zcm
Time: 470.6s Extracted 79431 file(s).

Kernel Time = 19.063 = 00:00:19.063 = 4%
User Time = 288.945 = 00:04:48.945 = 61%
Process Time = 308.008 = 00:05:08.008 = 65%
Global Time = 470.624 = 00:07:50.624 = 100%

[FatBit]

Dear Mr. Nania,

I repeated your command line option (with newer and slower exe) packet a -r -mx -b64 -h0 C:\tmp\archive.zcm C:\temp\ and again obtained "crash". Translation: They are some problems in application and it must be closed.

Best regards,

FatBit

[Matt Mahoney]

I posted your results to http://mattmahoney.net/dc/10gb.html

[Nania Francesco]

@Matt
Please test Packet 1.1 in LTCB !
Thanks!
Hi!
P.S. could you tell me how to decompress the contents of an archive Zpaq in a specific folder other than the original (for WCC 2014) ?

[Matt Mahoney]

zpaq x archive dir -to newdir (extract and rename one directory)
zpaq x archive -to newdir/ (extract everything to newdir/everything)
In both cases, newdir/ will be created.

Also, I updated 10gb with packet 1.1 on system 4 and got a different result than yours.

3324783324 5857 430 4 packet 1.1 -r -m9 -b512 -h4
3008160754 4891* 470* 7 packet 1.1 -r -m9 -b512 -h4

Are you sure no files are missing? You can test like this: zpaq c 10gb.zpaq -force (with 10gb/ in current directory)
For me it shows 62 missing empty directory trees (62 of 83437 files differ) but all regular files verify OK.

I have a bunch of compressors to catch up on for 10gb, LTCB and silesia.

Edit: your results show 79431 files, which is the right number.

Edit: testing in 32 bit Vista:

C:\tmp>unzip packet1.1.zip
Archive:  packet1.1.zip
  inflating: readme.txt
  inflating: packet.exe

C:\tmp>packet
This version of C:\tmp\packet.exe is not compatible with the version of Windows
you're running. Check your computer's system information to see whether you need
 a x86 (32-bit) or x64 (64-bit) version of the program, and then contact the sof
tware publisher.

C:\tmp>file packet.exe
packet.exe: MS-DOS executable PE  for MS Windows (console)

It runs OK in 64 bit Ubuntu under wine.

Edit: tested on LTCB. http://mattmahoney.net/dc/text.html#2171

[Nania Francesco]

LTCB:
Thanks for alla test! the best option is -mx !
option -h set the hash search buffer!
above are for download a version 1.1 of packet named packetx86.zip http://encode.su/threads/1769-Packet...ll=1#post35642 !
Hi !


10gb test:
Thanks Matt I'm going back to test 10 GB download and installation with zpaq you advise me. I will test again. I used a program named FileCompare to compare file and folders. I use the free open source c++ code for Sami Runsas and naturally in the sort of names often change the placement of files and for this different results but not 300 MB of difference. I'll let you know.

[Nania Francesco]

Ok new test with packet 1.1 vs 10GB Benchmark on Intel Core i7 920, 2.66 GHz, 4+4 HT, 6 GB, Win7.

C:\>timer packet a -r -m9 -b512 -h4 c:\pro.pkt f:\test\10gb\

Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
Packet 1.1 free Archiver by Francesco A. NANIA only for testing.
Ultra LZ77 compression.
Final compress... 10000000000 to 3008160754 Bytes

Compressed 79431 files, Time: 5274.2s

Kernel Time = 20.592 = 00:00:20.592 = 0%
User Time = 4920.271 = 01:22:00.271 = 93%
Process Time = 4940.863 = 01:22:20.863 = 93%
Global Time = 5274.206 = 01:27:54.206 = 100%

C:\>timer packet x c:\pro.pkt f:\pro\

Timer 3.01 Copyright (c) 2002-2003 Igor Pavlov 2003-07-10
Packet 1.1 free Archiver by Francesco A. NANIA only for testing.
Ultra LZ77 compression.
Archive is c:\pro.pkt
Time: 453.1s Extracted 79431 file(s).

Kernel Time = 19.812 = 00:00:19.812 = 4%
User Time = 287.104 = 00:04:47.104 = 63%
Process Time = 306.916 = 00:05:06.916 = 67%
Global Time = 453.183 = 00:07:33.183 = 100%

Please Matt test with packetx86 version on Windows ! Hi!

[Matt Mahoney]

Updated 10GB and LTCB benchmarks with -mx option. http://mattmahoney.net/dc/text.html#2139

Can you verify output files are correct:

zpaq c 10gb.zpaq 10gb -to f:\test\10gb -force
zpaq c 10gb.zpaq 10gb -to f:\pro\10gb -force

It should show 62 of 83437 files differ. These are all empty directory trees.

Edit: packet_x86 fails (32 bit Vista):

C:\res>timer32 packet a enwik8.pkt enwik8
 Packet 1.1 free Archiver by Francesco A. NANIA only for testing.
 Ultra LZ77 compression.

Exit code: -1073741795

Commit   =    356136 KB  =    348 MB
Work Set =    342132 KB  =    335 MB

Kernel Time  =     0.499 =    0%
User Time    =    53.227 =   86%
Process Time =    53.726 =   87%
Global Time  =    61.319 =  100%

C:\res>timer32 packet a enwik9.pkt enwik9
 Packet 1.1 free Archiver by Francesco A. NANIA only for testing.
 Ultra LZ77 compression.

Exit code: -1073741795

Commit   =    356140 KB  =    348 MB
Work Set =    342104 KB  =    335 MB

Kernel Time  =     0.530 =    0%
User Time    =    53.040 =   80%
Process Time =    53.570 =   81%
Global Time  =    65.858 =  100%

A window pops up after 53 seconds: "This program has stopped working". In both cases, the .pkt file size is exactly 25,428,532 bytes. (Also fails on 10gb).