Precomp 0.3.8

[schnaader]

Hi!

I just uploaded Precomp 0.3.8. Change list:

- Files larger than 2 GB supported.
- Support for SWF files without slow mode.
- Updated packJPG to inofficial version 2.4WIP4 which improves compression ratio for JPGs a bit.
- New switches -pdfbmp (BMP header for PDF images, useful for PAQ) and -progonly (recompress only progressive JPG files, useful to leave the other ones for PAQ).
- Speed up for decompression (30-150%), slow and brute mode (up to 4 times faster).
- It is possible now to run multiple Precomp instances in the same directory.

Have a look at http://schnaader.info

[John]

THANKS!!

[LovePimple]

Thanks Christian!

[SvenBent]

sweet

[maadjordan]

thanks .. it even worked with movies captured with my casio Camera Ez-1050 (it avi with jpg sanepshopts ant mp3 audio).

is there a way to add an option to attach precomp exe as a SFX so the resulted file wouldhav .exe extension and restore original by double click..

[schnaader]

thanks .. it even worked with movies captured with my casio Camera Ez-1050 (it avi with jpg sanepshopts ant mp3 audio).

Must be the JPGs... if I had added video recompression, I would have added this to the change list in a very big fontsize

is there a way to add an option to attach precomp exe as a SFX so the resulted file wouldhav .exe extension and restore original by double click..

The next thing I will do (perhaps even before releasing the next version) will be a Precomp GUI and a own compressor that will be able to create SFX files with hopefully very fast (> 1 MB/s) decompression. But do not expect this too soon

[Black_Fox]

Thanks a lot!

[maadjordan]

here is two results of casio Ez-1050 movie recompress "hidden feature" of precomp 0.38

cimg0697.avi 26,689,224 >>>> 20,599,722
cimg1049.avi 27,017,464 >>>> 20,509,392

tech.info

cimg0697.avi

[RIFF AVI 26689216]: Audio/Video Interleaved File
[LIST hdrl 324]: Format Definition Chunk
[avih 56]: Main AVI Header
[dwMicroSecPerFrame]: Microseconds Per Frame: 40000
[dwMaxBytesPerSec]: Maximum Bytes Per Second: 1272125
[dwPaddingGranularity]: Padding Granularity (bytes): 0
[dwFlags]: Flags 0x00010030
[AVIF_HASINDEX]: AVI file has 'idx1' chunk
[AVIF_MUSTUSEINDEX]: Index must be used to determine order of presentation of data
[AVIF_WASCAPTUREFILE]: AVI file is a specially allocated file used for capturing real-time video
[dwTotalFrames]: Number Of Frames: 539
[dwInitialFrames]: Numer Of Initial Frames: 0
[dwStreams]: Number Of Streams: 2
[dwSuggestedBufferSize]: Suggested Buffer Size (bytes): 56574
[dwWidth]: Image Width (pixels): 640
[dwHeight]: Image Height (pixels): 480
[LIST strl 116]: Stream Format Definition Chunk
[strh 56]: Stream Header
[fccType]: Type: vids (Video Data)
[fccHandler]: Handler: mjpg (Motion JPEG including Huffman Tables 'mjpg' <0x67706A6D>)
[dwFlags]: Flags 0x00000000
[wPriority]: Stream Priority: 0
[wLanguage]: Language: 0 (Undefined)
[dwInitialFrames]: Numer Of Initial Frames: 0
[dwScale]: Stream Scale: 40000
[dwRate]: Stream Rate: 1000000
[dwStart]: Stream Start: 0
[dwLength]: Stream Duration: 539
[dwSuggestedBufferSize]: Suggested Buffer Size (bytes): 56574
[dwQuality]: Stream Quality (1-10000): 10000
[dwSampleSize]: Sample Size: 0
[rcFrame]: Frame Size Of Stream
[wX1]: Top: 0
[wY1]: Bottom: 0
[wX2]: Left: 640
[wY2]: Right: 480
[strf 40]: Video Stream Format
[biSize]: Header Size (bytes): 40
[biWidth]: Image Width (pixels): 640
[biHeight]: Image Height (pixels): 480
[biPlanes]: Number Of Planes: 1
[biBitCount]: Number Of Bits Per Pixel: 24
[biCompression]: Compression Algorithm: MJPG (Motion JPEG including Huffman Tables 'MJPG' <0x47504A4D>)
[biSizeImage]: Image Size (bytes, 0 = uncompressed): 921600
[biXPelsPerMeter]: Horizontal resolution of target device: 0
[biYPelsPerMeter]: Vertical resolution of target device: 0
[biClrUsed]: Number of colors used (0 = maximum): 0
[biClrImportant]: Number of important colors (0 = all): 0
[LIST strl 96]: Stream Format Definition Chunk
[strh 56]: Stream Header
[fccType]: Type: auds (Audio Data)
[fccHandler]: Handler:  (Unknown Four Character Code ' ' <0x00000011>)
[dwFlags]: Flags 0x00000000
[wPriority]: Stream Priority: 0
[wLanguage]: Language: 0 (Undefined)
[dwInitialFrames]: Numer Of Initial Frames: 0
[dwScale]: Stream Scale: 1024
[dwRate]: Stream Rate: 22125
[dwStart]: Stream Start: 0
[dwLength]: Stream Duration: 466
[dwSuggestedBufferSize]: Suggested Buffer Size (bytes): 2048
[dwQuality]: Stream Quality (1-10000): 0
[dwSampleSize]: Sample Size: 1024
[rcFrame]: Frame Size Of Stream
[wX1]: Top: 0
[wY1]: Bottom: 0
[wX2]: Left: 0
[wY2]: Right: 0
[strf 20]: Audio Stream Format
[wFormatTag]: Audio Format: 0x0011 (Intel DVI ADPCM (IMA ADPCM) <0x0011>)
[nChannels]: Number of channels: 1
[nSamplesPerSec]: Frequency of the sample rate (Hz): 44100
[nAvgBytesPerSec]: Average data rate (byte/s): 22125
[nBlockAlign]: Block alignment of the data (bytes): 1024
[wBitsPerSample]: Number of bits per sample (0 = undefined): 4
[cbSize]: Size of extra information (bytes): 2
[wSamplesPerBlock]: Number of samples per block: 1024
[IDIT 20]: Digitization Time: 2007/09/23/ 23:29
[LIST INFO 52]: RIFF Textual Informative Details
[ISFT 40]: Software Used: CASIO EX-Z1050
[JUNK 836]: Padding
[LIST movi 26664934]: Audio/Video Data
Skipped
[JUNK 6954]: Padding
[idx1 16064]: AVI Index Chunk


cimg1049.avi

[RIFF AVI 27017456]: Audio/Video Interleaved File
[LIST hdrl 324]: Format Definition Chunk
[avih 56]: Main AVI Header
[dwMicroSecPerFrame]: Microseconds Per Frame: 40000
[dwMaxBytesPerSec]: Maximum Bytes Per Second: 1272125
[dwPaddingGranularity]: Padding Granularity (bytes): 0
[dwFlags]: Flags 0x00010030
[AVIF_HASINDEX]: AVI file has 'idx1' chunk
[AVIF_MUSTUSEINDEX]: Index must be used to determine order of presentation of data
[AVIF_WASCAPTUREFILE]: AVI file is a specially allocated file used for capturing real-time video
[dwTotalFrames]: Number Of Frames: 558
[dwInitialFrames]: Numer Of Initial Frames: 0
[dwStreams]: Number Of Streams: 2
[dwSuggestedBufferSize]: Suggested Buffer Size (bytes): 57429
[dwWidth]: Image Width (pixels): 640
[dwHeight]: Image Height (pixels): 480
[LIST strl 116]: Stream Format Definition Chunk
[strh 56]: Stream Header
[fccType]: Type: vids (Video Data)
[fccHandler]: Handler: mjpg (Motion JPEG including Huffman Tables 'mjpg' <0x67706A6D>)
[dwFlags]: Flags 0x00000000
[wPriority]: Stream Priority: 0
[wLanguage]: Language: 0 (Undefined)
[dwInitialFrames]: Numer Of Initial Frames: 0
[dwScale]: Stream Scale: 40000
[dwRate]: Stream Rate: 1000000
[dwStart]: Stream Start: 0
[dwLength]: Stream Duration: 558
[dwSuggestedBufferSize]: Suggested Buffer Size (bytes): 57429
[dwQuality]: Stream Quality (1-10000): 10000
[dwSampleSize]: Sample Size: 0
[rcFrame]: Frame Size Of Stream
[wX1]: Top: 0
[wY1]: Bottom: 0
[wX2]: Left: 640
[wY2]: Right: 480
[strf 40]: Video Stream Format
[biSize]: Header Size (bytes): 40
[biWidth]: Image Width (pixels): 640
[biHeight]: Image Height (pixels): 480
[biPlanes]: Number Of Planes: 1
[biBitCount]: Number Of Bits Per Pixel: 24
[biCompression]: Compression Algorithm: MJPG (Motion JPEG including Huffman Tables 'MJPG' <0x47504A4D>)
[biSizeImage]: Image Size (bytes, 0 = uncompressed): 921600
[biXPelsPerMeter]: Horizontal resolution of target device: 0
[biYPelsPerMeter]: Vertical resolution of target device: 0
[biClrUsed]: Number of colors used (0 = maximum): 0
[biClrImportant]: Number of important colors (0 = all): 0
[LIST strl 96]: Stream Format Definition Chunk
[strh 56]: Stream Header
[fccType]: Type: auds (Audio Data)
[fccHandler]: Handler:  (Unknown Four Character Code ' ' <0x00000011>)
[dwFlags]: Flags 0x00000000
[wPriority]: Stream Priority: 0
[wLanguage]: Language: 0 (Undefined)
[dwInitialFrames]: Numer Of Initial Frames: 0
[dwScale]: Stream Scale: 1024
[dwRate]: Stream Rate: 22125
[dwStart]: Stream Start: 0
[dwLength]: Stream Duration: 482
[dwSuggestedBufferSize]: Suggested Buffer Size (bytes): 2048
[dwQuality]: Stream Quality (1-10000): 0
[dwSampleSize]: Sample Size: 1024
[rcFrame]: Frame Size Of Stream
[wX1]: Top: 0
[wY1]: Bottom: 0
[wX2]: Left: 0
[wY2]: Right: 0
[strf 20]: Audio Stream Format
[wFormatTag]: Audio Format: 0x0011 (Intel DVI ADPCM (IMA ADPCM) <0x0011>)
[nChannels]: Number of channels: 1
[nSamplesPerSec]: Frequency of the sample rate (Hz): 44100
[nAvgBytesPerSec]: Average data rate (byte/s): 22125
[nBlockAlign]: Block alignment of the data (bytes): 1024
[wBitsPerSample]: Number of bits per sample (0 = undefined): 4
[cbSize]: Size of extra information (bytes): 2
[wSamplesPerBlock]: Number of samples per block: 1024
[IDIT 20]: Digitization Time: 2007/11/30/ 21:28
[LIST INFO 52]: RIFF Textual Informative Details
[ISFT 40]: Software Used: CASIO EX-Z1050
[JUNK 836]: Padding
[LIST movi 26996518]: Audio/Video Data
Skipped
[JUNK 3050]: Padding
[idx1 16624]: AVI Index Chunk

so.. thanks again..

[IsName]

MJPG = Motion JPG, each frame is stored as JPEG data.

[maadjordan]

i can say it works with all casio catupred mjpeg file but note that i tested sample from leadtools here http://www.leadcodecs.com/Download/M...PEG-Videos.htm and it didnot work..

[RIFF AVI 10540132]: Audio/Video Interleaved File
[LIST hdrl 64660]: Format Definition Chunk
[avih 56]: Main AVI Header
[dwMicroSecPerFrame]: Microseconds Per Frame: 33367
[dwMaxBytesPerSec]: Maximum Bytes Per Second: 270260
[dwPaddingGranularity]: Padding Granularity (bytes): 1
[dwFlags]: Flags 0x00000810
[AVIF_HASINDEX]: AVI file has 'idx1' chunk
[AVIF_TRUSTCKTYPE]: use chunk type to find key frames
[dwTotalFrames]: Number Of Frames: 1173
[dwInitialFrames]: Numer Of Initial Frames: 0
[dwStreams]: Number Of Streams: 2
[dwSuggestedBufferSize]: Suggested Buffer Size (bytes): 4784
[dwWidth]: Image Width (pixels): 180
[dwHeight]: Image Height (pixels): 120
[LIST strl 32172]: Stream Format Definition Chunk
[strh 56]: Stream Header
[fccType]: Type: vids (Video Data)
[fccHandler]: Handler: MJPG (Motion JPEG including Huffman Tables 'MJPG' <0x47504A4D>)
[dwFlags]: Flags 0x00000000
[wPriority]: Stream Priority: 0
[wLanguage]: Language: 0 (Undefined)
[dwInitialFrames]: Numer Of Initial Frames: 0
[dwScale]: Stream Scale: 333670
[dwRate]: Stream Rate: 10000000
[dwStart]: Stream Start: 0
[dwLength]: Stream Duration: 1174
[dwSuggestedBufferSize]: Suggested Buffer Size (bytes): 4784
[dwQuality]: Stream Quality (1-10000): 0
[dwSampleSize]: Sample Size: 0
[rcFrame]: Frame Size Of Stream
[wX1]: Top: 0
[wY1]: Bottom: 0
[wX2]: Left: 180
[wY2]: Right: 120
[strf 64]: Video Stream Format
[biSize]: Header Size (bytes): 64
[biWidth]: Image Width (pixels): 180
[biHeight]: Image Height (pixels): 120
[biPlanes]: Number Of Planes: 1
[biBitCount]: Number Of Bits Per Pixel: 24
[biCompression]: Compression Algorithm: MJPG (Motion JPEG including Huffman Tables 'MJPG' <0x47504A4D>)
[biSizeImage]: Image Size (bytes, 0 = uncompressed): 129600
[biXPelsPerMeter]: Horizontal resolution of target device: 0
[biYPelsPerMeter]: Vertical resolution of target device: 0
[biClrUsed]: Number of colors used (0 = maximum): 0
[biClrImportant]: Number of important colors (0 = all): 0
[indx 32024]: AVI2 (OpenDML) Super Index Chunk
[LIST strl 32136]: Stream Format Definition Chunk
[strh 56]: Stream Header
[fccType]: Type: auds (Audio Data)
[fccHandler]: Handler: 0x00000000 (No Compression <0x00000000>)
[dwFlags]: Flags 0x00000000
[wPriority]: Stream Priority: 0
[wLanguage]: Language: 0 (Undefined)
[dwInitialFrames]: Numer Of Initial Frames: 0
[dwScale]: Stream Scale: 4
[dwRate]: Stream Rate: 192000
[dwStart]: Stream Start: 0
[dwLength]: Stream Duration: 1878208
[dwSuggestedBufferSize]: Suggested Buffer Size (bytes): 192008
[dwQuality]: Stream Quality (1-10000): 0
[dwSampleSize]: Sample Size: 4
[rcFrame]: Frame Size Of Stream
[wX1]: Top: 0
[wY1]: Bottom: 0
[wX2]: Left: 0
[wY2]: Right: 0
[strf 18]: Audio Stream Format
[wFormatTag]: Audio Format: 0x0001 (Microsoft PCM Format <0x0001>)
[nChannels]: Number of channels: 2
[nSamplesPerSec]: Frequency of the sample rate (Hz): 48000
[nAvgBytesPerSec]: Average data rate (byte/s): 192000
[nBlockAlign]: Block alignment of the data (bytes): 4
[wBitsPerSample]: Number of bits per sample (0 = undefined): 16
[cbSize]: Size of extra information (bytes): 0
[JUNK 2]: Padding
[indx 32024]: AVI2 (OpenDML) Super Index Chunk
[LIST odml 260]: AVI2 (OpenDML) Format Definition Chunk
[dmlh 248]: Total Number Of Frames AVI2 (OpenDML) 1174
[LIST movi 10455988]: Audio/Video Data
Skipped
[idx1 19456]: AVI Index Chunk

[nimdamsk]

You can extract .jpg from MJPEG .avi with Dwing's xjpg http://wex.cn/dwing/download/xjpg.7z and see if those jpegs are compressed as progressive or there is something else with them.

[maadjordan]

after using xjpg .. the resulted jpeg files are not normally viewd but when i checked format with jpegsnoop and it suceeded in exporting a jpeg file after adding "Inserting standard AVI DHT huffman table"


JPEGsnoop 1.2.1 (beta 3) by Calvin Hass
www.impulseadventure.com/photo/
-------------------------------

Filename: [C:\Downloads\mjpeg\mjpeg\WhatBox_MJPEG_180x120_411 _q25.avi]
Filesize: [10540140] Bytes

Start Offset: 0x0001F6FC

*** AVI File Decoding ***
Decoding RIFF AVI format...

LIST
hdrl
LIST
strl
-[FourCC Type] = [vids] Video
-[FourCC Codec] = [MJPG]
-[Sample Rate] = [29.97] frames/sec
vids
LIST
strl
-[FourCC Type] = [auds] Audio
-[FourCC Codec] = []
-[Sample Rate] = [48000.00] samples/sec
auds
indx
LIST
odml
LIST
movi
idx1

AVI is MotionJPEG
Use [Tools->Img Search Fwd] to locate next frame

*** Marker: SOI (xFFD ***
OFFSET: 0x0001F6FC

*** Marker: APP0 (xFFE0) ***
OFFSET: 0x0001F6FE
length = 16
identifier = [AVI1]
Detected MotionJPEG
Importing standard Huffman table...

*** Marker: DHT from MotionJPEG standard (Define Huffman Table) ***
OFFSET: 0x0001F700
Huffman table length = 418
----
Destination ID = 0
Class = 0 (DC / Lossless Table)
Codes of length 01 bits (000 total):
Codes of length 02 bits (001 total): 00
Codes of length 03 bits (005 total): 01 02 03 04 05
Codes of length 04 bits (001 total): 06
Codes of length 05 bits (001 total): 07
Codes of length 06 bits (001 total): 08
Codes of length 07 bits (001 total): 09
Codes of length 08 bits (001 total): 0A
Codes of length 09 bits (001 total): 0B
Codes of length 10 bits (000 total):
Codes of length 11 bits (000 total):
Codes of length 12 bits (000 total):
Codes of length 13 bits (000 total):
Codes of length 14 bits (000 total):
Codes of length 15 bits (000 total):
Codes of length 16 bits (000 total):
Total number of codes: 012

----
Destination ID = 1
Class = 0 (DC / Lossless Table)
Codes of length 01 bits (000 total):
Codes of length 02 bits (003 total): 00 01 02
Codes of length 03 bits (001 total): 03
Codes of length 04 bits (001 total): 04
Codes of length 05 bits (001 total): 05
Codes of length 06 bits (001 total): 06
Codes of length 07 bits (001 total): 07
Codes of length 08 bits (001 total): 08
Codes of length 09 bits (001 total): 09
Codes of length 10 bits (001 total): 0A
Codes of length 11 bits (001 total): 0B
Codes of length 12 bits (000 total):
Codes of length 13 bits (000 total):
Codes of length 14 bits (000 total):
Codes of length 15 bits (000 total):
Codes of length 16 bits (000 total):
Total number of codes: 012

----
Destination ID = 0
Class = 1 (AC Table)
Codes of length 01 bits (000 total):
Codes of length 02 bits (002 total): 01 02
Codes of length 03 bits (001 total): 03
Codes of length 04 bits (003 total): 00 04 11
Codes of length 05 bits (003 total): 05 12 21
Codes of length 06 bits (002 total): 31 41
Codes of length 07 bits (004 total): 06 13 51 61
Codes of length 08 bits (003 total): 07 22 71
Codes of length 09 bits (005 total): 14 32 81 91 A1
Codes of length 10 bits (005 total): 08 23 42 B1 C1
Codes of length 11 bits (004 total): 15 52 D1 F0
Codes of length 12 bits (004 total): 24 33 62 72
Codes of length 13 bits (000 total):
Codes of length 14 bits (000 total):
Codes of length 15 bits (001 total): 82
Codes of length 16 bits (125 total): 09 0A 16 17 18 19 1A 25 26 27 28 29 2A 34 35 36
37 38 39 3A 43 44 45 46 47 48 49 4A 53 54 55 56
57 58 59 5A 63 64 65 66 67 68 69 6A 73 74 75 76
77 78 79 7A 83 84 85 86 87 88 89 8A 92 93 94 95
96 97 98 99 9A A2 A3 A4 A5 A6 A7 A8 A9 AA B2 B3
B4 B5 B6 B7 B8 B9 BA C2 C3 C4 C5 C6 C7 C8 C9 CA
D2 D3 D4 D5 D6 D7 D8 D9 DA E1 E2 E3 E4 E5 E6 E7
E8 E9 EA F1 F2 F3 F4 F5 F6 F7 F8 F9 FA
Total number of codes: 162

----
Destination ID = 1
Class = 1 (AC Table)
Codes of length 01 bits (000 total):
Codes of length 02 bits (002 total): 00 01
Codes of length 03 bits (001 total): 02
Codes of length 04 bits (002 total): 03 11
Codes of length 05 bits (004 total): 04 05 21 31
Codes of length 06 bits (004 total): 06 12 41 51
Codes of length 07 bits (003 total): 07 61 71
Codes of length 08 bits (004 total): 13 22 32 81
Codes of length 09 bits (007 total): 08 14 42 91 A1 B1 C1
Codes of length 10 bits (005 total): 09 23 33 52 F0
Codes of length 11 bits (004 total): 15 62 72 D1
Codes of length 12 bits (004 total): 0A 16 24 34
Codes of length 13 bits (000 total):
Codes of length 14 bits (001 total): E1
Codes of length 15 bits (002 total): 25 F1
Codes of length 16 bits (119 total): 17 18 19 1A 26 27 28 29 2A 35 36 37 38 39 3A 43
44 45 46 47 48 49 4A 53 54 55 56 57 58 59 5A 63
64 65 66 67 68 69 6A 73 74 75 76 77 78 79 7A 82
83 84 85 86 87 88 89 8A 92 93 94 95 96 97 98 99
9A A2 A3 A4 A5 A6 A7 A8 A9 AA B2 B3 B4 B5 B6 B7
B8 B9 BA C2 C3 C4 C5 C6 C7 C8 C9 CA D2 D3 D4 D5
D6 D7 D8 D9 DA E2 E3 E4 E5 E6 E7 E8 E9 EA F2 F3
F4 F5 F6 F7 F8 F9 FA
Total number of codes: 162


*** Marker: DQT (xFFDB) ***
Define a Quantization Table.
OFFSET: 0x0001F710
Table length = 132
----
Precision=8 bits
Destination ID=0 (Luminance)
DQT, Row #0: 8 5 5 8 12 20 25 30
DQT, Row #1: 6 6 7 9 13 29 30 27
DQT, Row #2: 7 6 8 12 20 28 34 28
DQT, Row #3: 7 8 11 14 25 43 40 31
DQT, Row #4: 9 11 18 28 34 54 51 38
DQT, Row #5: 12 17 27 32 40 52 56 46
DQT, Row #6: 24 32 39 43 51 60 60 50
DQT, Row #7: 36 46 47 49 56 50 51 49
Approx quality factor = 75.25 (scaling=49.49 variance=0.81)
----
Precision=8 bits
Destination ID=1 (Chrominance)
DQT, Row #0: 8 9 12 23 49 49 49 49
DQT, Row #1: 9 10 13 33 49 49 49 49
DQT, Row #2: 12 13 28 49 49 49 49 49
DQT, Row #3: 23 33 49 49 49 49 49 49
DQT, Row #4: 49 49 49 49 49 49 49 49
DQT, Row #5: 49 49 49 49 49 49 49 49
DQT, Row #6: 49 49 49 49 49 49 49 49
DQT, Row #7: 49 49 49 49 49 49 49 49
Approx quality factor = 75.26 (scaling=49.48 variance=0.19)

*** Marker: SOF0 (Baseline DCT) (xFFC0) ***
OFFSET: 0x0001F796
Frame header length = 17
Precision = 8
Number of Lines = 120
Samples per Line = 180
Image Size = 180 x 120
Raw Image Orientation = Landscape
Number of Img components = 3
Component[1]: ID=0x01, Samp Fac=0x22 (Subsamp 1 x 1), Quant Tbl Sel=0x00 (Lum: Y)
Component[2]: ID=0x02, Samp Fac=0x11 (Subsamp 2 x 2), Quant Tbl Sel=0x01 (Chrom: Cb)
Component[3]: ID=0x03, Samp Fac=0x11 (Subsamp 2 x 2), Quant Tbl Sel=0x01 (Chrom: Cr)

*** Marker: SOS (Start of Scan) (xFFDA) ***
OFFSET: 0x0001F7A9
Scan header length = 12
Number of img components = 3
Component[1]: selector=0x01, table=0x00
Component[2]: selector=0x02, table=0x11
Component[3]: selector=0x03, table=0x11
Spectral selection = 0 .. 63
Successive approximation = 0x00


*** Decoding SCAN Data ***
OFFSET: 0x0001F7B7
Scan Decode Mode: No IDCT (DC only)
NOTE: Low-resolution DC component shown. Can decode full-res with [Options->Scan Segment->Full IDCT]

Scan Data encountered marker 0xFFD9 @ 0x0001F939.0
Scan Data encountered marker 0xFF30 @ 0x0001F93B.0
NOTE: Marker wasn't EOI (0xFFD9)

Compression stats:
Compression Ratio: 168.31:1
Bits per pixel: 0.14:1

Huffman code histogram stats:
Huffman Table: (Dest ID: 0, Class: DC)
# codes of length 01 bits: 0 ( 0%)
# codes of length 02 bits: 383 (100%)
# codes of length 03 bits: 0 ( 0%)
# codes of length 04 bits: 0 ( 0%)
# codes of length 05 bits: 0 ( 0%)
# codes of length 06 bits: 1 ( 0%)
# codes of length 07 bits: 0 ( 0%)
# codes of length 08 bits: 0 ( 0%)
# codes of length 09 bits: 0 ( 0%)
# codes of length 10 bits: 0 ( 0%)
# codes of length 11 bits: 0 ( 0%)
# codes of length 12 bits: 0 ( 0%)
# codes of length 13 bits: 0 ( 0%)
# codes of length 14 bits: 0 ( 0%)
# codes of length 15 bits: 0 ( 0%)
# codes of length 16 bits: 0 ( 0%)

Huffman Table: (Dest ID: 1, Class: DC)
# codes of length 01 bits: 0 ( 0%)
# codes of length 02 bits: 192 (100%)
# codes of length 03 bits: 0 ( 0%)
# codes of length 04 bits: 0 ( 0%)
# codes of length 05 bits: 0 ( 0%)
# codes of length 06 bits: 0 ( 0%)
# codes of length 07 bits: 0 ( 0%)
# codes of length 08 bits: 0 ( 0%)
# codes of length 09 bits: 0 ( 0%)
# codes of length 10 bits: 0 ( 0%)
# codes of length 11 bits: 0 ( 0%)
# codes of length 12 bits: 0 ( 0%)
# codes of length 13 bits: 0 ( 0%)
# codes of length 14 bits: 0 ( 0%)
# codes of length 15 bits: 0 ( 0%)
# codes of length 16 bits: 0 ( 0%)

Huffman Table: (Dest ID: 0, Class: AC)
# codes of length 01 bits: 0 ( 0%)
# codes of length 02 bits: 0 ( 0%)
# codes of length 03 bits: 0 ( 0%)
# codes of length 04 bits: 384 (100%)
# codes of length 05 bits: 0 ( 0%)
# codes of length 06 bits: 0 ( 0%)
# codes of length 07 bits: 0 ( 0%)
# codes of length 08 bits: 0 ( 0%)
# codes of length 09 bits: 0 ( 0%)
# codes of length 10 bits: 0 ( 0%)
# codes of length 11 bits: 0 ( 0%)
# codes of length 12 bits: 0 ( 0%)
# codes of length 13 bits: 0 ( 0%)
# codes of length 14 bits: 0 ( 0%)
# codes of length 15 bits: 0 ( 0%)
# codes of length 16 bits: 0 ( 0%)

Huffman Table: (Dest ID: 1, Class: AC)
# codes of length 01 bits: 0 ( 0%)
# codes of length 02 bits: 192 (100%)
# codes of length 03 bits: 0 ( 0%)
# codes of length 04 bits: 0 ( 0%)
# codes of length 05 bits: 0 ( 0%)
# codes of length 06 bits: 0 ( 0%)
# codes of length 07 bits: 0 ( 0%)
# codes of length 08 bits: 0 ( 0%)
# codes of length 09 bits: 0 ( 0%)
# codes of length 10 bits: 0 ( 0%)
# codes of length 11 bits: 0 ( 0%)
# codes of length 12 bits: 0 ( 0%)
# codes of length 13 bits: 0 ( 0%)
# codes of length 14 bits: 0 ( 0%)
# codes of length 15 bits: 0 ( 0%)
# codes of length 16 bits: 0 ( 0%)

YCC clipping in DC:
Y component: [<0= 0] [>255= 0]
Cb component: [<0= 0] [>255= 0]
Cr component: [<0= 0] [>255= 0]

RGB clipping in DC:
R component: [<0= 0] [>255= 0]
G component: [<0= 0] [>255= 0]
B component: [<0= 0] [>255= 0]

Brightest Pixel Search:
YCC=[-1024, 0, 0] RGB=[ 0, 0, 0] @ MCU[ 0, 0]

Finished Decoding SCAN Data
Number of RESTART markers decoded: 0
Next position in scan buffer: Offset 0x0001F938.4


*** Marker: EOI (End of Image) (xFFD9) ***
OFFSET: 0x0001F939


*** Searching Compression Signatures ***

Signature: 01F7BF349603DA557C8CD6EE7D9C5AC7
Signature (Rotated): 01CAA4241F9ACC590059C92CC8203E75
File Offset: 128764 bytes
Chroma subsampling: 2x2
EXIF Make/Model: NONE
EXIF Makernotes: NONE
EXIF Software: NONE

Searching Compression Signatures: (3314 built-in, 0 user(*) )

EXIF.Make / Software EXIF.Model Quality Subsamp Match?
------------------------- ----------------------------------- ---------------- --------------
SW :[LEAD Technologies Inc ] [025 ]

ASSESSMENT not done as file offset non-zero

*** Exporting JPEG ***
Exporting from: [C:\Downloads\mjpeg\mjpeg\WhatBox_MJPEG_180x120_411 _q25.avi]
Exporting to: [C:\Downloads\mjpeg\mjpeg\WhatBox_MJPEG_180x120_411 _q25.avi.export.jpg]
Inserting standard AVI DHT huffman table
Export done

[Intrinsic]

The new packJPG makes a really nice difference, thanks for this latest release Christian.

And I could have sworn i noticed on some tests a few days ago that some other types(ie non-JPEGs) of files increased very slightly in size(only talking bytes) but i can't seem to find what i tested now :/

Overall nice gains though, esp on JPEG.

[schnaader]

The new packJPG makes a really nice difference, thanks for this latest release Christian.

Overall nice gains though, esp on JPEG.

Thanks, it is also nice to hear of the Casio MJPEG compression feature . Sad it doesn't work for MJPEG in general - perhaps huffman tables can be added somehow, I'll do some experiments with this and ask Matthias Stirner about it.
By the way, it would be nice to know if the Casio MJPEG feature is also available in Precomp 0.3.7 or if it is result of the new PackJPG DLL.

And I could have sworn i noticed on some tests a few days ago that some other types(ie non-JPEGs) of files increased very slightly in size(only talking bytes) but i can't seem to find what i tested now :/

There's a slight size increasement (should be 4 bytes) that results from >2 GB support - file size is now stored as 8 bytes, not as 4 byte, so that could be it.

[SvenBent]

There's a slight size increasement (should be 4 bytes) that results from >2 GB support - file size is now stored as 8 bytes, not as 4 byte, so that could be it.

with 4 bytes you shoud blea ble to describe up to size of 4294967295 bytes or close to 4gb.
Did you use a the wrong kind of interger (e.g with one bit reserved for +/-)

[maadjordan]

i've test it with v0.37(pjg2.3) and worked fine and guess what it even worked with v0.34(pjg2.2) so the problem was "ME" not testing it before..sorry

on the other hand about the packjpg v2.4wip it seemss fine with color jpg but when using grayscale images it losses compression compared to v2.3..
is there a chance to test my finiding more.. as least a compiled version would fine..

[thometal]

The next thing I will do (perhaps even before releasing the next version) will be a Precomp GUI and a own compressor that will be able to create SFX files with hopefully very fast (> 1 MB/s) decompression. But do not expect this too soon

I would prefer an integretion into freearc, because I don't like to have 1 archiver per filetype. Also with freearc you have a good GUI and excellent algorithms. So why to research the wheel more than once?

Thats my opinion. And I think in this way your algorithm will be widely-used.

TT

[schnaader]

on the other hand about the packjpg v2.4wip it seemss fine with color jpg but when using grayscale images it losses compression compared to v2.3..
is there a chance to test my finiding more.. as least a compiled version would fine..

I can only send Matthias Stirner a message and ask him when a compiled version will be out. He said that compression ratio would be better for most files, but he knew that there were some that would lose ratio. Anyway, this packJPG version is no final version, so I think we should wait for a final v2.4 release.

I would prefer an integretion into freearc, because I don't like to have 1 archiver per filetype. Also with freearc you have a good GUI and excellent algorithms. So why to research the wheel more than once?

Thats my opinion. And I think in this way your algorithm will be widely-used.

I'll think about this. There's a Precomp preset in arc.ini, but perhaps a deeper integration would be useful.
For SFX archives, however, I will have to do everything myself to get the smallest possible overhead.

I have experimented with some Motion JPG videos and there is a standard JPG DHT header that has to be inserted. Results are not that good, but this should be improvable, also JPGs in this video are rather small.
Only adding the DHT header without recompressing would also be an option to proceed with PAQ which will get a much better ratio.

WhatBox_180x120_411_q25.avi 10.540.140 Bytes
WhatBox_180x120_411_q25.pcf 9.973.896 Bytes (5,4% smaller)

WhatBox_180x120_411_q25.avi.ccm2 6.691.207 Bytes
WhatBox_180x120_411_q25.pcf.ccm2 6.532.180 Bytes (2,4% smaller)

Damn, now I have to release the next Precomp version earlier

[Intrinsic]

There's a slight size increasement (should be 4 bytes) that results from >2 GB support - file size is now stored as 8 bytes, not as 4 byte, so that could be it.

Ahh yep i remember thinking at the time if it was something todo with the larger file support Just slipped my mind when i posted...my memory sucks sometimes.

[Intrinsic]

Just came across these errors when unpacking some old financials to go over them:

Precomp v0.3.8 - ALPHA version - USE FOR TESTING ONLY
Free for non-commercial use - Copyright 2006-2008 by Christian Schneider

Input file $$arcpackedfile$$.tmp was made with a different Precomp version
PCF version info: 0.3.7
WARNING: CRC error in help/help.zip
WARNING: CRC error in themes/themepack.zip
87%
WARNING: CRC error in lib/BCastle.jar
...And the list of CRC errors goes on. When using 0.3.7 they decompresses fine fyi. The only files that seemed to be effected where the zip's and jar's.
I have been able to reproduce this fyi, and can send you a subset of the files that it doesn't like if you want.

Anything i can do at my end to get you any data on this? or is it nothing to worry about?

[SvenBent]

nput file $$arcpackedfile$$.tmp was made with a different Precomp version
PCF version info: 0.3.7

then using 0.3.7 they decompresses fine

it not wonder it doesn't work as it appears that you have been using 3.7 for making the pcf file. it actually says so in the error msg.

its a test only project and its probably not made to be backwards compatible

[Intrinsic]

Yeah i can read lol, but no mention of non-backwards compatibility although it's to be expected.

[Bulat Ziganshin]

1. for keeping b/w compatibility you may've used zip64-like idea - use -1 to denote that next 8 bytes hold 64-bit size

2. for better compatibility with freearc-like shells i propose to add support for stdin-to-stdout mode, like it already done in ccm. this will allow to smoothly integrate precomp into fa with propoer progress indication and so on

[SvenBent]

Yeah i can read lol, but no mention of non-backwards compatibility although it's to be expected.

Yeah its not really mentioned anywhere. Would be a good thing

But then again if you use it for what its what build for there wouldn't be any issues... use for testing only and you didn't... shame on you. Thinking you could get away by using this for actually use

[schnaader]

Sorry for the trouble. I'll put the old Precomp versions and a note about backward compatibility (which is not supported as you may have noticed ) on the site.

[Intrinsic]

Heh that's cool, better than it being a bug

[maadjordan]

another finding.. Corel Draw RIFF format is supported by precomp in "slow" mode and i test it with v9,v11,v12, so i think it support all..

for you to confirm here is some pages that has CDR file samples..

http://www.wavpack.com/downloads.html (gain was small)
http://www.uth.tmc.edu/scriptorium/t...el/sample.html (gain was smaller)
http://www.mhprofessional.com/downlo...1912_code.html (gain is huge)
http://andyrew.info/corel/samples/

the supported formats in slow mode are

CDR Corel DRAW Graphic (v7.0,8,8b,9,10,11,12,13 are riff file but v14.0 is zip with riff inside as msoffice2007 files)
PAT Corel Pattern File
CLK Corel R.A.V.E. Document (v1,2,3 are riff)
DES Corel Designer Graphic (v10,10.5,12 are riff v14 are zipped riff)
CSL Corel Symbol Library (v1,2,3,4 are riff and v5,6 are zipped riff)
CDT Corel Draw Template (v7,8,8b,9,10,11,12,12.5,13 are riff and 14,14.1 are zipped riff)

samples are attached

still to check CDX & CPX formats..

[lunaris]

Hello


A simple feature request


Include decompression for LZMA streams.

Actually a lot of Linux distribution include LZMA compressed isos.


Thanks

[maadjordan]

if lzma support is on the way, please consdier .RH 3d format..
i noticed that right hemisphere format .rh from http://www.righthemisphere.com support LZMA compression here is samples.. http://rapidshare.com/files/13413608...Models.7z.html (link temporary for 30 days..)

[Intrinsic]

Is it possible to add TIFF files to the list of ones that precomp will check without using -slow(or maybe it'll have to anyways?)? TIFF files can use Deflate and when precomp -slow is used on these types it makes a huge difference as you'd expect.

Quick example, for what it's worth:

Just CCM: 2,156,082 bytes
Precomp -slow + CCM: 1,311,135 bytes

Recompressed streams: 5/5
zLib streams (slow mode): 5/5

I can provide example files if needed. But also i don't think that Deflate is that commonly used in TIFF files, and it has other methods too like LZW and PackBits, although they aren't as good as Deflate so Deflate is the most commonly used or none at all.