How do I dump the strings LZ77 matches?

[SolidComp]

Say I'm running zlib or libdeflate to gzip a text file... How can I extract a list of the strings that LZ77 has decided are matches with previous strings?

I'm particularly interested in how it handles matchable substrings of matched superstrings, like:

type="text/javascript"

type="text"

type="text

So how do I extract the matches?

[Bulat Ziganshin]

find routine like encode_match or so and add printf statement

[Shelwien]

http://nishi.dreamhosters.com/u/defl_matches_v0.rar

C:\!arc\defl_matches_v0>test.bat
Extract raw deflate stream from .zip -> 00000000.raw
beg=00000023 last=0 type=2 size=2977 unplen=7705
end=000492F6 bufbeg=00000007 bufend=00000000
Extract LZ token stream from .raw -> 00000000.dec
Unpack the data from .dec -> 00000000.unp
0a0fdbaf0589c9713bde9120cbb20199 *00000000.unp
lit: "\x0A"
match: "acco"
lit: "r"
lit: "d"
match: "ingly.'\x0A"
match: "THE "
lit: "E"
lit: "N"
lit: "D"
lit: "\x0A"

[SolidComp]

http://nishi.dreamhosters.com/u/defl_matches_v0.rar

C:\!arc\defl_matches_v0>test.bat
Extract raw deflate stream from .zip -> 00000000.raw
beg=00000023 last=0 type=2 size=2977 unplen=7705
end=000492F6 bufbeg=00000007 bufend=00000000
Extract LZ token stream from .raw -> 00000000.dec
Unpack the data from .dec -> 00000000.unp
0a0fdbaf0589c9713bde9120cbb20199 *00000000.unp
lit: "\x0A"
match: "acco"
lit: "r"
lit: "d"
match: "ingly.'\x0A"
match: "THE "
lit: "E"
lit: "N"
lit: "D"
lit: "\x0A"

Thanks @Shelwien. I'm not too familiar with .bat files. If I understand the snippet above, I run test.bat at the command line, and the remainder of that snippet is the output of the command? How does it know which .zip file to process? I don't see any naming of a target .zip file anywhere. (I assume this will process .gz files too?)

p.s. Your site is still being blocked by BitDefender and other tools.

[Shelwien]

Here's the bat file:

echo Extract raw deflate stream from .zip -^> 00000000.raw
rawdet.exe book1.zip nul nul 

echo Extract LZ token stream from .raw -^> 00000000.dec
raw2dec.exe 00000000.raw 00000000.dec 

echo Unpack the data from .dec -^> 00000000.unp
dec2unp.exe 00000000.dec 00000000.unp > 00000000.txt

md5sum 00000000.unp

tail 00000000.txt

Do you see where to put the .zip now?
Though actually it would extract the deflate streams from any file containing them, including .pdf,.png etc.

But the main point are the utils for deflate parsing - there's source included, so you can tweak them how you need.
For example, I used raw2dec and a similar lzma utility to compare deflate and lzma entropy coding on the same
sequence of matches. threads/1288-LZMA-markup-tool

> I don't see any naming of a target .zip file anywhere.

You can replace book1.zip above with %1, then "test.bat somefile" would process what you specify.
Or you can just do the whole 3 steps manually.

> p.s. Your site is still being blocked by BitDefender and other tools.

Well, AV guys are known for blocking any hacking tools, so it may be "correct" about that.