Results 1 to 2 of 2

Thread: Slow but strong compression idea

  1. #1
    Member
    Join Date
    Jun 2020
    Location
    Somewhere
    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Slow but strong compression idea

    What if we use hashcat to bruteforce multiple fast hashes of fragments of file at the same time?
    There would be need for fast hashes, filesize, few first and last bytes and maybe entropy.
    Has anyone tried that?

  2. #2
    Administrator Shelwien's Avatar
    Join Date
    May 2008
    Location
    Kharkov, Ukraine
    Posts
    3,942
    Thanks
    291
    Thanked 1,286 Times in 728 Posts
    Hashes are lossy.
    Code:
    > md5sum *_*
    79054025255fb1a26e4bc422aef54eb4 *md5_1
    79054025255fb1a26e4bc422aef54eb4 *md5_2
    2a8c87d415a369eeb396d17df6241c57 *sha1_1
    d27794ba8bc1f19e97ec82fea19a231e *sha1_2
    
    > sha1sum *_*
    a34473cf767c6108a5751a20971f1fdfba97690a *md5_1
    4283dd2d70af1ad3c2d5fdc917330bf502035658 *md5_2
    8ac60ba76f1999a1ab70223f225aefdc78d4ddc0 *sha1_1
    8ac60ba76f1999a1ab70223f225aefdc78d4ddc0 *sha1_2
    It may be possible to use hashing as a replacement for entropy coding, to produce a codec with reverse asymmetry
    (fast encoding/slow decoding; in a way, some dedup algorithms already do work like that - only check hash matches rather than full data blocks).
    But you can't rely on bruteforce for reconstruction of input string - its lossy and too slow even for password hashes.
    Attached Files Attached Files

Similar Threads

  1. RAZOR - strong LZ-based archiver
    By Christian in forum Data Compression
    Replies: 208
    Last Post: 4th June 2020, 22:53
  2. Fast and strong LZ only compressors
    By lz77 in forum Data Compression
    Replies: 8
    Last Post: 26th March 2020, 13:20
  3. (LZW variant) LZOOM compression idea and help
    By r01 in forum Data Compression
    Replies: 4
    Last Post: 11th July 2017, 12:00
  4. Very slow compression with very fast decompression?
    By Mangix in forum Data Compression
    Replies: 16
    Last Post: 12th September 2013, 02:25
  5. Compression idea: Base conversion
    By Nightgunner5 in forum Data Compression
    Replies: 8
    Last Post: 30th October 2009, 07:58

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •