Results 1 to 25 of 25

Thread: CHK 1.01 is here! (New GUI MD5/SHA1 file checker)

  1. #1
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts

    Cool CHK 1.01 is here! (New GUI MD5/SHA1 file checker)

    Hi fellas!

    Check out the CHK! With this small GUI tool you can check/verify file contents, find duplicate files, save checksums to .md5/.sha1 files (compatible with md5sum/sha1sum and many other utilities) and more!

    Have fun!

    File Name: chk101.zip
    Size: 437,848 bytes
    MD5: BB7F5DD8AED14743F5213E1EA097F9B9
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	chk101.png 
Views:	704 
Size:	189.0 KB 
ID:	1426  
    Attached Files Attached Files

  2. #2
    Member kampaster's Avatar
    Join Date
    Apr 2010
    Location
    ->
    Posts
    55
    Thanks
    4
    Thanked 6 Times in 6 Posts
    encode thank

  3. #3
    Member chornobyl's Avatar
    Join Date
    May 2008
    Location
    ua/kiev
    Posts
    153
    Thanks
    0
    Thanked 0 Times in 0 Posts
    not md5 nor size wont match, is something wrong

  4. #4
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    To compare items by hash (MD5/SHA1), simply press on MD5/SHA1 column. All items will be sorted by hash and matched ones will be marked by special icon!

  5. #5
    Tester
    Black_Fox's Avatar
    Join Date
    May 2008
    Location
    [CZE] Czechia
    Posts
    471
    Thanks
    26
    Thanked 9 Times in 8 Posts
    Nice When hashing some bigger files (say 50 MB each), CHK stops responding to user input at second or third file... It doesn't freeze in endless loop nor crash, just looks unresponsive.
    I am... Black_Fox... my discontinued benchmark
    "No one involved in computers would ever say that a certain amount of memory is enough for all time? I keep bumping into that silly quotation attributed to me that says 640K of memory is enough. There's never a citation; the quotation just floats like a rumor, repeated again and again." -- Bill Gates

  6. #6
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    It's because the hash computing is done in main thread! It's BETA and proof of concept anyway... If program will become popular, I will do many improvements. If not, I'll keep it as is, since I wrote that tool for myself.

  7. #7
    Programmer schnaader's Avatar
    Join Date
    May 2008
    Location
    Hessen, Germany
    Posts
    571
    Thanks
    219
    Thanked 204 Times in 96 Posts
    Nice program. Some usability things:

    - If no file is marked, "Edit->Copy" command should create a summary for the whole list instead of doing nothing.
    - (Un)checking "Edit->Use SHA1" shouldn't clear the list but just switch MD5<->SHA1

    Quote Originally Posted by chornobyl View Post
    not md5 nor size wont match, is something wrong
    Worked for me, downloaded the ZIP file and MD5 and size matched. Are you sure you checked MD5/size of the ZIP file and not chk.exe (which is 458.240 bytes, C7A67B53B36E036EC77759E688EAB307)?
    http://schnaader.info
    Damn kids. They're all alike.

  8. #8
    Member chornobyl's Avatar
    Join Date
    May 2008
    Location
    ua/kiev
    Posts
    153
    Thanks
    0
    Thanked 0 Times in 0 Posts
    -adding same files twice, listing them two times and not replacing
    -stop button, have to kill program when selected too big file
    -start button, to first create list, then compare
    -fixed size font for hashes, and option for lowercase
    -and maybe grouping similar lines by background color
    -cant select few files inside
    -deleting remove file avoiding recycle bin
    Quote Originally Posted by schnaader
    you sure you checked MD5/size of the ZIP
    my bad, i checked executable itself
    Last edited by chornobyl; 20th November 2010 at 22:02.

  9. #9
    Member
    Join Date
    Nov 2010
    Location
    fr
    Posts
    4
    Thanks
    0
    Thanked 0 Times in 0 Posts
    look fine
    tested on my project dir 20Go / 8826 files / 2 raptors Raid0
    matches are found with md5

    somes remarks :
    i not find how scan a dir with menu (wildcard * not enabled)
    can not manage files filters (scan only *.dat and/or don't scan files *.7z)
    save as : export ascii scan list in form md5 *path\filename
    should be nice if a marker exist like a + instead of * when duplicate file matches (was a bit tricky to find duplicate in ascii file with 8000+ files scaned)

    another thing, not sure if in spirit of this prog (as is done to calculate signature)
    turbo mode : just read file data (and calc sign) only if some others files have same length
    chk : 13sec
    double file scanner http://mulder.dummwiedeutsch.de/home...cts#doublescan : 8sec

  10. #10
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    Quote Originally Posted by ben View Post
    i not find how scan a dir with menu (wildcard * not enabled)
    Drag&Drop a Folder or even a Drive to CHK's window! (Drop item(s) here, means drop not just a file(s) here)

    Quote Originally Posted by ben View Post
    should be nice if a marker exist like a + instead of * when duplicate file matches (was a bit tricky to find duplicate in ascii file with 8000+ files scaned)
    MD5 and SHA1 files are in md5sum and sha1sum formats respectively - i.e. you can use these command line utilities to test integrity of files. In addition, many other utilities are compatible with such files. As example, check out the ExactFile! Also, you may sort a list by the digest (MD5/SHA1) and only then save to file - file will contain information sorted my MD5/SHA1.

    Quote Originally Posted by ben View Post
    another thing, not sure if in spirit of this prog (as is done to calculate signature)
    turbo mode : just read file data (and calc sign) only if some others files have same length
    chk : 13sec
    double file scanner http://mulder.dummwiedeutsch.de/home...cts#doublescan : 8sec
    CHK is not just about duplicate file search! And as a note it can be many times faster - I have my own SHA1 implementation which is 4x times faster than current Indy component based one. Also I may add a multi-threading! But at this stage of development I wrote just a small program with basic functionality. If no one needs in such kind of software I will not spend my spare time for it. If CHK will be more or less popular, as I said, I will add some further work!

  11. #11
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts

    Exclamation

    Somehow CHK 1.01 faced a false detection by some anti-viruses.

    Wrote a letter to Kaspersky. The answer is:

    Hello,

    Sorry, it was a false detection. It will be fixed in the next update.
    Thank you for your help.

    -----------------
    Regards, Artem Ushkov
    Virus Analyst, Kaspersky Lab.
    Anyway, some other AV software detects CHK 1.01 as a virus/hoax.

    IN REAL WORLD, IT IS NOT!

    I just can't write a letter to ALL AV makers... If someone can, please write a note to your favorite AV software vendor! Thanks a lot!

  12. #12
    Member
    Join Date
    Mar 2010
    Location
    Germany
    Posts
    116
    Thanks
    18
    Thanked 32 Times in 11 Posts
    I have the same problem with my own programs, until I avoid UPX to compress my work.
    Your are using UPX as well, try it without.

  13. #13
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    Did a few improvements:
    + More polished GUI
    + Improved SHA1 computation - now it's my own and optimized SHA1 implementation that a few times faster than a component-based one as in current version
    + CRC computed simultaneously and kept for reference
    + Added ECR (Estimated Compression Ratio) feature. Now you can find a highly redundant files and determine already compressed files. Furthermore now you can see how good the file can be compressed.
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	chk102.png 
Views:	325 
Size:	68.2 KB 
ID:	1608  

  14. #14
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts

    Question

    Any ideas are welcomed, BTW! CHK is a file analysis tool, from the data compression world. What kind of a feature you need the most?
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	1.png 
Views:	315 
Size:	342.5 KB 
ID:	1611  

  15. #15
    Member
    Join Date
    May 2008
    Location
    Antwerp , country:Belgium , W.Europe
    Posts
    487
    Thanks
    1
    Thanked 3 Times in 3 Posts

    Thumbs down UPX fails to restore the original unpacked CHK.EXE

    What version and options did you use to UPX the chk.exe ?
    UPX 3.07 can unpack it without any errors, but the unpacked file doesn't work anymore.
    (something about a missing DLL)
    Any idea why this is ?

  16. #16
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    I always pack with the latest UPX and use --ultra-brute switch.

  17. #17
    Member Skymmer's Avatar
    Join Date
    Mar 2009
    Location
    Russia
    Posts
    681
    Thanks
    38
    Thanked 168 Times in 84 Posts
    Quote Originally Posted by pat357 View Post
    What version and options did you use to UPX the chk.exe ?
    UPX 3.07 can unpack it without any errors, but the unpacked file doesn't work anymore.
    (something about a missing DLL)
    Any idea why this is ?
    I can confirm it. The reason is that there is a shift and overlapping in reconstructed import table. I tried manually manipulate with deUPX-ed file but failed, just don't have too much experience with such things. Anyway, I have the working unpacked version of it, so if you need it then I can give it to you.
    But interesting... I never seen such thing before with UPX. Seems that is some error in decompression routine. Ilia, can you provide the original non-packed file so we can submit bug-report to UPX developers ?

  18. #18
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts

    Talking

    Looks like I have no original EXE - only packed one. CHK v0.01 is from year 2010, probably UPX developers already fixed such issues. Anyway, we will check it in the upcoming CHK 1.02!

  19. #19
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    + Now if you'll add the same file(s) miltiple times the information will be updated instead of adding duplicated items

    Most likely I'll switch to SHA256 since it's more secure. CRC will be kept since nearly all archivers use it for file integrity checking.

  20. #20
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    Also, probably instead of current predictor I'll add file entropy calculator. Obviously not just an order-0 file entropy, but order-1...order-5. Anyway, current multi-order SR predictor is really accurate.

  21. #21
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	Untitled.png 
Views:	290 
Size:	65.7 KB 
ID:	1615  

  22. #22
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts
    Marking matched files with a star:
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	star.png 
Views:	294 
Size:	150.4 KB 
ID:	1616  

  23. #23
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts

    Talking

    Now it's much more solid!

    Collecting new ideas. As example I may add a "Compress" command to compress a file to .GZ/.BZ2/.Z file. In this case you will able not to just search highly redundant files, but compressing them as well. You may search and delete duplicate files already. Have an idea about authentication/signing...

    And even if no one interested in CHK currently, it will be something cool and unique at the end. Believe me!
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	s.png 
Views:	274 
Size:	50.7 KB 
ID:	1617  

  24. #24
    Member zody's Avatar
    Join Date
    Aug 2009
    Location
    Germany
    Posts
    90
    Thanks
    0
    Thanked 1 Time in 1 Post
    Maybe 2 file windows side by side would be useful to compare directories easier =)
    The estimated compression ratio is a really helpful feature

    "Compress" command could start any archiver via command line...

  25. #25
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,984
    Thanks
    377
    Thanked 352 Times in 140 Posts

    Talking

    Quote Originally Posted by zody View Post
    The estimated compression ratio is a really helpful feature
    BTW, looks like CHK and only has precise compression prognosis - it's really close to result of real world compressors. WinRAR has such feature, but its results are far from real.

Similar Threads

  1. FrontPAQ - GUI frontend for PAQ8PF and PAQ8PX
    By LovePimple in forum Download Area
    Replies: 26
    Last Post: 17th January 2019, 14:36
  2. New GUI tool
    By encode in forum Data Compression
    Replies: 31
    Last Post: 18th November 2010, 22:55
  3. GUI for CCMx and DURILCA?
    By LovePimple in forum Forum Archive
    Replies: 27
    Last Post: 23rd March 2008, 22:12
  4. FreeArc GUI - how it should look&feel?
    By Bulat Ziganshin in forum Forum Archive
    Replies: 31
    Last Post: 20th July 2007, 18:32
  5. GUI for creation of 7z-SFX-archives
    By Vacon in forum Forum Archive
    Replies: 0
    Last Post: 8th June 2007, 16:16

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •