Page 1 of 2 12 LastLast
Results 1 to 30 of 47

Thread: Slowest Random General Lossless Compressor

  1. #1
    Member
    Join Date
    Nov 2019
    Location
    Virginia
    Posts
    3
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Smile Slowest Random General Lossless Compressor

    I programmed it, but it's really really slow. It takes an hour to compress 12 bytes to 7 bytes. And you can still compress that 7 bytes again. But the time it takes is it worth it? And How much would it worth? Because theoretically it can compress all types of files, and I believe with faster computer, and elegant code. It would take few seconds to compress.

  2. #2
    Administrator Shelwien's Avatar
    Join Date
    May 2008
    Location
    Kharkov, Ukraine
    Posts
    3,943
    Thanks
    293
    Thanked 1,286 Times in 728 Posts
    You can win 20k euro here: http://prize.hutter1.net/
    Have to decompress it rather than compress, though :)
    15284944*7/12 = 8916217
    50000*(15284944-8916217)/15284944 = 20833

  3. #3
    Member
    Join Date
    Nov 2019
    Location
    Virginia
    Posts
    3
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Quote Originally Posted by Shelwien View Post
    You can win 20k euro here: http://prize.hutter1.net/
    Have to decompress it rather than compress, though
    15284944*7/12 = 8916217
    50000*(15284944-8916217)/15284944 = 20833
    Don't you think 20k euro is too nano money for a true general random lossless compressor?

  4. #4
    Administrator Shelwien's Avatar
    Join Date
    May 2008
    Location
    Kharkov, Ukraine
    Posts
    3,943
    Thanks
    293
    Thanked 1,286 Times in 728 Posts
    First you need to have something you can actually sell.
    Like a US patent, or startup company based on your idea.
    An idea is not a product.
    With just an idea you can get a research grant or a job contract, but nothing luxurious.

    Then, there's also a cost/benefit analysis.
    The choice is not between storing the data with your algorithm, or not storing anything at all.
    But rather between getting more storage vs computing power required + extra latency.
    For a new algorithm with a speed similar to zlib there would be some applications,
    but we don't see cmix or nncp getting used to save storage space, because it wouldn't be profitable.

  5. #5
    Member
    Join Date
    Feb 2020
    Location
    Sargodha,Pakistan
    Posts
    9
    Thanks
    1
    Thanked 0 Times in 0 Posts

    Smile can you show us sample code or algorithm of compressor?

    i am also working on random data compressor.
    that turn 2 bit to following
    11 1
    10 10
    01 11
    00 0
    AMillionRandomDigits.bin 405k to 291k
    but decompress is so slow that i don't know even its working.

  6. #6
    Administrator Shelwien's Avatar
    Join Date
    May 2008
    Location
    Kharkov, Ukraine
    Posts
    3,943
    Thanks
    293
    Thanked 1,286 Times in 728 Posts
    Cool. So how do you understand whether to decode "11" as "01" or "11 11"?
    By trying all versions and comparing the file hash?
    Then you'd need a bit of file hash per instance of ambiguous code?
    So there's no compression?

  7. #7
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,569
    Thanks
    777
    Thanked 687 Times in 372 Posts
    intuition!

  8. #8
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    11 0 1
    10 10
    01 11
    00 0 2 11,12,21 22

    Last edited by pacalovasjurijus; 6th February 2020 at 19:36.

  9. #9
    Member
    Join Date
    Feb 2020
    Location
    Sargodha,Pakistan
    Posts
    9
    Thanks
    1
    Thanked 0 Times in 0 Posts
    i am only researching random data compressor.i am not saying that i have a working one.
    AMillionRandomDigits.bin 405k
    to
    AMillionRandomDigits.m8d 291k ;data file 00 -> 0 01->10 10->1 11->1
    AMillionRandomDigits.m8h 116k ;hash(xxHash) file of every 20bytes(10bytes of m8d)
    =408k
    but after ziping both m8d + m8h to rar
    m8.rar 382k
    compressor is very very fast but to verify decompression its take lot of time and if many states of m8 data match the same hash we need additional overhead of index of correct data.it really hard to compress random data to even few bytes.
    direct index to correct data state is not a option because
    AMillionRandomDigits.m8d 291k
    AMillionRandomDigits.m8i 183k
    =479k
    even rar
    index based.rar 453k
    so only hash is option for now and there is tiny chance that our m8 state data do not produce same hash.

    here a report of m8(Method 8) with index file
    AMillionRandomDigits.bin
    405 KB ( 415,241 bytes)
    AMillionRandomDigits.m8i
    187 KB ( 192,280 bytes)
    AMillionRandomDigits.m8d / AMillionRandomDigits.rar
    291 KB ( 298,981 bytes) / 265 KB (272,318 bytes)

    gain = 72% 116260 Bytes / 65%142923
    index avg bits per m8 byte= 5.14
    needed avg bits per m8 byte=3.11 /3.82
    hash 2 bits needed 16 bytes


    original.dat
    3.00 MB (3,145,728 bytes)
    original.m8i
    1.38 MB (1,456,779 bytes)
    original.m8d /original.rar
    2.16 MB (2,265,125 bytes) /1.96 MB (2,062,809 bytes)

    gain = 72% / 65%
    ---------------------

  10. #10
    Member
    Join Date
    Feb 2020
    Location
    Sargodha,Pakistan
    Posts
    9
    Thanks
    1
    Thanked 0 Times in 0 Posts
    m64(Method 64bit) states
    encode 64 bits to 41-51bits etc...
    decoder
    1.need inputs bits size 41-51bits etc..
    2.index of correct state

    ---------------
    Pass :1 States: 0
    Pass :2 States: 1
    Pass :3 States: 2
    Pass :4 States: 3
    Pass :5 States: 3
    Pass :6 States: 6
    Pass :7 States: 9
    Pass :8 States: 15
    Pass :9 States: 15
    Pass :10 States: 30
    Pass :11 States: 45
    Pass :12 States: 45
    Pass :13 States: 90
    Pass :14 States: 135
    Pass :15 States: 135
    Pass :16 States: 270
    Pass :17 States: 405
    Pass :18 States: 675
    Pass :19 States: 1080
    Pass :20 States: 1755
    Pass :21 States: 2835
    Pass :22 States: 2835
    Pass :23 States: 2835
    Pass :24 States: 5670
    Pass :25 States: 5670
    Pass :26 States: 5670
    Pass :27 States: 11340
    Pass :28 States: 17010
    Pass :29 States: 28350
    Pass :30 States: 45360
    Pass :31 States: 73710
    Pass :32 States: 119070
    Pass :33 States: 192780
    Pass :34 States: 311849
    Pass :35 States: 504605
    Pass :36 States: 504605
    Pass :37 States: 1007029
    Pass :38 States: 1500961
    Pass :39 States: 2462196
    Pass :40 States: 3804002
    Pass :41 States: 5801424
    Pass :42 States: 8447952
    Pass :43 States: 8447952
    Pass :44 States: 12162688
    Pass :45 States: 14017748
    Pass :46 States: 16577648
    Pass :47 States: 18178976
    States :17881600
    -----------------------
    more short version:
    10011110101011000100111010000000010101000001011100 00101100000111
    m45:101111010101101011101000011100111100101100111
    1 Pass :34 States: 95998
    0 Pass :35 States: 153559
    0 Pass :36 States: 153379
    1 Pass :37 States: 152252
    0 Pass :38 States: 295986
    1 Pass :39 States: 284629
    1 Pass :40 States: 502480
    0 Pass :41 States: 646492
    0 Pass :42 States: 527689
    1 Pass :43 States: 337297
    1 Pass :44 States: 351582
    1 Pass :45 States: 319217
    ----- Total Pass :45 Final States: 205921 ------
    ((((((((( Index == 122586 )))))))))))
    01101111001000001000100111001111010001001100100101 10110011001101
    m47:1101111010001001011101111101011010111011011011 1
    0 Pass :34 States: 149758
    1 Pass :35 States: 149738
    1 Pass :36 States: 299078
    1 Pass :37 States: 446363
    0 Pass :38 States: 733544
    1 Pass :39 States: 713685
    1 Pass :40 States: 1306902
    0 Pass :41 States: 1743411
    1 Pass :42 States: 1486174
    1 Pass :43 States: 2066042
    0 Pass :44 States: 2229619
    1 Pass :45 States: 1474605
    1 Pass :46 States: 1311028
    1 Pass :47 States: 1105680
    ----- Total Pass :47 Final States: 655617 ------
    ((((((((( Index == 350125 )))))))))))
    01110010010000001001011100100110110100110000100000 01010101111001
    m43:1110101000101111010110111011001000111111101
    0 Pass :34 States: 57599
    1 Pass :35 States: 57580
    1 Pass :36 States: 114836
    1 Pass :37 States: 170614
    1 Pass :38 States: 277496
    1 Pass :39 States: 420701
    1 Pass :40 States: 620626
    1 Pass :41 States: 857210
    0 Pass :42 States: 1104658
    1 Pass :43 States: 852266
    ----- Total Pass :43 Final States: 529394 ------
    ((((((((( Index == 210288 )))))))))))
    01110110110000011101001011110100111010010100011111 00100101010001
    m45:111110110011110101111101110101101111101011101
    1 Pass :34 States: 486718
    1 Pass :35 States: 730031
    1 Pass :36 States: 1216204
    1 Pass :37 States: 1942092
    0 Pass :38 States: 3135137
    1 Pass :39 States: 3089805
    0 Pass :40 States: 5864948
    1 Pass :41 States: 5530821
    1 Pass :42 States: 9312570
    1 Pass :43 States: 11555167
    0 Pass :44 States: 14667817
    1 Pass :45 States: 11028470
    ----- Total Pass :45 Final States: 6703038 ------
    ((((((((( Index == 2641358 )))))))))))
    00010100001000000000101000100110101100111011110001 11011100000111
    m46:0110010000010100101101011011101111011111100111
    1 Pass :34 States: 21598
    0 Pass :35 States: 34525
    1 Pass :36 States: 34396
    1 Pass :37 States: 67410
    1 Pass :38 States: 96777
    1 Pass :39 States: 148234
    1 Pass :40 States: 204601
    1 Pass :41 States: 266534
    0 Pass :42 States: 314842
    0 Pass :43 States: 223466
    1 Pass :44 States: 105054
    1 Pass :45 States: 74016
    1 Pass :46 States: 55184
    ----- Total Pass :46 Final States: 27072 ------
    ((((((((( Index == 1290 )))))))))))
    11011110111011010100010010010011011101011100111011 00000000001001
    m46:1111110111011110101010111111111011101100000101
    1 Pass :34 States: 1196158
    1 Pass :35 States: 1794187
    0 Pass :36 States: 2989706
    1 Pass :37 States: 2987242
    1 Pass :38 States: 5945454
    0 Pass :39 States: 8809187
    0 Pass :40 States: 8603140
    0 Pass :41 States: 7981890
    0 Pass :42 States: 6836321
    0 Pass :43 States: 5194226
    1 Pass :44 States: 3364799
    0 Pass :45 States: 3578468
    1 Pass :46 States: 2541119
    ----- Total Pass :46 Final States: 1394598 ------
    ((((((((( Index == 988164 )))))))))))
    00011001010110011100100000001111101111101100011000 11000000000110
    m46:0110111101110100001111101111101101100110000110
    1 Pass :34 States: 121679
    1 Pass :35 States: 243314
    0 Pass :36 States: 364539
    0 Pass :37 States: 363074
    1 Pass :38 States: 355849
    1 Pass :39 States: 668178
    0 Pass :40 States: 907965
    0 Pass :41 States: 786547
    0 Pass :42 States: 553158
    0 Pass :43 States: 314079
    1 Pass :44 States: 135851
    1 Pass :45 States: 83808
    0 Pass :46 States: 58816
    ----- Total Pass :46 Final States: 16864 ------
    ((((((((( Index == 994 )))))))))))
    11000011001110000011111110010110101001111100001100 00010101111111
    m49:1100110111000111111101110101011111001100111111 111
    1 Pass :34 States: 244798
    0 Pass :35 States: 397753
    0 Pass :36 States: 397515
    1 Pass :37 States: 395833
    1 Pass :38 States: 777178
    0 Pass :39 States: 1121927
    0 Pass :40 States: 1052070
    1 Pass :41 States: 879435
    1 Pass :42 States: 1271426
    1 Pass :43 States: 1391883
    1 Pass :44 States: 1486749
    1 Pass :45 States: 1381774
    1 Pass :46 States: 1163455
    1 Pass :47 States: 866465
    1 Pass :48 States: 571565
    1 Pass :49 States: 332195
    ----- Total Pass :49 Final States: 159042 ------
    ((((((((( Index == 154028 )))))))))))
    10101010011001010110111011010101101111010111010100 10100101010000
    m47:1010101011011110111011111101111111111010101110 0
    1 Pass :34 States: 846718
    1 Pass :35 States: 1370829
    1 Pass :36 States: 2216955
    1 Pass :37 States: 3583092
    0 Pass :38 States: 5772657
    1 Pass :39 States: 5716260
    0 Pass :40 States: 11020860
    1 Pass :41 States: 10552430
    0 Pass :42 States: 18523002
    pass failed
    1 Pass :43 States: 0
    1 Pass :44 States: 2
    1 Pass :45 States: 3
    0 Pass :46 States: 5
    0 Pass :47 States: 5
    ----- Total Pass :47 Final States: 0 ------
    ((((((((( Index == 0 )))))))))))
    11111101110010000011001110101010010011110011100001 11100110111010
    m53:1111111110100011011101010101011110111001111011 0111010
    0 Pass :34 States: 341758
    1 Pass :35 States: 341736
    1 Pass :36 States: 682994
    1 Pass :37 States: 1021517
    0 Pass :38 States: 1687672
    0 Pass :39 States: 1657060
    1 Pass :40 States: 1556931
    1 Pass :41 States: 2716552
    1 Pass :42 States: 3470346
    1 Pass :43 States: 4572233
    0 Pass :44 States: 5333823
    1 Pass :45 States: 3807002
    1 Pass :46 States: 3738020
    0 Pass :47 States: 3324236
    1 Pass :48 States: 1671105
    1 Pass :49 States: 956088
    1 Pass :50 States: 676410
    0 Pass :51 States: 325079
    1 Pass :52 States: 141582
    0 Pass :53 States: 34226
    ----- Total Pass :53 Final States: 18289 ------
    ((((((((( Index == 10965 )))))))))))
    01101010010101111110000000010110100011100110101010 11000100110100
    m48:1101010111111110000111010011101101010101101011 10
    1 Pass :34 States: 98999
    0 Pass :35 States: 197956
    1 Pass :36 States: 197759
    0 Pass :37 States: 392942
    1 Pass :38 States: 387880
    0 Pass :39 States: 737680
    1 Pass :40 States: 695780
    1 Pass :41 States: 1170080
    0 Pass :42 States: 1447360
    1 Pass :43 States: 1129550
    0 Pass :44 States: 1336732
    1 Pass :45 States: 988258
    1 Pass :46 States: 878050
    1 Pass :47 States: 743121
    0 Pass :48 States: 534570
    ----- Total Pass :48 Final States: 261869 ------
    ((((((((( Index == 74224 )))))))))))
    11011010101001111100001011100010001000100011011010 10111111000001
    m52:1111010101011111001011100100100100111101010111 111001
    0 Pass :34 States: 66559
    1 Pass :35 States: 66540
    1 Pass :36 States: 132756
    1 Pass :37 States: 197490
    1 Pass :38 States: 322230
    0 Pass :39 States: 491827
    1 Pass :40 States: 457859
    0 Pass :41 States: 755866
    1 Pass :42 States: 649786
    0 Pass :43 States: 871158
    1 Pass :44 States: 678750
    1 Pass :45 States: 704868
    1 Pass :46 States: 647062
    1 Pass :47 States: 537620
    1 Pass :48 States: 409549
    1 Pass :49 States: 275832
    0 Pass :50 States: 169171
    0 Pass :51 States: 66439
    1 Pass :52 States: 9676
    ----- Total Pass :52 Final States: 1668 ------
    ((((((((( Index == 754 )))))))))))

  11. #11
    Member
    Join Date
    Feb 2020
    Location
    Sargodha,Pakistan
    Posts
    9
    Thanks
    1
    Thanked 0 Times in 0 Posts

    Smile M8(Method 8bit)

    M8 single bytes states


    size
    byte value:states count

    16
    0:1

    14 16
    1:2

    16 14
    2:2

    14 16 14
    3:3

    16 14
    4:2

    14 16 12 14
    5:4

    16 14 14
    6:3

    14 16 14 12 14
    7:5

    16 14
    8:2

    14 16 12 14
    9:4

    16 14 14 12
    10:4

    14 16 14 12 14 12
    11:6

    16 14 14
    12:3

    14 16 12 14 12 14
    13:6

    16 14 14 14 12
    14:5

    14 16 14 12 14 12 14 12
    15:8

    16 14
    16:2

    14 16 12 14
    17:4

    16 14 14 12
    18:4

    14 16 14 12 14 12
    19:6

    16 14 14 12
    20:4

    14 16 12 14 12 14 10 12
    21:8

    16 14 14 14 12 12
    22:6

    14 16 14 12 14 12 14 12 10 12
    23:10

    16 14 14
    24:3

    14 16 12 14 12 14
    25:6

    16 14 14 12 14 12
    26:6

    14 16 14 12 14 12 12 14 12
    27:9

    16 14 14 14 12
    28:5

    14 16 12 14 12 14 12 14 10 12
    29:10

    16 14 14 14 12 14 12 12
    30:8

    14 16 14 12 14 12 14 12 12 14 12 10 12
    31:13

    16 14
    32:2

    14 16 12 14
    33:4

    16 14 14 12
    34:4

    14 16 14 12 14 12
    35:6

    16 14 14 12
    36:4

    14 16 12 14 12 14 10 12
    37:8

    16 14 14 14 12 12
    38:6

    14 16 14 12 14 12 14 12 10 12
    39:10

    16 14 14 12
    40:4

    14 16 12 14 12 14 10 12
    41:8

    16 14 14 12 14 12 12 10
    42:8

    14 16 14 12 14 12 12 14 12 10 12 10
    43:12

    16 14 14 14 12 12
    44:6

    14 16 12 14 12 14 12 14 10 12 10 12
    45:12

    16 14 14 14 12 14 12 12 12 10
    46:10

    14 16 14 12 14 12 14 12 12 14 12 10 12 10 12 10
    47:16

    16 14 14
    48:3

    14 16 12 14 12 14
    49:6

    16 14 14 12 14 12
    50:6

    14 16 14 12 14 12 12 14 12
    51:9

    16 14 14 12 14 12
    52:6

    14 16 12 14 12 14 10 12 12 14 10 12
    53:12

    16 14 14 14 12 12 14 12 12
    54:9

    14 16 14 12 14 12 14 12 10 12 12 14 12 10 12
    55:15

    16 14 14 14 12
    56:5

    14 16 12 14 12 14 12 14 10 12
    57:10

    16 14 14 12 14 12 14 12 12 10
    58:10

    14 16 14 12 14 12 12 14 12 12 14 12 10 12 10
    59:15

    16 14 14 14 12 14 12 12
    60:8

    14 16 12 14 12 14 12 14 10 12 12 14 10 12 10 12
    61:16

    16 14 14 14 12 14 12 12 14 12 12 12 10
    62:13

    14 16 14 12 14 12 14 12 12 14 12 10 12 12 14 12 10 12 10 12 10
    63:21

    16 14
    64:2

    14 16 12 14
    65:4

    16 14 14 12
    66:4

    14 16 14 12 14 12
    67:6

    16 14 14 12
    68:4

    14 16 12 14 12 14 10 12
    69:8

    16 14 14 14 12 12
    70:6

    14 16 14 12 14 12 14 12 10 12
    71:10

    16 14 14 12
    72:4

    14 16 12 14 12 14 10 12
    73:8

    16 14 14 12 14 12 12 10
    74:8

    14 16 14 12 14 12 12 14 12 10 12 10
    75:12

    16 14 14 14 12 12
    76:6

    14 16 12 14 12 14 12 14 10 12 10 12
    77:12

    16 14 14 14 12 14 12 12 12 10
    78:10

    14 16 14 12 14 12 14 12 12 14 12 10 12 10 12 10
    79:16

    16 14 14 12
    80:4

    14 16 12 14 12 14 10 12
    81:8

    16 14 14 12 14 12 12 10
    82:8

    14 16 14 12 14 12 12 14 12 10 12 10
    83:12

    16 14 14 12 14 12 12 10
    84:8

    14 16 12 14 12 14 10 12 12 14 10 12 10 12 8 10
    85:16

    16 14 14 14 12 12 14 12 12 12 10 10
    86:12

    14 16 14 12 14 12 14 12 10 12 12 14 12 10 12 10 12 10 8 10
    87:20

    16 14 14 14 12 12
    88:6

    14 16 12 14 12 14 12 14 10 12 10 12
    89:12

    16 14 14 12 14 12 14 12 12 10 12 10
    90:12

    14 16 14 12 14 12 12 14 12 12 14 12 10 12 10 10 12 10
    91:18

    16 14 14 14 12 14 12 12 12 10
    92:10

    14 16 12 14 12 14 12 14 10 12 12 14 10 12 10 12 10 12 8 10
    93:20

    16 14 14 14 12 14 12 12 14 12 12 12 10 12 10 10
    94:16

    14 16 14 12 14 12 14 12 12 14 12 10 12 12 14 12 10 12 10 12 10 10 12 10 8 10
    95:26

    16 14 14
    96:3

    14 16 12 14 12 14
    97:6

    16 14 14 12 14 12
    98:6

    14 16 14 12 14 12 12 14 12
    99:9

    16 14 14 12 14 12
    100:6

    14 16 12 14 12 14 10 12 12 14 10 12
    101:12

    16 14 14 14 12 12 14 12 12
    102:9

    14 16 14 12 14 12 14 12 10 12 12 14 12 10 12
    103:15

    16 14 14 12 14 12
    104:6

    14 16 12 14 12 14 10 12 12 14 10 12
    105:12

    16 14 14 12 14 12 12 10 14 12 12 10
    106:12

    14 16 14 12 14 12 12 14 12 10 12 10 12 14 12 10 12 10
    107:18

    16 14 14 14 12 12 14 12 12
    108:9

    14 16 12 14 12 14 12 14 10 12 10 12 12 14 10 12 10 12
    109:18

    16 14 14 14 12 14 12 12 12 10 14 12 12 12 10
    110:15

    14 16 14 12 14 12 14 12 12 14 12 10 12 10 12 10 12 14 12 10 12 10 12 10
    111:24

    16 14 14 14 12
    112:5

    14 16 12 14 12 14 12 14 10 12
    113:10

    16 14 14 12 14 12 14 12 12 10
    114:10

    14 16 14 12 14 12 12 14 12 12 14 12 10 12 10
    115:15

    16 14 14 12 14 12 14 12 12 10
    116:10

    14 16 12 14 12 14 10 12 12 14 10 12 12 14 10 12 10 12 8 10
    117:20

    16 14 14 14 12 12 14 12 12 14 12 12 12 10 10
    118:15

    14 16 14 12 14 12 14 12 10 12 12 14 12 10 12 12 14 12 10 12 10 12 10 8 10
    119:25

    16 14 14 14 12 14 12 12
    120:8

    14 16 12 14 12 14 12 14 10 12 12 14 10 12 10 12
    121:16

    16 14 14 12 14 12 14 12 12 10 14 12 12 10 12 10
    122:16

    14 16 14 12 14 12 12 14 12 12 14 12 10 12 10 12 14 12 10 12 10 10 12 10
    123:24

    16 14 14 14 12 14 12 12 14 12 12 12 10
    124:13

    14 16 12 14 12 14 12 14 10 12 12 14 10 12 10 12 12 14 10 12 10 12 10 12 8 10
    125:26

    16 14 14 14 12 14 12 12 14 12 12 12 10 14 12 12 12 10 12 10 10
    126:21

    14 16 14 12 14 12 14 12 12 14 12 10 12 12 14 12 10 12 10 12 10 12 14 12 10 12 10 12 10 10 12 10 8 10
    127:34

    16 16
    128:3

    14 14 16 16
    129:6

    16 16 14 14
    130:6

    14 14 16 16 14 14
    131:9

    16 16 14 14
    132:6

    14 14 16 16 12 12 14 14
    133:12

    16 16 14 14 14 14
    134:9

    14 14 16 16 14 14 12 12 14 14
    135:15

    16 16 14 14
    136:6

    14 14 16 16 12 12 14 14
    137:12

    16 16 14 14 14 14 12 12
    138:12

    14 14 16 16 14 14 12 12 14 14 12 12
    139:18

    16 16 14 14 14 14
    140:9

    14 14 16 16 12 12 14 14 12 12 14 14
    141:18

    16 16 14 14 14 14 14 14 12 12
    142:15

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12
    143:24

    16 16 14 14
    144:6

    14 14 16 16 12 12 14 14
    145:12

    16 16 14 14 14 14 12 12
    146:12

    14 14 16 16 14 14 12 12 14 14 12 12
    147:18

    16 16 14 14 14 14 12 12
    148:12

    14 14 16 16 12 12 14 14 12 12 14 14 10 10 12 12
    149:24

    16 16 14 14 14 14 14 14 12 12 12 12
    150:18

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 10 10 12 12
    151:30

    16 16 14 14 14 14
    152:9

    14 14 16 16 12 12 14 14 12 12 14 14
    153:18

    16 16 14 14 14 14 12 12 14 14 12 12
    154:18

    14 14 16 16 14 14 12 12 14 14 12 12 12 12 14 14 12 12
    155:27

    16 16 14 14 14 14 14 14 12 12
    156:15

    14 14 16 16 12 12 14 14 12 12 14 14 12 12 14 14 10 10 12 12
    157:30

    16 16 14 14 14 14 14 14 12 12 14 14 12 12 12 12
    158:24

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 12 12 14 14 12 12 10 10 12 12
    159:39

    16 16 14 14
    160:6

    14 14 16 16 12 12 14 14
    161:12

    16 16 14 14 14 14 12 12
    162:12

    14 14 16 16 14 14 12 12 14 14 12 12
    163:18

    16 16 14 14 14 14 12 12
    164:12

    14 14 16 16 12 12 14 14 12 12 14 14 10 10 12 12
    165:24

    16 16 14 14 14 14 14 14 12 12 12 12
    166:18

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 10 10 12 12
    167:30

    16 16 14 14 14 14 12 12
    168:12

    14 14 16 16 12 12 14 14 12 12 14 14 10 10 12 12
    169:24

    16 16 14 14 14 14 12 12 14 14 12 12 12 12 10 10
    170:24

    14 14 16 16 14 14 12 12 14 14 12 12 12 12 14 14 12 12 10 10 12 12 10 10
    171:36

    16 16 14 14 14 14 14 14 12 12 12 12
    172:18

    14 14 16 16 12 12 14 14 12 12 14 14 12 12 14 14 10 10 12 12 10 10 12 12
    173:36

    16 16 14 14 14 14 14 14 12 12 14 14 12 12 12 12 12 12 10 10
    174:30

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 12 12 14 14 12 12 10 10 12 12 10 10 12 12 10 10
    175:48

    16 16 14 14 14 14
    176:9

    14 14 16 16 12 12 14 14 12 12 14 14
    177:18

    16 16 14 14 14 14 12 12 14 14 12 12
    178:18

    14 14 16 16 14 14 12 12 14 14 12 12 12 12 14 14 12 12
    179:27

    16 16 14 14 14 14 12 12 14 14 12 12
    180:18

    14 14 16 16 12 12 14 14 12 12 14 14 10 10 12 12 12 12 14 14 10 10 12 12
    181:36

    16 16 14 14 14 14 14 14 12 12 12 12 14 14 12 12 12 12
    182:27

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 10 10 12 12 12 12 14 14 12 12 10 10 12 12
    183:45

    16 16 14 14 14 14 14 14 12 12
    184:15

    14 14 16 16 12 12 14 14 12 12 14 14 12 12 14 14 10 10 12 12
    185:30

    16 16 14 14 14 14 12 12 14 14 12 12 14 14 12 12 12 12 10 10
    186:30

    14 14 16 16 14 14 12 12 14 14 12 12 12 12 14 14 12 12 12 12 14 14 12 12 10 10 12 12 10 10
    187:45

    16 16 14 14 14 14 14 14 12 12 14 14 12 12 12 12
    188:24

    14 14 16 16 12 12 14 14 12 12 14 14 12 12 14 14 10 10 12 12 12 12 14 14 10 10 12 12 10 10 12 12
    189:48

    16 16 14 14 14 14 14 14 12 12 14 14 12 12 12 12 14 14 12 12 12 12 12 12 10 10
    190:39

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 12 12 14 14 12 12 10 10 12 12 12 12 14 14 12 12 10 10 12 12 10 10 12 12 10 10
    191:63

    16 16 14
    192:4

    14 14 16 16 12 14
    193:8

    16 16 14 14 14 12
    194:8

    14 14 16 16 14 14 12 14 12
    195:12

    16 16 14 14 14 12
    196:8

    14 14 16 16 12 12 14 14 12 14 10 12
    197:16

    16 16 14 14 14 14 14 12 12
    198:12

    14 14 16 16 14 14 12 12 14 14 12 14 12 10 12
    199:20

    16 16 14 14 14 12
    200:8

    14 14 16 16 12 12 14 14 12 14 10 12
    201:16

    16 16 14 14 14 14 12 12 14 12 12 10
    202:16

    14 14 16 16 14 14 12 12 14 14 12 12 12 14 12 10 12 10
    203:24

    16 16 14 14 14 14 14 12 12
    204:12

    14 14 16 16 12 12 14 14 12 12 14 14 12 14 10 12 10 12
    205:24

    16 16 14 14 14 14 14 14 12 12 14 12 12 12 10
    206:20

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 12 14 12 10 12 10 12 10
    207:32

    16 16 14 14 14 12
    208:8

    14 14 16 16 12 12 14 14 12 14 10 12
    209:16

    16 16 14 14 14 14 12 12 14 12 12 10
    210:16

    14 14 16 16 14 14 12 12 14 14 12 12 12 14 12 10 12 10
    211:24

    16 16 14 14 14 14 12 12 14 12 12 10
    212:16

    14 14 16 16 12 12 14 14 12 12 14 14 10 10 12 12 12 14 10 12 10 12 8 10
    213:32

    16 16 14 14 14 14 14 14 12 12 12 12 14 12 12 12 10 10
    214:24

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 10 10 12 12 12 14 12 10 12 10 12 10 8 10
    215:40

    16 16 14 14 14 14 14 12 12
    216:12

    14 14 16 16 12 12 14 14 12 12 14 14 12 14 10 12 10 12
    217:24

    16 16 14 14 14 14 12 12 14 14 12 12 14 12 12 10 12 10
    218:24

    14 14 16 16 14 14 12 12 14 14 12 12 12 12 14 14 12 12 12 14 12 10 12 10 10 12 10
    219:36

    16 16 14 14 14 14 14 14 12 12 14 12 12 12 10
    220:20

    14 14 16 16 12 12 14 14 12 12 14 14 12 12 14 14 10 10 12 12 12 14 10 12 10 12 10 12 8 10
    221:40

    16 16 14 14 14 14 14 14 12 12 14 14 12 12 12 12 14 12 12 12 10 12 10 10
    222:32

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 12 12 14 14 12 12 10 10 12 12 12 14 12 10 12 10 12 10 10 12 10 8 10
    223:52

    16 16 14 14 14
    224:7

    14 14 16 16 12 12 14 14 12 14
    225:14

    16 16 14 14 14 14 12 12 14 12
    226:14

    14 14 16 16 14 14 12 12 14 14 12 12 12 14 12
    227:21

    16 16 14 14 14 14 12 12 14 12
    228:14

    14 14 16 16 12 12 14 14 12 12 14 14 10 10 12 12 12 14 10 12
    229:28

    16 16 14 14 14 14 14 14 12 12 12 12 14 12 12
    230:21

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 10 10 12 12 12 14 12 10 12
    231:35

    16 16 14 14 14 14 12 12 14 12
    232:14

    14 14 16 16 12 12 14 14 12 12 14 14 10 10 12 12 12 14 10 12
    233:28

    16 16 14 14 14 14 12 12 14 14 12 12 12 12 10 10 14 12 12 10
    234:28

    14 14 16 16 14 14 12 12 14 14 12 12 12 12 14 14 12 12 10 10 12 12 10 10 12 14 12 10 12 10
    235:42

    16 16 14 14 14 14 14 14 12 12 12 12 14 12 12
    236:21

    14 14 16 16 12 12 14 14 12 12 14 14 12 12 14 14 10 10 12 12 10 10 12 12 12 14 10 12 10 12
    237:42

    16 16 14 14 14 14 14 14 12 12 14 14 12 12 12 12 12 12 10 10 14 12 12 12 10
    238:35

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 12 12 14 14 12 12 10 10 12 12 10 10 12 12 10 10 12 14 12 10 12 10 12 10
    239:56

    16 16 14 14 14 14 14 12
    240:11

    14 14 16 16 12 12 14 14 12 12 14 14 12 14 10 12
    241:22

    16 16 14 14 14 14 12 12 14 14 12 12 14 12 12 10
    242:22

    14 14 16 16 14 14 12 12 14 14 12 12 12 12 14 14 12 12 12 14 12 10 12 10
    243:33

    16 16 14 14 14 14 12 12 14 14 12 12 14 12 12 10
    244:22

    14 14 16 16 12 12 14 14 12 12 14 14 10 10 12 12 12 12 14 14 10 10 12 12 12 14 10 12 10 12 8 10
    245:44

    16 16 14 14 14 14 14 14 12 12 12 12 14 14 12 12 12 12 14 12 12 12 10 10
    246:33

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 10 10 12 12 12 12 14 14 12 12 10 10 12 12 12 14 12 10 12 10 12 10 8 10
    247:55

    16 16 14 14 14 14 14 14 12 12 14 12 12
    248:18

    14 14 16 16 12 12 14 14 12 12 14 14 12 12 14 14 10 10 12 12 12 14 10 12 10 12
    249:36

    16 16 14 14 14 14 12 12 14 14 12 12 14 14 12 12 12 12 10 10 14 12 12 10 12 10
    250:36

    14 14 16 16 14 14 12 12 14 14 12 12 12 12 14 14 12 12 12 12 14 14 12 12 10 10 12 12 10 10 12 14 12 10 12 10 10 12 10
    251:54

    16 16 14 14 14 14 14 14 12 12 14 14 12 12 12 12 14 12 12 12 10
    252:29

    14 14 16 16 12 12 14 14 12 12 14 14 12 12 14 14 10 10 12 12 12 12 14 14 10 10 12 12 10 10 12 12 12 14 10 12 10 12 10 12 8 10
    253:58

    16 16 14 14 14 14 14 14 12 12 14 14 12 12 12 12 14 14 12 12 12 12 12 12 10 10 14 12 12 12 10 12 10 10
    254:47

    14 14 16 16 14 14 12 12 14 14 12 12 14 14 12 12 12 12 14 14 12 12 10 10 12 12 12 12 14 14 12 12 10 10 12 12 10 10 12 12 10 10 12 14 12 10 12 10 12 10 10 12 10 8 10
    255:76

    Total Satates 4240
    Attached Files Attached Files

  12. #12
    Member
    Join Date
    Feb 2020
    Location
    Sargodha,Pakistan
    Posts
    9
    Thanks
    1
    Thanked 0 Times in 0 Posts
    76^10=1.20603310207599752931664275127e+188 max state for each 10bytes of m8 byte

  13. #13
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    My white hole software:

    source code:

    Attached Files Attached Files
    Last edited by pacalovasjurijus; 9th February 2020 at 13:57.

  14. #14
    Member
    Join Date
    Feb 2020
    Location
    Sargodha,Pakistan
    Posts
    9
    Thanks
    1
    Thanked 0 Times in 0 Posts
    White hole software is in binary can you provide us source code or algorithm.
    Can you tell us how it is working?

  15. #15
    Member
    Join Date
    Sep 2018
    Location
    Philippines
    Posts
    114
    Thanks
    31
    Thanked 2 Times in 2 Posts
    @arshalatti, do you have actual decompressor for your random data compression idea?

    Once you attempt to write a decompressor, it will become clearer to you the limitations of your algorithm.

  16. #16
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    You need to make two files pause and file.txt
    file.txt for name of file that need to compress.
    pause for pause the software you need to add *.
    Algorithm compress 1023 and 16383 variations.
    Attached Thumbnails Attached Thumbnails Click image for larger version. 

Name:	ssss.png 
Views:	42 
Size:	136.8 KB 
ID:	7355  

  17. #17
    Member
    Join Date
    Feb 2020
    Location
    Sargodha,Pakistan
    Posts
    9
    Thanks
    1
    Thanked 0 Times in 0 Posts
    @compgt m8,m64,h40m64 all these projects are research only.we all know clearly that random data is very hard to compress even few bytes.
    My main goal is to compress 405k file at least few bytes.

  18. #18
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    Here is tested a file:
    Attached Files Attached Files

  19. #19
    Member
    Join Date
    Feb 2020
    Location
    Sargodha,Pakistan
    Posts
    9
    Thanks
    1
    Thanked 0 Times in 0 Posts
    what is algorithm of white hole software?
    source code in python White_hole_1.0.0.1.4.py and White_hole_1.0.0.1.4__extract.py.
    i am c/c++ programmer so its hard to understand algorithm.

  20. #20
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    New version of White hole Software:
    Attached Files Attached Files

  21. #21
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    Random file:
    I compressed the random file.
    Before:3,145,728
    After:3,145,726
    Please, pay me 103 Euro
    My webmoney: E388412813675

    Attached Files Attached Files

  22. Thanks (2):

    arshalatti (11th February 2020),ne0n (10th February 2020)

  23. #22
    Member
    Join Date
    Feb 2020
    Location
    Sargodha,Pakistan
    Posts
    9
    Thanks
    1
    Thanked 0 Times in 0 Posts
    Hope

  24. #23
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    Software: White_hole_1.0.0.1.6
    Before:
    2019-07-01.bin (little bit different but Random)
    1048576 Bytes
    After:
    2019-07-01.bin.b
    1048396 Bytes
    Time
    6 minutes
    Last edited by pacalovasjurijus; 15th February 2020 at 20:27.

  25. #24
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    New version of comression:
    Test:
    Before:
    3,145,728 Bytes 1(4)) (Random)
    After:
    3,145,724 Bytes 1(4)).b
    Attached Files Attached Files

  26. #25
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    The Random file:
    Attached Files Attached Files

  27. #26
    Member
    Join Date
    Sep 2007
    Location
    Denmark
    Posts
    920
    Thanks
    57
    Thanked 113 Times in 90 Posts
    Quote Originally Posted by pacalovasjurijus View Post
    Random file:
    I compressed the random file.
    Before:3,145,728
    After:3,145,726
    Please, pay me 103 Euro
    My webmoney: E388412813675


    I see no method to get back to the original file so your "compresse" file is lacking data/information.

    I can compress anything to one bit if there is no need to decompress it
    Is it you data?
    1= yes
    0=no

  28. #27
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    Quote Originally Posted by SvenBent View Post
    I see no method to get back to the original file so your "compresse" file is lacking data/information.

    I can compress anything to one bit if there is no need to decompress it
    Is it you data?
    1= yes
    0=no

    https://pinetools.com/random-file-generator
    c2
    u2
    3,145,728
    3,145,726.b2




    c
    u
    3,145,728
    3,145,724.b
    Attached Files Attached Files
    Last edited by pacalovasjurijus; 21st February 2020 at 18:50.

  29. #28
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    please, compress 3MB any file by zip and send to me.

    2,689,630 s.zip
    2,689,629 s.zip.b

  30. #29
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    I working on version 1.0.0.1.8​
    I can compress this file:
    Attached Files Attached Files

  31. #30
    Member
    Join Date
    Aug 2019
    Location
    Finglas
    Posts
    78
    Thanks
    2
    Thanked 2 Times in 1 Post
    In version 1.0.0.1.7:
    In White hole software I used algorithm paq for c1 and u1, c and u I use algorithm and c2 and u3 I use my algorithm Calculus.
    Now, I am working in version 1.0.0.1.8.
    I use in the version my new algorithm for:
    c3 and u3 algorithm sorting information of 1 and 0 like yes and no.

Page 1 of 2 12 LastLast

Similar Threads

  1. World's slowest image compressor
    By SolidComp in forum Data Compression
    Replies: 5
    Last Post: 19th July 2016, 01:36
  2. BIM (a new lossless image compressor) is here!
    By encode in forum Data Compression
    Replies: 43
    Last Post: 17th September 2013, 15:00
  3. New lossless image compressor
    By encode in forum Data Compression
    Replies: 105
    Last Post: 10th January 2013, 09:36
  4. GraLIC - new lossless image compressor
    By Alexander Rhatushnyak in forum Data Compression
    Replies: 17
    Last Post: 29th November 2010, 20:27
  5. Which compressor for general use
    By Fairy in forum Data Compression
    Replies: 14
    Last Post: 9th August 2009, 18:19

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •