Results 1 to 3 of 3

Thread: NEW FULL BWTS COMPRESSOR

  1. #1
    Member biject.bwts's Avatar
    Join Date
    Jun 2008
    Location
    texas
    Posts
    449
    Thanks
    23
    Thanked 14 Times in 10 Posts

    NEW FULL BWTS COMPRESSOR

    I decide today to bite the bullet and write a full 256 BWTS compressor
    It still is in testing. But Basically I did a BWTS followed by MTFQ followed by RLEQ which is all old stuff then wrote a special mode of ARB255 called it ARB25X did some tweaking till it beat a page I found on Calgary 18 file test of M99 and RLE+M99

    http://www.geocities.com/m99datacomp...n/calgary.html

    It could be tweaked more. And the executables may not run on
    most machine but its a start I tweaked it till I got 874,034 where
    as the one I am comparting against gets 874,040 I am sure it
    could be tweaked more. It actually for short files.

    http://bijective.dogma.net/bwttmp.zip

    contains a test set up with just the executables
    except has the source code for arb25x and shows
    the logs for Clagary and Bananas files.

    Any comments welcomed. Its only mentioned at this site for now!!
    David A. Scott

  2. #2
    Member
    Join Date
    May 2008
    Location
    Antwerp , country:Belgium , W.Europe
    Posts
    487
    Thanks
    1
    Thanked 3 Times in 3 Posts
    Quote Originally Posted by biject.bwts View Post
    It could be tweaked more. And the executables may not run on
    most machine but its a start I tweaked it till I got 874,034 where
    as the one I am comparting against gets 874,040 I am sure it
    could be tweaked more. It actually for short files.

    http://bijective.dogma.net/bwttmp.zip

    contains a test set up with just the executables
    except has the source code for arb25x and shows
    the logs for Clagary and Bananas files.
    Nice exe's !! BWTS.EXE is almost 80MB !
    Why are the exe's so "fat" ?
    I tried to run it on my Vista box, but got error about "no DPMI in memory"..
    Any chance to compile Win32 exe 's ?

  3. #3
    Member biject.bwts's Avatar
    Join Date
    Jun 2008
    Location
    texas
    Posts
    449
    Thanks
    23
    Thanked 14 Times in 10 Posts
    Quote Originally Posted by pat357 View Post
    Nice exe's !! BWTS.EXE is almost 80MB !
    Why are the exe's so "fat" ?
    I tried to run it on my Vista box, but got error about "no DPMI in memory"..
    Any chance to compile Win32 exe 's ?
    Well every thing was compiled with DJGPP GNU C++ its runs on my machine however. The problem is allocating memory while running sometimes I get it some times I don't so I have been declaring large arrays in the headers. But I have another compiler the MinGW I am planning hopefully in the near future to use that compiler and change the memory options. Actually Yata Mori has a bwts in his OPENBWT code so that is another option.
    The RLEQ uses the first 3 sybmols in file. Its big since I try to load the whole file in memory and seach for 3 first symbols. I am going to change that option so that when I read the fist symbol I call it ZA then form ZB = ZA xor 1 and form ZC = ZA xor 2 this way I get the 3 control symbols right away. This Run Length Encoder shares the use of the 256 characters in a byte. Its not the neatest way but the way I did it. In the current version I used the first 3 seen in the new low memory version I will define the 3 symbols from first one in file. This also meand I have to change ARB25X to match this change in RLEQ and UNRLEQ. But when that done the only thing left is the large size of BWTS and like I said there are other options and I am working on them. I just want to show people that BWTS can make a compressor that as good or better than some of the good BWT based compressors.

    The source code for bwts is
    http://bijective.dogma.net/bwts.zip
    The source code for rleq stuff
    http://bijective.dogma.net/mtfrleq.zip

    the openbwt library source is
    http://www.geocities.com/zxcb33/openbwt-v1.3.zip


    Take Care
    Dave

Similar Threads

  1. USING BWTS in BWTmix
    By biject.bwts in forum Data Compression
    Replies: 8
    Last Post: 9th March 2010, 02:00
  2. strange behavior with precomp and full path name
    By SvenBent in forum Data Compression
    Replies: 9
    Last Post: 6th September 2009, 18:45
  3. BWTS STATUS OF PAPER
    By biject.bwts in forum Data Compression
    Replies: 20
    Last Post: 4th September 2009, 21:10
  4. BWTS explanation?
    By TopQuark in forum Data Compression
    Replies: 5
    Last Post: 8th April 2009, 22:26
  5. Replies: 3
    Last Post: 8th July 2008, 15:55

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •