Can you Help me

[swordsman]

hi,all .my teacher asked me to compress weather radar raw data(CR=10 or above), it is so challenge, anyone who can help me or give me some proposal
loss SNR <1.5dB
thanks

[Skymmer]

Interesting. Not sure if thats what you need but anyway. Obviously the files you provided are 1 channel \ 16 bit sounds, stored as ASCII data. I opened them in Audition with 1ch\16bit\44100 interpretation and then saved in WAV (PCM) format. Then converted to OGG with libVorbis 20090301 [aoTuVb5.7]. More exactly:
ZnBA_chanel3 - with q 5,6 - 60 543 bytes.
ZnBB_chanel3 - with q 6,7 - 63 644 bytes.

Well, compression ratio is exactly 10. Not sure how you can measure SNR losses here. I've attached resulted files.

[swordsman]

firstly thanks to your kindly help, but i am not sure what the Algorithm you have used is? lossless or lossy ?Would you mind if you can give me some Specific materials for further reference. (software ,web thesis ,any other things).Any help from you will give me great help! Thank you so much.Good luck!

Interesting. Not sure if thats what you need but anyway. Obviously the files you provided are 1 channel \ 16 bit sounds, stored as ASCII data. I opened them in Audition with 1ch\16bit\44100 interpretation and then saved in WAV (PCM) format. Then converted to OGG with libVorbis 20090301 [aoTuVb5.7]. More exactly:
ZnBA_chanel3 - with q 5,6 - 60 543 bytes.
ZnBB_chanel3 - with q 6,7 - 63 644 bytes.

Well, compression ratio is exactly 10. Not sure how you can measure SNR losses here. I've attached resulted files.

[encode]

I guess Skymmer posted all the details.

It is possible to open your files via Adobe Audition (Cool Edit Pro) sound editor as an ASCII audio file (Mono, 16-bit, 44100 Hz).
After that, you may save a file as WAV or as RAW/PCM - producing regular/binary instead of ASCII audio.
That files you may compress using well known audio compression software like FLAC, OGG, etc.

[Skymmer]

Well, yes. But here some more...
Yes, its a lossy scheme. First, you need some converter\editor to convert your .dat files to .wav. I used Adobe Audition. Just rename .dat to .txt and open as ASCII Text Data type. Adobe Audition is not freeware but you can get a trial at http://www.adobe.com/products/audition/. You can also try Audacity and SoX. But I don't know if they are capable to deal with such data. Also don't know about Sound Forge. I don't like its editing principles and workspace area.
After conversion you can pack your .wav files with OGG Vorbis. I can recommend aoTuVb5.7 version, since it have an improved psychoacoustic model. You can grab it at RareWares.
As for lossless... Such compression ratios almost impossible with lossless compression. More exactly speaking its possible but in very very rare cases. And your example is not a case Try
LA 0.4b -high -noseek
or
OptimFROG 4.600 --mode ultranew --optimize best --experimental --uselessoptimization

Let me know with your progress.

[swordsman]

ok,thanks ,i will try it.BY the way ,i have searched the internet ,but i am not sure what the audio compression algorithm adobe have used ,would you mind if you can tell me how can i get some reference to refer because i have to do some research and write a thesis, thank you

Well, yes. But here some more...
Yes, its a lossy scheme. First, you need some converter\editor to convert your .dat files to .wav. I used Adobe Audition. Just rename .dat to .txt and open as ASCII Text Data type. Adobe Audition is not freeware but you can get a trial at http://www.adobe.com/products/audition/. You can also try Audacity and SoX. But I don't know if they are capable to deal with such data. Also don't know about Sound Forge. I don't like its editing principles and workspace area.
After conversion you can pack your .wav files with OGG Vorbis. I can recommend aoTuVb5.7 version, since it have an improved psychoacoustic model. You can grab it at RareWares.
As for lossless... Such compression ratios almost impossible with lossless compression. More exactly speaking its possible but in very very rare cases. And your example is not a case Try
LA 0.4b -high -noseek
or
OptimFROG 4.600 --mode ultranew --optimize best --experimental --uselessoptimization

Let me know with your progress.

[Skymmer]

Да нуу тебя в трынду. Можит за тибя дипломм написать еще ? Все написано, дальше тести сам.

* - ошибки специально.

[Black_Fox]

[swordsman]

Nooooo,just a student from china,Jiangsu ,nanjing ,need your help

Да нуу тебя в трынду. Можит за тибя дипломм написать еще ? Все написано, дальше тести сам.

* - ошибки специально.

[Skymmer]

You can also use another approach. Instead of psychoacoustic, you can use pure mathematical principle. Pass the resulting file through LossyWAV and then pack with some Lossless compressor, which supports controlling the block size. Details are here:
http://wiki.hydrogenaudio.org/index.php?title=Lossywav
You can also try lossy modes of WavPack, Shorten, OptimFROG.

[Matt Mahoney]

Quick test, where zn is the concatenation of the 2 files like this:

copy/b ZnBA_chanel3.dat+ZnBB_chanel3.dat zn

  392,207 zn.paq8px
  392,544 zn.paq8l
  397,771 zn.zpaq_c3
  400,616 zn.lpaq9m
  401,315 zn.paq6
  401,780 zn.paq9a
  401,955 zn.nz_cc
  403,367 zn.lpaq1
  405,353 zn.cmm4
  405,388 zn.ctw
  407,032 zn.bbb
  407,950 zn.zpaq_c2
  413,775 zn.bwt.fpaq0f2
  414,982 zn.nz
  416,036 zn.grzip
  416,103 zn.pmm
  417,456 zn.lzpxj
  417,570 zn.zpaq_c1
  418,183 zn.pmd
  419,706 zn.bwt.fpaq0p
  422,496 zn.paq1
  427,707 zn.pms
  429,603 zn.tarsalzp
  433,005 ZN.ACB
  439,627 zn.bz2
  445,242 zn.dmc
  445,728 zn.p6
  447,239 zn.szip
  455,315 zn.fpaq0f2
  464,688 zn.fcm1
  471,850 zn.7z
  473,305 zn.cab
  485,303 zn.sr2
  497,312 ZN.Z
  506,842 ZN.HA
  509,799 zn.gz
  510,017 zn.zip
  511,002 ZN.RAR
  526,713 zn.fpaq0
  543,833 zn.fpaq0p
  596,949 zn.bpe
  625,883 zn.lzo
  633,508 zn.lzrw5
  671,515 zn.lzrw3-a
  687,561 zn.sr
  752,932 zn.fastlz
  783,677 zn.lzrw2
  826,697 zn.lzrw1-a
1,036,622 zn.ppp
1,144,059 zn.flzp
1,244,118 zn

I think you will need lossy compression. Divide the values by a constant with rounding. Then I suggest encoding as binary numbers (2 bytes), then compress with some of the top compressors like paq8px, paq8l., or zp c3. You can also try delta coding or adaptive filtering.

[swordsman]

thank you for your kindly help ,i will try it

Quick test, where zn is the concatenation of the 2 files like this:

copy/b ZnBA_chanel3.dat+ZnBB_chanel3.dat zn

  392,207 zn.paq8px
  392,544 zn.paq8l
  397,771 zn.zpaq_c3
  400,616 zn.lpaq9m
  401,315 zn.paq6
  401,780 zn.paq9a
  401,955 zn.nz_cc
  403,367 zn.lpaq1
  405,353 zn.cmm4
  405,388 zn.ctw
  407,032 zn.bbb
  407,950 zn.zpaq_c2
  413,775 zn.bwt.fpaq0f2
  414,982 zn.nz
  416,036 zn.grzip
  416,103 zn.pmm
  417,456 zn.lzpxj
  417,570 zn.zpaq_c1
  418,183 zn.pmd
  419,706 zn.bwt.fpaq0p
  422,496 zn.paq1
  427,707 zn.pms
  429,603 zn.tarsalzp
  433,005 ZN.ACB
  439,627 zn.bz2
  445,242 zn.dmc
  445,728 zn.p6
  447,239 zn.szip
  455,315 zn.fpaq0f2
  464,688 zn.fcm1
  471,850 zn.7z
  473,305 zn.cab
  485,303 zn.sr2
  497,312 ZN.Z
  506,842 ZN.HA
  509,799 zn.gz
  510,017 zn.zip
  511,002 ZN.RAR
  526,713 zn.fpaq0
  543,833 zn.fpaq0p
  596,949 zn.bpe
  625,883 zn.lzo
  633,508 zn.lzrw5
  671,515 zn.lzrw3-a
  687,561 zn.sr
  752,932 zn.fastlz
  783,677 zn.lzrw2
  826,697 zn.lzrw1-a
1,036,622 zn.ppp
1,144,059 zn.flzp
1,244,118 zn

I think you will need lossy compression. Divide the values by a constant with rounding. Then I suggest encoding as binary numbers (2 bytes), then compress with some of the top compressors like paq8px, paq8l., or zp c3. You can also try delta coding or adaptive filtering.

[est]

from NJU?

[swordsman]

from nupt