Results 1 to 14 of 14

Thread: Can you Help me

  1. #1
    Member
    Join Date
    May 2010
    Location
    China
    Posts
    6
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Can you Help me

    hi,all .my teacher asked me to compress weather radar raw data(CR=10 or above), it is so challenge, anyone who can help me or give me some proposal
    loss SNR <1.5dB
    thanks
    Attached Files Attached Files
    Last edited by swordsman; 13th May 2010 at 12:31.

  2. #2
    Member Skymmer's Avatar
    Join Date
    Mar 2009
    Location
    Russia
    Posts
    681
    Thanks
    38
    Thanked 168 Times in 84 Posts
    Interesting. Not sure if thats what you need but anyway. Obviously the files you provided are 1 channel \ 16 bit sounds, stored as ASCII data. I opened them in Audition with 1ch\16bit\44100 interpretation and then saved in WAV (PCM) format. Then converted to OGG with libVorbis 20090301 [aoTuVb5.7]. More exactly:
    ZnBA_chanel3 - with q 5,6 - 60 543 bytes.
    ZnBB_chanel3 - with q 6,7 - 63 644 bytes.

    Well, compression ratio is exactly 10. Not sure how you can measure SNR losses here. I've attached resulted files.
    Attached Files Attached Files

  3. #3
    Member
    Join Date
    May 2010
    Location
    China
    Posts
    6
    Thanks
    0
    Thanked 0 Times in 0 Posts
    firstly thanks to your kindly help, but i am not sure what the Algorithm you have used is? lossless or lossy ?Would you mind if you can give me some Specific materials for further reference. (software ,web thesis ,any other things).Any help from you will give me great help! Thank you so much.Good luck!

    Quote Originally Posted by Skymmer View Post
    Interesting. Not sure if thats what you need but anyway. Obviously the files you provided are 1 channel \ 16 bit sounds, stored as ASCII data. I opened them in Audition with 1ch\16bit\44100 interpretation and then saved in WAV (PCM) format. Then converted to OGG with libVorbis 20090301 [aoTuVb5.7]. More exactly:
    ZnBA_chanel3 - with q 5,6 - 60 543 bytes.
    ZnBB_chanel3 - with q 6,7 - 63 644 bytes.

    Well, compression ratio is exactly 10. Not sure how you can measure SNR losses here. I've attached resulted files.

  4. #4
    The Founder encode's Avatar
    Join Date
    May 2006
    Location
    Moscow, Russia
    Posts
    3,982
    Thanks
    377
    Thanked 351 Times in 139 Posts
    I guess Skymmer posted all the details.

    It is possible to open your files via Adobe Audition (Cool Edit Pro) sound editor as an ASCII audio file (Mono, 16-bit, 44100 Hz).
    After that, you may save a file as WAV or as RAW/PCM - producing regular/binary instead of ASCII audio.
    That files you may compress using well known audio compression software like FLAC, OGG, etc.

  5. #5
    Member Skymmer's Avatar
    Join Date
    Mar 2009
    Location
    Russia
    Posts
    681
    Thanks
    38
    Thanked 168 Times in 84 Posts
    Well, yes. But here some more...
    Yes, its a lossy scheme. First, you need some converter\editor to convert your .dat files to .wav. I used Adobe Audition. Just rename .dat to .txt and open as ASCII Text Data type. Adobe Audition is not freeware but you can get a trial at http://www.adobe.com/products/audition/. You can also try Audacity and SoX. But I don't know if they are capable to deal with such data. Also don't know about Sound Forge. I don't like its editing principles and workspace area.
    After conversion you can pack your .wav files with OGG Vorbis. I can recommend aoTuVb5.7 version, since it have an improved psychoacoustic model. You can grab it at RareWares.
    As for lossless... Such compression ratios almost impossible with lossless compression. More exactly speaking its possible but in very very rare cases. And your example is not a case Try
    LA 0.4b -high -noseek
    or
    OptimFROG 4.600 --mode ultranew --optimize best --experimental --uselessoptimization

    Let me know with your progress.
    Last edited by Skymmer; 14th May 2010 at 17:19.

  6. #6
    Member
    Join Date
    May 2010
    Location
    China
    Posts
    6
    Thanks
    0
    Thanked 0 Times in 0 Posts
    ok,thanks ,i will try it.BY the way ,i have searched the internet ,but i am not sure what the audio compression algorithm adobe have used ,would you mind if you can tell me how can i get some reference to refer because i have to do some research and write a thesis, thank you
    Quote Originally Posted by Skymmer View Post
    Well, yes. But here some more...
    Yes, its a lossy scheme. First, you need some converter\editor to convert your .dat files to .wav. I used Adobe Audition. Just rename .dat to .txt and open as ASCII Text Data type. Adobe Audition is not freeware but you can get a trial at http://www.adobe.com/products/audition/. You can also try Audacity and SoX. But I don't know if they are capable to deal with such data. Also don't know about Sound Forge. I don't like its editing principles and workspace area.
    After conversion you can pack your .wav files with OGG Vorbis. I can recommend aoTuVb5.7 version, since it have an improved psychoacoustic model. You can grab it at RareWares.
    As for lossless... Such compression ratios almost impossible with lossless compression. More exactly speaking its possible but in very very rare cases. And your example is not a case Try
    LA 0.4b -high -noseek
    or
    OptimFROG 4.600 --mode ultranew --optimize best --experimental --uselessoptimization

    Let me know with your progress.
    Last edited by swordsman; 15th May 2010 at 07:31.

  7. #7
    Member Skymmer's Avatar
    Join Date
    Mar 2009
    Location
    Russia
    Posts
    681
    Thanks
    38
    Thanked 168 Times in 84 Posts
    Да нуу тебя в трынду. Можит за тибя дипломм написать еще ? Все написано, дальше тести сам.

    * - ошибки специально.
    Last edited by Skymmer; 15th May 2010 at 17:03.

  8. #8
    Tester
    Black_Fox's Avatar
    Join Date
    May 2008
    Location
    [CZE] Czechia
    Posts
    471
    Thanks
    26
    Thanked 9 Times in 8 Posts
    I am... Black_Fox... my discontinued benchmark
    "No one involved in computers would ever say that a certain amount of memory is enough for all time? I keep bumping into that silly quotation attributed to me that says 640K of memory is enough. There's never a citation; the quotation just floats like a rumor, repeated again and again." -- Bill Gates

  9. #9
    Member
    Join Date
    May 2010
    Location
    China
    Posts
    6
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Nooooo,just a student from china,Jiangsu ,nanjing ,need your help

    Quote Originally Posted by Skymmer View Post
    Да нуу тебя в трынду. Можит за тибя дипломм написать еще ? Все написано, дальше тести сам.

    * - ошибки специально.

  10. #10
    Member Skymmer's Avatar
    Join Date
    Mar 2009
    Location
    Russia
    Posts
    681
    Thanks
    38
    Thanked 168 Times in 84 Posts
    You can also use another approach. Instead of psychoacoustic, you can use pure mathematical principle. Pass the resulting file through LossyWAV and then pack with some Lossless compressor, which supports controlling the block size. Details are here:
    http://wiki.hydrogenaudio.org/index.php?title=Lossywav
    You can also try lossy modes of WavPack, Shorten, OptimFROG.

  11. #11
    Expert
    Matt Mahoney's Avatar
    Join Date
    May 2008
    Location
    Melbourne, Florida, USA
    Posts
    3,255
    Thanks
    306
    Thanked 779 Times in 486 Posts
    Quick test, where zn is the concatenation of the 2 files like this:

    copy/b ZnBA_chanel3.dat+ZnBB_chanel3.dat zn

    Code:
      392,207 zn.paq8px
      392,544 zn.paq8l
      397,771 zn.zpaq_c3
      400,616 zn.lpaq9m
      401,315 zn.paq6
      401,780 zn.paq9a
      401,955 zn.nz_cc
      403,367 zn.lpaq1
      405,353 zn.cmm4
      405,388 zn.ctw
      407,032 zn.bbb
      407,950 zn.zpaq_c2
      413,775 zn.bwt.fpaq0f2
      414,982 zn.nz
      416,036 zn.grzip
      416,103 zn.pmm
      417,456 zn.lzpxj
      417,570 zn.zpaq_c1
      418,183 zn.pmd
      419,706 zn.bwt.fpaq0p
      422,496 zn.paq1
      427,707 zn.pms
      429,603 zn.tarsalzp
      433,005 ZN.ACB
      439,627 zn.bz2
      445,242 zn.dmc
      445,728 zn.p6
      447,239 zn.szip
      455,315 zn.fpaq0f2
      464,688 zn.fcm1
      471,850 zn.7z
      473,305 zn.cab
      485,303 zn.sr2
      497,312 ZN.Z
      506,842 ZN.HA
      509,799 zn.gz
      510,017 zn.zip
      511,002 ZN.RAR
      526,713 zn.fpaq0
      543,833 zn.fpaq0p
      596,949 zn.bpe
      625,883 zn.lzo
      633,508 zn.lzrw5
      671,515 zn.lzrw3-a
      687,561 zn.sr
      752,932 zn.fastlz
      783,677 zn.lzrw2
      826,697 zn.lzrw1-a
    1,036,622 zn.ppp
    1,144,059 zn.flzp
    1,244,118 zn
    I think you will need lossy compression. Divide the values by a constant with rounding. Then I suggest encoding as binary numbers (2 bytes), then compress with some of the top compressors like paq8px, paq8l., or zp c3. You can also try delta coding or adaptive filtering.

  12. #12
    Member
    Join Date
    May 2010
    Location
    China
    Posts
    6
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Smile

    thank you for your kindly help ,i will try it
    Quote Originally Posted by Matt Mahoney View Post
    Quick test, where zn is the concatenation of the 2 files like this:

    copy/b ZnBA_chanel3.dat+ZnBB_chanel3.dat zn

    Code:
      392,207 zn.paq8px
      392,544 zn.paq8l
      397,771 zn.zpaq_c3
      400,616 zn.lpaq9m
      401,315 zn.paq6
      401,780 zn.paq9a
      401,955 zn.nz_cc
      403,367 zn.lpaq1
      405,353 zn.cmm4
      405,388 zn.ctw
      407,032 zn.bbb
      407,950 zn.zpaq_c2
      413,775 zn.bwt.fpaq0f2
      414,982 zn.nz
      416,036 zn.grzip
      416,103 zn.pmm
      417,456 zn.lzpxj
      417,570 zn.zpaq_c1
      418,183 zn.pmd
      419,706 zn.bwt.fpaq0p
      422,496 zn.paq1
      427,707 zn.pms
      429,603 zn.tarsalzp
      433,005 ZN.ACB
      439,627 zn.bz2
      445,242 zn.dmc
      445,728 zn.p6
      447,239 zn.szip
      455,315 zn.fpaq0f2
      464,688 zn.fcm1
      471,850 zn.7z
      473,305 zn.cab
      485,303 zn.sr2
      497,312 ZN.Z
      506,842 ZN.HA
      509,799 zn.gz
      510,017 zn.zip
      511,002 ZN.RAR
      526,713 zn.fpaq0
      543,833 zn.fpaq0p
      596,949 zn.bpe
      625,883 zn.lzo
      633,508 zn.lzrw5
      671,515 zn.lzrw3-a
      687,561 zn.sr
      752,932 zn.fastlz
      783,677 zn.lzrw2
      826,697 zn.lzrw1-a
    1,036,622 zn.ppp
    1,144,059 zn.flzp
    1,244,118 zn
    I think you will need lossy compression. Divide the values by a constant with rounding. Then I suggest encoding as binary numbers (2 bytes), then compress with some of the top compressors like paq8px, paq8l., or zp c3. You can also try delta coding or adaptive filtering.

  13. #13
    Member
    Join Date
    Jun 2010
    Location
    CN
    Posts
    5
    Thanks
    1
    Thanked 1 Time in 1 Post
    from NJU?

  14. #14
    Member
    Join Date
    May 2010
    Location
    China
    Posts
    6
    Thanks
    0
    Thanked 0 Times in 0 Posts
    from nupt

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •