Results 1 to 6 of 6

Thread: Corsica : Microsoft's compression and encryption asic

  1. #1
    Member
    Join Date
    Dec 2017
    Location
    china
    Posts
    10
    Thanks
    0
    Thanked 1 Time in 1 Post

    Corsica : Microsoft's compression and encryption asic


  2. Thanks:

    comp1 (28th August 2019)

  3. #2
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    918
    Thanks
    254
    Thanked 327 Times in 200 Posts
    Outside of video no compression accelerator 'made it' yet. The flexibility that comes with a software approach tends to give a 5–10% density advantage which has been too much for HW to catch up by bruteforcing. Randen and HighwayHash show that the advantage in encryption may also be equally difficult to realize.

  4. #3
    Member SolidComp's Avatar
    Join Date
    Jun 2015
    Location
    USA
    Posts
    353
    Thanks
    131
    Thanked 54 Times in 38 Posts
    Quote Originally Posted by Jyrki Alakuijala View Post
    Outside of video no compression accelerator 'made it' yet. The flexibility that comes with a software approach tends to give a 5–10% density advantage which has been too much for HW to catch up by bruteforcing. Randen and HighwayHash show that the advantage in encryption may also be equally difficult to realize.
    Jyrki what do you mean? Corsica and Zipline "made it". Microsoft and Broadcom designed the ASIC, and Microsoft deployed them at scale at Azure. That's what the article is about.

    The ratios are extremely impressive at 4 to 8 percent. I wonder what the Zipline algorithm is specifically.

  5. #4
    Member
    Join Date
    Sep 2008
    Location
    France
    Posts
    890
    Thanks
    486
    Thanked 279 Times in 119 Posts
    Quote Originally Posted by SolidComp View Post
    I wonder what the Zipline algorithm is specifically.

    https://github.com/opencomputeproject/Project-Zipline

    See also : https://encode.su/threads/3083-Micro...roject-Zipline

  6. #5
    Member
    Join Date
    Dec 2017
    Location
    china
    Posts
    10
    Thanks
    0
    Thanked 1 Time in 1 Post
    Their LZ comressor supports maximum 64KB window size. The search engine is directly byte matching. It should provide a lot benefits comparing to hash chain based searching in software.
    Four compression engine with 4BYTE per cycle at 800Mhz frequency, so total 100Gb throughput. Not a very impression data for a specified accelerator.

  7. #6
    Member
    Join Date
    Jun 2015
    Location
    Switzerland
    Posts
    918
    Thanks
    254
    Thanked 327 Times in 200 Posts
    Quote Originally Posted by SolidComp View Post
    Jyrki what do you mean? Corsica and Zipline "made it".
    When the developer itself claims to have deployed a new technology, it is not yet a notable sign of superiority of that technique. In my book it counts as a storytelling effort, a marketing deployment or a feasibility study.

Similar Threads

  1. Replies: 33
    Last Post: 25th June 2019, 13:15
  2. Can anyone identify this compression/encryption tool?
    By Mexxi in forum The Off-Topic Lounge
    Replies: 2
    Last Post: 9th August 2014, 17:52
  3. Replies: 3
    Last Post: 19th April 2013, 17:33
  4. A Microsoft study on deduplication
    By m^2 in forum Data Compression
    Replies: 1
    Last Post: 5th May 2011, 19:15
  5. Idea: Combine Compression & Encryption
    By dirks in forum Data Compression
    Replies: 16
    Last Post: 22nd February 2010, 11:49

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •