Results 1 to 3 of 3

Thread: Intel's Teraflops Research Chip and pigz parallel implementation ?

  1. #1
    Member apollo's Avatar
    Join Date
    Apr 2011
    Location
    Apollo Republic
    Posts
    8
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Smile Intel's Teraflops Research Chip and pigz parallel implementation ?

    hello, I'm new here I was wondering what would be the results if parallel implementation of pigz be used on Intel's Teraflops Research Chip which has 80 cores, what would the results be ? speaking in hypothetically ?

    does having large amount of cores speed of compression decompression ? I'm leaning mainly towards multimedia files, videos and mp3s nothing else

  2. #2
    Programmer Bulat Ziganshin's Avatar
    Join Date
    Mar 2007
    Location
    Uzbekistan
    Posts
    4,507
    Thanks
    742
    Thanked 665 Times in 359 Posts
    1. compression should scale well as far as each core has enough local memory (~512kb) and total RAM throughput is enough to handle 2gb/s compression speed
    2. pigz decompression is single-threaded
    3. MM files cannot be further compressed anyway

  3. #3
    Member
    Join Date
    Aug 2015
    Location
    The Earth
    Posts
    11
    Thanks
    3
    Thanked 20 Times in 7 Posts
    https://github.com/madler/pigz
    pigz version 2.4 26 Dec 2017
    Portability improvements
    Produce Zip64 format when needed for --zip (>= 4 GiB)
    Make -no-name compatible with gzip, add --time option
    Add -m as a short option for --no-time
    Check run-time zlib version to handle weak linking
    Fix a concurrent read bug in --list operation
    Process options first, for gzip compatibility
    Add --synchronous (-Y) option to force device write
    Disallow an empty suffix (e.g. --suffix '')
    Return an exit code of 1 if any issues are encountered
    Fix sign error in compression reduction percentage

Similar Threads

  1. I'm looking for the best free implementation of deflate
    By caveman in forum Data Compression
    Replies: 2
    Last Post: 22nd November 2010, 09:27
  2. Intel Parallel Studio 2011
    By VoLT in forum The Off-Topic Lounge
    Replies: 0
    Last Post: 16th October 2010, 11:20
  3. Move-to-Front Implementation
    By Cyan in forum Data Compression
    Replies: 34
    Last Post: 8th August 2010, 02:11
  4. gzip - Intel IPP
    By M4ST3R in forum Download Area
    Replies: 5
    Last Post: 2nd June 2010, 16:09
  5. Parallel implmentation of gzip: pigz
    By nimdamsk in forum Forum Archive
    Replies: 2
    Last Post: 13th March 2007, 21:44

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •