Results 1 to 2 of 2

Thread: A Survey on Data Compression in Cache and Main Memory Systems

  1. #1
    Join Date
    May 2015
    Thanked 3 Times in 1 Post

    A Survey on Data Compression in Cache and Main Memory Systems Accepted in IEEE TPDS 2015.

    It highlights motivation for using compression in HPC systems (especially next-generation extreme-scale systems) and also presents challenges in use of compression. It discusses compression in CPUs and GPUs, conventional (SRAM and DRAM) and non-volatile memory (NVM) systems, and 2D and 3D memory systems. It also discusses interaction of compression with prefetching, error-correction and thermal and power management techniques.

  2. Thanks (3):

    Cyan (21st May 2015),nemequ (23rd May 2015),Paul W. (21st May 2015)

  3. #2
    Join Date
    Oct 2013
    Filling a much-needed gap in the literature
    Thanked 49 Times in 35 Posts

    Early Compressed Memory papers, systems


    You may be interested in

    (1) a couple of my early papers (1991) that talk about compressed caching for virtual memory; so far as I know, I invented it, though others probably invented it independently. (I think I may have talked about it in earlier tech reports I don't have handy.) When Fred Douglis published his 1993 paper, I immediately thought that he missed a few tricks IIRC---(1) he was keeping the compressed version of a page in RAM after it was uncompressed, wasting precious space; you need a fast compression algorithm so that you can re-compress the page instead, (2) his adaptation couldn't really work right without noticing the cost of hitting recently-evicted pages, and (3) he didn't scale his results to show it'd work okay anyway if the processor was fast enough, as processors soon would be.

    (2) Cdr-coding systems in some Lisp systems, which compressed linear linked lists into a vector representation at garbage-collection time. At least on the Symbolics Lisp Machines, there was hardware tag support, with most of the tag-checking done in parallel with the normal hash tag check. That was what got me thinking about how to exploit a stock TLB similarly-but-differently, and how very compressible pointers can be.

    (3) The Apple Newton, which used our WKdm algorithm years before we got around to publishing it (and years and years before OS X), and did so largely to conserve power rather than increase speed. (That was before Lithium-Ion batteries, and battery life was critical.)


    These are the two old papers I mentioned. They talk about the compressibility of pointers, and the increasing attractiveness of compressed caching given technology trends (now clearly true), among many other things.

    Some Issues and Strategies in Heap Management and Memory Hierarchies:

    Operating System Support for Small Objects

Similar Threads

  1. loseless data compression method for all digital data type
    By rarkyan in forum Random Compression
    Replies: 244
    Last Post: 23rd March 2020, 16:33
  2. Transparent Compression on File Systems
    By Gonzalo in forum The Off-Topic Lounge
    Replies: 7
    Last Post: 21st March 2016, 12:15
  3. Super-Scalar RAM-CPU Cache Compression
    By Gonzalo in forum Data Compression
    Replies: 5
    Last Post: 16th February 2015, 01:06
  4. Data decompression on in-memory kernel
    By cregd in forum Data Compression
    Replies: 8
    Last Post: 27th January 2009, 17:24
  5. Memory Limits for Windows Operating Systems
    By LovePimple in forum The Off-Topic Lounge
    Replies: 1
    Last Post: 12th July 2008, 23:40

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts