Transparent Compression on File Systems

[Gonzalo]

The primary purpose for this thread is to ask for help.

But probably my question will be quickly answered by any of you. Even if not, I want to post here for further discussion some interesting projects.

I'll start making an -still incomplete- list of file systems that support transparent compression. I'm open to your additions, so new users/viewers can have an all-in-one quick overview about the subject. Or if it is preferred, each one can have its own thread. Let me know please.

By the way, the question is: How can I mount an external device (pendrive) which is formatted with HFS+ in order to activate its built-in compression on Linux? I have such a device working, but with no compression. All hfs* packages are installed. I've searched the best I can, without results... Thanks in advance.

[Gonzalo]

The yet incomplete list, sorted by name:

Btrfs (lzo, zlib) - LZ4, Snappy and LZMA proposed but not implemented yet.
>Kernel.org
>Wikipedia
>Repository

GBFS (gzip) - Stands for GeoBase file system. Intended for spatial data storage.
> Release notes in version 3.9.7.5 (The last one as of January 2015)

GBFS (Deduplication) - This one stands for GreenBytes File System. Based on ZFS.

HFS+ (zlib)

HAMMER2 (per-block deduplication, LZ4, ZLIB) - Not finished.

NTFS (LZNT1)
>Wikipedia
>SourceForge

Reiser4 (lzo, zlib)
>Kernel.org
>Wikipedia
>SourceForge

Squashfs (per-file deduplication, lz4, lzma, lzma2, lzo, zlib) - Read only. Used on live-cds.
>Kernel.org
>Wikipedia
>SourceForge
>LZMA patches

ZFS (Deduplication, LZ4, LZJB, GZIP, ZLE)
>Wikipedia
>Open-source multi-platform fork







*New entries will be added in THIS post, included your suggestions. So stay tuned.

[m^2]

ZFS has LZJB, not LZJ.
HAMMER2 has lz4, zlib
GBFS (formely ZFS+) has somethig too.
Does dedupe count?

[Gonzalo]

Yes! I have to add dedupe to ZFS too. Thanks.

[fcorbelli]

the today most advanced fs, used for years in production, is zfs, but is not very well supported on linux for license problem
i do not know stable and widely used file systems that use compression (not counting ntfs)

[m^2]

HAMMER1 has dedupe.
Besides, https://en.wikipedia.org/wiki/Compar...f_file_systems lists FSes with compression and dedupe.

[Gonzalo]

Updated first post with SquashFS 4 (added lz4, lzo and documentation)

[m^3]

Updated first post with SquashFS 4 (added lz4, lzo and documentation)

If you're listing FS with dedup, HAMMER (not HAMMER2) has it.