New compression method

[no404error]

0.1-3% on PRD.

DELL and Ocarina Networks - GET OUT! Chek out - OUT OF WORK!

[nikkho]

Any link?

[Crush]

Is this a chinese spam post? I don´t understand a single word and there´s no link or real information. What the heck is a PRD and what % was it before?

[no404error]

No. It's not a spam.

Time to reading without processing+compression <= (much higher) time to reading with preprocessing+compression.

[Lucas]

uhh...
is this it?
http://enterprisestorageforum.com/co...ompression.htm

[Matt Mahoney]

That's old news. After Dell bought Ocarina in 2010 (where I was a chief scientist), they pretty much abandoned Ocarina's niche, which was high compression ratios done in the background on infrequently accessed files, often using customer-specific algorithms based on analyzing their workflow and sample data. Instead, Dell went with a very fast but generic byte-aligned LZ77 type algorithm which was applied as the data was saved. They did keep dedupe, however. It was an engineering decision, trading off storage capacity for speed. Given cheap hardware, it was probably the right one, but it is the reason I no longer work for Ocarina/Dell. Once the acquisition was complete, they really didn't have much work for me to do. I am surprised they kept me as long as they did (until Feb. 2015. By then I had saved enough to retire). Most of my time was spent developing zpaq, which Dell didn't really have any use for.