Activity Stream

Filter
Sort By Time Show
Recent Recent Popular Popular Anytime Anytime Last 24 Hours Last 24 Hours Last 7 Days Last 7 Days Last 30 Days Last 30 Days All All Photos Photos Forum Forums
Filter by: Forums Clear All
  • Jarek's Avatar
    Today, 05:48
    I have just updated context dependence for upscaling paper ( https://arxiv.org/abs/2004.03391: large improvement opportunities from FUIF/JXL no predictor) with RGB case, and standard YCrCb transform has turned out quite terrible (also PCA): - orthogonal transforms individually optimized (~L1-PCA) for each image gave on average ~6.3% reduction from YCrCb, - below single orthogonal transform optimized for all gave mean ~4.6% reduction: 0.515424, 0.628419, 0.582604 -0.806125, 0.124939, 0.578406 0.290691, -0.767776, 0.570980 Transform should align values along axes to approximate with three independent Laplace distributions (observed dependencies can be included in considered width prediction), but YCrCb is far form that (at least for upscaling): How exactly color transforms are chosen/optimized? I have optimized for lossless, while YCrCb is said to be perceptual, optimized for lossy - any chance to formalize the problem here? (what would e.g. allow to optimize it separately for various region types) YCrCb is not orthogonal – is there an advantage of considering non-orthogonal color transforms? Ps. I wasn’t able to find details about XYB from JPEG XL (?)
    0 replies | 13 view(s)
  • suryakandau@yahoo.co.id's Avatar
    Today, 03:18
    ​here is the source code
    17 replies | 565 view(s)
  • suryakandau@yahoo.co.id's Avatar
    Today, 02:45
    Fp8sk5 -improve compression ratio better than fp8sk3 and fp8sk5 using -8 option on mixed40.dat(GDCC public test set files) is Total 400000000 bytes compressed to 46612718 bytes. using -8 option on block40.dat(GDCC public test set file) is Total 399998976 bytes compressed to 61239095 bytes.
    17 replies | 565 view(s)
  • suryakandau@yahoo.co.id's Avatar
    Today, 01:35
    Thanx for your input. I will try it
    17 replies | 565 view(s)
  • moisesmcardona's Avatar
    Today, 00:24
    moisesmcardona replied to a thread Fp8sk in Data Compression
    Thanks. May I ask why you don't use a Source Control repository? Something like GitHub or Gitlab can be really convenient. We do this with paq8px and @kaitz does it with paq8pxd and paq8pxv.
    17 replies | 565 view(s)
  • Gotty's Avatar
    Today, 00:24
    Aha, I see. Yes, he will certainly need to find a balance between price vs video quality + durability. He seems to be unsatisfied with the video quality of Xiaomi 8T (It's not that bad, is it? #1 #2) ... and thinking about rugged design. To satisfy those needs it won't be cheap, clearly. >>I guess maybe a phone would cost $200-400. Yes, probably that's the range. The Xiaomi Redmi Note 8T is 169 USD here. It's extremely good priced. Has 4K video, 4K screen, Gorilla glass. It has 4 cameras at the back. That's why I suggested it. What's your budget, CompressMaster? Blackview phones ain't cheap. Are you sure you need rugged design? A normal case usually does a good job. It protects the phone when accidentally dropped - especially the lenses and the screen need protection. When it has gorilla glass it's even more solid. Protects from scratches. I believe you are afraid of a screen break. So go for a case. Rugged design is "too much" in my view.
    6 replies | 124 view(s)
  • suryakandau@yahoo.co.id's Avatar
    Today, 00:18
    ​here is the source code
    17 replies | 565 view(s)
  • ivan2k2's Avatar
    Yesterday, 22:13
    you'll never win this court, you'll never start this court you'll never see the scale of your insanity you cant admit you can be wrong and insane if you are trolling, and your trolling is not productive
    22 replies | 1282 view(s)
  • Stefan Atev's Avatar
    Yesterday, 22:01
    This has all had me trying to scratch the compression bug again :) I am trying several ideas out, will let you know if they pan out: ​ 1. No literals (construct a "dictionary" of 256 bytes so that a match (of length 1) is always guaranteed - the code to set that up is very short); that alone is not very promising (literals encoded as len-1 matches will definitely use more than the 9 bits LZSS does); I am trying an offset encoding scheme that's very simple but unfortunately hard to optimize for (if you must _always_ be able to encode a match, you may need too many bits for the match offset - trying to use multiple "offset contexts"); For this to work, the savings of 1 bit from each match must offset the cost of adding len-1 matches as a replacement for literals. It will also simplify the decompressor size if everything is a match. 2. Imprecise lengths - especially if you can reuse previous match offsets, it's OK if there are "gaps" in representable match lengths; an especially long match will just be encoded with multiple shorter matches; that only makes sense if you expect to have long matches and very few bits dedicated to offsets. A Goulomb or Fibonacci length distribution seems too difficult for a tiny decompressor, but I think there are easier ways to stretch out your length budget. I am trying to see if there's a way to stick to byte-oriented IO, no variable-length codes, etc (just more fun, I think; the best compression likely needs variable-length codes even if they add a little decompressor complexity). I guess I will shoot to have a program that spits out the compressed data and a small decompressor (probably just C source to match the data); The inputs being small at least allows me not to worry about being reasonable about memory consumption, match finding performance, etc.. It turns out (as we all knew) that trying to do optimal decisions when encoding choices can drastically affect future output is quite difficult.
    40 replies | 2642 view(s)
  • SolidComp's Avatar
    Yesterday, 21:22
    I wonder how it compares to AV1.
    1 replies | 111 view(s)
  • Sportman's Avatar
    Yesterday, 21:22
    I do not practice a religion, when you take out what's distorted in main religions there is some truth left. I believe there can only be one truth with some paradoxes. There is nothing to learn when there is no bad, free will allow slow down progress or even going backwards, the universe is very forgiving with many second chances. For who have permanent no intentions to improve, even not the slightest intention, there is a sort of recycle program what set somebody a big step back in evolution and temporary for a long time on hold, what give a big time delay and a loss of what’s build up in that cut period what must be all redone.
    22 replies | 1282 view(s)
  • Sportman's Avatar
    Yesterday, 20:54
    H.266/Versatile Video Coding (VVC): "This new standard offers improved compression, which reduces data requirements by around 50% of the bit rate relative to the previous standard H.265/High Efficiency Video Coding (HEVC)" https://newsletter.fraunhofer.de/-viewonline2/17386/465/11/14SHcBTt/V44RELLZBp/1
    1 replies | 111 view(s)
  • SolidComp's Avatar
    Yesterday, 19:19
    Yeah, because of the price. CompressMaster said he uses a Lenovo A2010, which is super cheap and only has 1 GB of RAM, and he said that he's looking for a phone that can record Full HD (1080p), so I figured he wanted something very low cost. I'm not sure what the prices are like in Slovakia, though I assume the top end prices are similar to the US – Apple and Samsung charge nearly the same price for their flagships in all countries, else there would be lots of arbitrage. $100 USD is a great price in the US, compared to $1,000+ for the latest flagships. To get the kind of quality you're implying, I guess maybe a phone would cost $200-400.
    6 replies | 124 view(s)
  • Aniskin's Avatar
    Yesterday, 19:15
    Aniskin replied to a thread 7-zip plugins in Data Compression
    Maybe later.
    19 replies | 3463 view(s)
  • compgt's Avatar
    Yesterday, 17:52
    "What's your Religion, Sportman?" You're a smart guy, you can figure out what i mean by now. I am Christian (Roman Catholic), after my family's religion. That's too much Karmic doctrine. Some people in the higher places bypass religion. They choose to steal, and steal. And eliminate those who are in their way.
    22 replies | 1282 view(s)
  • moisesmcardona's Avatar
    Yesterday, 17:51
    moisesmcardona replied to a thread Fp8sk in Data Compression
    Please remember to post the source code.
    17 replies | 565 view(s)
  • suryakandau@yahoo.co.id's Avatar
    Yesterday, 17:29
    Fp8sk4 - small improvement with tuning parameter ​
    17 replies | 565 view(s)
  • Shelwien's Avatar
    Yesterday, 17:23
    Shelwien replied to a thread 7-zip plugins in Data Compression
    I suppose you can try looking for "10 37 10 0F" signatures. (Which is FF D8 FF E0 xor EF =239) But isn't it simpler to make a standalone converter for this, rather than modify mfilter?
    19 replies | 3463 view(s)
  • compgt's Avatar
    Yesterday, 17:23
    It was 1970s Cold War, we were still inventing everything, field-testing the internet, even the BPO industry. There was no Peace with these Chinese, American and British groups etc. fighting each other, you watched the movies, they're my documentaries of the Cold War. Poor and beaten Americans and British had to go back to where they came from. They can't invade Asia anymore (but i think they're here again in the Philippines). No peace because the Hollywood industry i knew are full of f*king addicts, killers, and thieves!! > At least remind what you invented. Too many, innumerable in number. Some given and taught to poor but smart academics for them to have livelihood. Summary: Hollywood music and movies are mine! The tech giants are mine!!!! Enough of this!! Be alerted, Jyrki! We all need money in this pandemic and economic recessions around the globe. Tell Google i want my Google billion$! (I haven't enjoyed the luxuries of the 1990s to 2010s (big house and lot, cars, high-end computers, world tours etc.) when in fact i am supposed to be multi-billionaire!!)
    22 replies | 1282 view(s)
  • Sportman's Avatar
    Yesterday, 16:13
    What happened with the high salary what's included with this kind of Tier 1 job? What you want to do with billions? At least remind what you invented. The concept of good and bad is determined by entities in the universe who are impersonal and remember all our thoughts and actions. They are a sort of Turing machine who receive, store, decide and send back, they take into account this live and the last 6 lives. As a sort ultimate judge they influence and decide for all what live the future direction with respect for free will in a small local space. If something good or bad happened it had a reason caused by yourself in that 7 lives, there is nobody else to blame. Lying without good reason result in something bad, it’s the conscious of all there is what force us to move slowly forward.
    22 replies | 1282 view(s)
  • lz77's Avatar
    Yesterday, 15:09
    Too many different words... I for curiosity counted the number of "words" and delimiters in TS40.txt. There are a lot of different "words" (case sensitive) in the file (389388!). I thought that the number of "words" would be less than 65536. In Shakespeare's works there are 29066 different words (tokens). You can do it with my small but powerfull Perl script. :) It outputs all different "words" with their frequency (sorted by frequency). #!perl -w my $word=qr/(+)/; my $delim=qr/(+)/; open F,"+<$ARGV" or die "Can not open $ARGV\n"; binmode F; { local $/=undef; $_=<F>; } close F; #$_=substr $_,0,100000; # for debug my %h=(); while (/$word/g) { if (exists($h{$1})) { ++$h{$1} } else { $h{$1}=1 } } open F,">$ARGV".".words.txt"; binmode F; for $key (sort { $h{$b} <=> $h{$a} } keys %h) { print F "$h{$key} $key\n"; } close F; %h=(); while (/$delim/g) { if (exists($h{$1})) { ++$h{$1} } else { $h{$1}=1 } } open F,">$ARGV".".delim.txt"; binmode F; for $key (sort { $h{$b} <=> $h{$a} } keys %h) { my $k=$key; $k =~ s/()/"(".ord($1).")"/ge; print F "$h{$key} $k\n"; } close F; Download Perl for Windows from http://strawberryperl.com/releases.html Select zip or portable edition and extract only perl.exe and all 4 dll files, it's enough.
    34 replies | 1791 view(s)
  • maadjordan's Avatar
    Yesterday, 15:08
    maadjordan replied to a thread 7-zip plugins in Data Compression
    Is there away to let mfilter handle "xor" files. The sample iso has CNG files that are XORed jpg.. I could not find away to guest if data streams are Xor'ed or not. http://www.subdude-site.com/WebPages_Local/RefInfo/Computer/Linux/LinuxGuidesByBlaze/appsImagePhotoTools/cng2jpgGuide/cng2jpg_guide.htm
    19 replies | 3463 view(s)
  • compgt's Avatar
    Yesterday, 14:34
    I don't know where you were in the 1970s but i was with the higher powers in governments, wealthy business groups, and top scientists. These patents were distributed by me among the nations for a world peace and "world balance" i idealized. These decisions of mine were to be honored and followed; i dictated them all. (So China and Korea are now major producers of smartphones, for example.) My clan was a military superpower too. We were NASA/Starfleet. I made the Star Trek movies, for that matter. What wasn't followed in the end were my Hollywood and tech ownerships, too overkill. > No proof, no payment. I dictated them all, and they followed me. I was the Boss. I was like their wizard grandfather and they were my grandchildren stealing from me. But now i want some billion$ from Hollywood and tech. They should just follow my order now. Sergey Brin and Larry Page are lucky i chose them. I made them. They owe me. I'm not after their billions; It's my billions too. I want my Google billions. Google should pay me now. I'm asking for it. Alphabet is mine. Google, #PayTamayo ! Good for you. You have some kind of understanding of this collective consciousness. You want to inculcate in me your concept of goodness? I was a wise Jedi of Star Wars. I was a Wizard in Fantastic Beasts and Harry Potter. ;) You know what i mean. I made these movies too. They're the ones who gained much from my efforts, my inventions, my improvements and developments, my science and technologies. I planned these big companies, designed their portfolios of products and technologies, their timeline of technologies to be implemented. I just chose them to be billionaires with me. I am the one stolen here of my rightful ownerships. It's justice for me.
    22 replies | 1282 view(s)
  • cssignet's Avatar
    Yesterday, 14:11
    ​do not waste more time on 46, there is an error on profiles. hopefully this would be improved by speed/size in next release
    478 replies | 127422 view(s)
  • maadjordan's Avatar
    Yesterday, 14:03
    maadjordan replied to a thread 7-zip plugins in Data Compression
    I think the file was the problem. after testing many programs for bin2iso and last using Isobuster managed to convert to iso but after comparing both bin and iso files was found identical. just rename the bin file as iso and extractng worked fine
    19 replies | 3463 view(s)
  • Aniskin's Avatar
    Yesterday, 13:33
    Aniskin replied to a thread 7-zip plugins in Data Compression
    Fixed. Thanks for bug report. But there is no difference between disc1.bin and extracted disc1.iso for the sample you provided because the image was created with using of "2048 bytes per sector" mode.
    19 replies | 3463 view(s)
  • Sportman's Avatar
    Yesterday, 13:06
    You worked there as Einstein did? I don’t think a single human can be the Patent Office entity or owner, or it must be a company that help investors registering patents at different patent offices world wide. No proof, no payment. Yes, all there is is consciousness what cause electromagnetic waves what science call matter and yes we must evolve as human by slowly moving back to our common source again, an idea is nothing else then a glimpse of that common source. Done at own power mean often progress, but it can also that somebody bring you in that position even without that you know it. This last case can have a good and bad reason, in the bad reason case it’s best to avoid it with or without help. The only thing what is good is if you help somebody else without gaining anything for yourself, claiming something from big companies fall probably not under that definition.
    22 replies | 1282 view(s)
  • maadjordan's Avatar
    Yesterday, 11:58
    maadjordan replied to a thread 7-zip plugins in Data Compression
    Checked for size is working fine but getting unpack error.. I tried through "bin" file and through "Cue" file. I will restart my system and try again. What is the new maximum size limit?
    19 replies | 3463 view(s)
  • Dresdenboy's Avatar
    Yesterday, 11:33
    I already found this thread a few weeks ago. Your algo is very interesting. I think this might also work well with small files which don't have so many matches (covering ~15-50% of total bytes for binary data). The decompressor code might even be very small. My literal encoding needs roughly half a bit per literal or more, depending on other parameters, and 0 bits for no literals between matches. Matches (starting from length 2) need more than one bit ofc. This roughly fits the probabilities.
    19 replies | 1009 view(s)
  • Aniskin's Avatar
    Yesterday, 11:27
    Aniskin replied to a thread 7-zip plugins in Data Compression
    Fixed.
    19 replies | 3463 view(s)
  • compgt's Avatar
    Yesterday, 09:09
    Hello @Sportman, I was the Patent Office. I mean, it was me deciding too what technologies to recognize and who gets the patents. Mainly, i was distributing patents to various countries for a "world balance" i was idealizing and maintaining. That's why Korea and China are now major producers of smartphones (because i am Asian), though if you think about it, the technologies were my better refinements already. I was on top of almost everything science and tech. I was United Nations/NASA/Starfleet. > I don't think you make any chance against a big company without rock solid proof. They should be ashamed of themselves. They should just pay me. I made them. #PayTamayo > The universe is one big information field and in source we are all one. Everything we go to invent in human life time already exist, it's all about tuning to a hint or idea in the information field. You mean the Psychic, "Collective Consciousness" Field that is purportedly accessed by smart and genius people with ease or instantaneously in their waking moments. This was made artificially in the movie "Matrix" starring Keanu Reeves. Individual consciousness still disagree and fight against each other in there. I outlawed this mindNet or "mind network". It will just melt human brains until they are useless and dumped for nothing. The Borg of Star Trek are not considered right, but a problem. We must evolve as humans, and not with artificial devices attached to the brain and bodies. > Ideas exist for everybody but you need to focus to tune in and heavy labor to build a product and company. I remember when I was young that James Dyson showing his vacuum cleaner idea with a container for dust but nobody wanted to do something with it. Ten years later he build and sold them with his own company what's today a very big company. Truth be told, i co-invented, improved, and developed too the modern televisions for the 1980s and onwards (Sony is mine, i co-own too), and music component players, refrigerators, even vacuum cleaners.
    22 replies | 1282 view(s)
  • compgt's Avatar
    Yesterday, 08:38
    @SvenBent, i am telling the truth. I just want a piece of the Hollywood and tech billion$. LOL Am i getting you uncomfortable? Do you want me to sing for you? :) No, never mind, i hardly sing these days. I can't sing to you live. But, ... i rediscovered the videos that we made in the 1970s to the 80s in YouTube. So i made a playlist of my songs, here it is. (In high-school 1988-1992, i forgot this.) That's my voice in Bread, America, etc, and they're mostly my compositions, or i was co-composer: https://www.youtube.com/playlist?list=PLnoHqN_r4wNu38-pbRwoIyNo1qDv-nX2b Do you have voice recognition software expertise? Can you spot the same voice in the official songs from different bands? Did i get some million$ from these songs? No. Google and YouTube are mine. I co-own Hollywood music and movie companies, taken from me too. @SvenBent, my initials are "GRT". The Guitar Man? TG man? There is a prevalence of 'g' 't' in this song, my simple "encodings". :) Terminal by Rupert Holmes? TR? Rainbow-Temple of the King? RT?
    22 replies | 1282 view(s)
  • compgt's Avatar
    Yesterday, 08:26
    James, Apple is now, just now, releasing their SoC? This is already 2020, we may not have anticipated this, but maybe. Of course, i won't accurately say that these technologies were designed by us in perfect pristine form, unchanged from the 1970s. I understand that they're updating our technologies, to meet the changing needs of the times. I remember designing, improving AMD and Nvidia technologies. Even technologies on data centers or cloud computing, maybe even DeepMind. They were betting on my research all the time. Because i led my clan's science research. Because i was like a "central hub" among scientist networks. I own Microsoft, IBM, Intel, and AMD too. I was just betrayed and denied in the end. Don't get intimidated by these pronouncements of mine. I am just telling the truth. I will not be making noise like this, if i am at least billionaire in Hollywood and tech. The truth is that i made Apple, i made it happen. I chose Steve Jobs. Others knew me as "the little Steve Jobs". I was Wozniak's Boss. My family designed the early Apple computers because we co-own Apple. I even made the movie "Jobs (2013)", not just the Marvel movies. It was Cold War, we knew flight technologies, weapons tech, even nukes. Consider me the almost one-man Standards Committee of most science and technologies. We were Starfleet, and we were taking charge of the modern science and technologies for the modern World Peace that we worked upon.
    22 replies | 1282 view(s)
  • SvenBent's Avatar
    Yesterday, 07:50
    Seriously get help. Something is not right inside you
    22 replies | 1282 view(s)
  • moisesmcardona's Avatar
    Yesterday, 00:47
    A few years ago, there was a Cloud service called Bitcasa. They seem to have a hash table of some sort. Files uploaded would be split into chunks (I believe 512kb chunks) and it would only upload those if it didn't exist on their servers. Basically reducing redundancy data for stuff like legally purchased music or videos, where several users would store the same data over and over again. This saved bandwidth on the user side as well but required significant IO due to the file chunking. Not to mention the NTFS Master File Table being growing a lot! There was no compression performed.
    17 replies | 929 view(s)
  • JamesWasil's Avatar
    5th July 2020, 22:02
    Apple is now releasing their own SOC (system on a chip). If your claims are correct, then you would already know how this chip works, the undocumented modes for it, and can show us schematics and partial things here that would prove it was developed during the Cold War and convince everyone that you were slighted by big tech companies rather than a doctor's prescription for medication. Are you able to provide the proof for this? Even partial photos that cannot be used for anything tangible but visible and verifiable enough to prove that you had it before (since no one but Apple currently has these, and if your claim is true, then you could draw or outline how these work and differences between theirs with proprietary modifications and AMD/Intel and ARM and RISC-V cpus before they ever tell the public or private engineers for firms about them. And of course you would already know what these modifications and proprietary things are, because you already invented them! Yes?). Can you provide this as evidence to prove your claims?
    22 replies | 1282 view(s)
  • Sportman's Avatar
    5th July 2020, 20:46
    Dutch investor Eckhart Wintzen (https://web.archive.org/web/20090713021317/http://www.extent.nl/about-eckart/) said to Dutch inventor Jan Sloot in 1998 "demo or die" because he wanted proof the chip card manual put in Sloot’s device was the source of the video play back information. Even if you show a working inventing you need to confirm to all requested proof to get an investment. How do you want to backup your claims? Did you patent or deposit them at a notary office as Sloot did? Did you gave demo’s with witnesses who are still alive as Sloot did? I don't think you make any chance against a big company without rock solid proof. The universe is one big information field and in source we are all one. Everything we go to invent in human life time already exist, it's all about tuning to a hint or idea in the information field. I noticed when I invented something one or more invented a similar thing round the same time. In the beginning I thought they copied me, but after contacting them I discovered it was done total independent while very similar. I went once to the local patent office to check an idea and they could not find the idea in my country, but in an other country there was the same inventing patented some years before with even a drawing what was a simple version of my drawing, so also very similar. Ideas exist for everybody but you need to focus to tune in and heavy labor to build a product and company. I remember when I was young that James Dyson showing his vacuum cleaner idea with a container for dust but nobody wanted to do something with it. Ten years later he build and sold them with his own company what's today a very big company. There is no free lunch.
    22 replies | 1282 view(s)
  • Darek's Avatar
    5th July 2020, 20:02
    Darek replied to a thread Paq8pxd dict in Data Compression
    300KB is a very, very, good score! The first fourth submitted places for LTCB are: cmix v18 = 115,714,367 phda9 1.8 = 116,544,849 nncp 2019-11-16 = 119,167,224 paq8pxd_v48_bwt1 -s14 = 126,183,029 and there are paq8pxd_v89 and paq8sk23 to be submitted. paq8sk23score = 122'364'274 (but 2.5x higher time and 4GB more memory used)
    955 replies | 319715 view(s)
  • moisesmcardona's Avatar
    5th July 2020, 16:41
    moisesmcardona replied to a thread Fp8sk in Data Compression
    You put the current copyright year. See paq8px and paq8pxd.
    17 replies | 565 view(s)
  • suryakandau@yahoo.co.id's Avatar
    5th July 2020, 16:14
    I don't know which the exactly copyright year of this. Is it 2008 or 2018 ? I have written Matt Mahoney as a credit for him
    17 replies | 565 view(s)
  • LucaBiondi's Avatar
    5th July 2020, 16:09
    LucaBiondi replied to a thread Paq8pxd dict in Data Compression
    Thank you Darek! Next time we should go under 123.000.0000 for enwik9.. Near 300k of improveement very good!!! P.s. what is actual record for enwik9?
    955 replies | 319715 view(s)
  • moisesmcardona's Avatar
    5th July 2020, 16:03
    moisesmcardona replied to a thread Fp8sk in Data Compression
    The copyright year was removed from the executable.
    17 replies | 565 view(s)
  • Darek's Avatar
    5th July 2020, 15:48
    Darek replied to a thread Paq8pxd dict in Data Compression
    enwik scores for paq8pxd v89 Luca's modification: 15'728'903 - enwik8 -s15 -w -e1,english.dic by Paq8pxd_v89 15'655'526 - enwik8 -x15 -w -e1,english.dic by Paq8pxd_v89 123'301'984 - enwik9 -x15 -w -e1,english.dic by Paq8pxd_v89 15'728'903 - enwik8 -s15 -w -e1,english.dic by paq8pxd_v89_40_3360, change: 0,00% 15'654'147 - enwik8 -x15 -w -e1,english.dic by paq8pxd_v89_40_3360, change: -0,01% 123'013'220 - enwik9 -x15 -w -e1,english.dic by paq8pxd_v89_40_3360, change: -0,23% - very good change, no more memory usage and 3% of compression time improvenment!
    955 replies | 319715 view(s)
  • Scope's Avatar
    5th July 2020, 15:47
    I haven't tested the speed yet, but I've compared the overall size of the same test set (personally, the most important thing for me is maximum efficiency at the slowest speed and I would be interested in an even slower mode like -sb, but designed for large images, and at faster speeds, exchange a little efficiency for higher speed is reasonable) 498 files (2 053 230 418 bytes) pingo (25) -s0 -strip 1 623 898 128 pingo (25) -s5 -strip 1 574 034 276 pingo (25) -sa -strip 1 555 294 498 pingo (44) -s0 -strip 1 623 898 128 pingo (44) -s5 -strip 1 577 248 424 pingo (46) -s5 -strip 1 572 187 422 pingo (47) -s5 -strip 1 570 768 051 pingo (44) -sa -strip 1 555 295 235 pingo (45) -sa -strip 1 555 294 330 pingo (46) -sa -strip 1 572 187 422 pingo (47) -sa -strip 1 555 295 745 proto -s0 -strip 1 624 029 494 proto -s5 -strip 1 567 973 360 proto -sa -strip 2 053 230 418
    478 replies | 127422 view(s)
  • compgt's Avatar
    5th July 2020, 15:00
    ivan, do you want me to sing for you? No, never mind, i hardly sing these days. Just listen to American songs, they're mostly my compositions, or i was co-composer. I wonder if i composed Russian songs during the Cold War.
    22 replies | 1282 view(s)
  • SolidComp's Avatar
    5th July 2020, 14:14
    How did you get the 400% CPU figure? How does network bitrate convert to CPU utilization percentage?
    12 replies | 707 view(s)
  • maadjordan's Avatar
    5th July 2020, 11:26
    maadjordan replied to a thread 7-zip plugins in Data Compression
    I will try this and post result
    19 replies | 3463 view(s)
  • maadjordan's Avatar
    5th July 2020, 11:25
    maadjordan replied to a thread 7-zip plugins in Data Compression
    check your inbox
    19 replies | 3463 view(s)
  • suryakandau@yahoo.co.id's Avatar
    5th July 2020, 04:51
    mixed40.dat using fp8sk3 -8 Total 400000000 bytes compressed to 46685762 bytes. block40.dat using fp8sk3 -8 Total 399998976 bytes compressed to 61313849 bytes.
    40 replies | 2555 view(s)
  • suryakandau@yahoo.co.id's Avatar
    5th July 2020, 04:43
    Fp8sk3 using -8 option on mixed40.dat(GDCC public test set files) is Total 400000000 bytes compressed to 46685762 bytes. using -8 option on block40.dat(GDCC public test set file) is Total 399998976 bytes compressed to 61313849 bytes. here is the source code and executable files
    17 replies | 565 view(s)
  • cssignet's Avatar
    5th July 2020, 02:16
    the changes would be implemented atm (rc2 44). i did not it test widely though
    478 replies | 127422 view(s)
  • Trench's Avatar
    5th July 2020, 01:56
    As stated on wikipedia "GIF images are compressed using the Lempel–Ziv–Welch (LZW) lossless data compression technique to reduce the file size without degrading the visual quality. This compression technique was patented in 1985. Controversy over the licensing agreement between the software patent holder, Unisys, and CompuServe in 1994 spurred the development of the Portable Network Graphics (PNG) standard. By 2004 all the relevant patents had expired." "Welch filed a patent application for the LZW method in June 1983. The resulting patent, US 4558302, granted in December 1985""when the patent was granted, Unisys entered into licensing agreements with over a hundred companies" https://en.wikipedia.org/wiki/GIF Did they make money? can you if you did the same? if its a small difference no but if its a big maybe? "In January 2016, Telegram started re-encoding all GIFs to MPEG4 videos that "require up to 95% less disk space for the same image quality." well mpeg4 doesnt seem as convenient or as fast. A bigger hard drive you can buy easier than time. In other fiends some people creates things and big companies pay them million to buy the patent and the company never sells the thing they buy since more money to be made in the thing they have. But other programs say free to use for public use but must pay if corporation. And some use the honor system while others give a free demo for a free days are tries only or 1 time daily. So many questions arise and more which a few are. Now is their a legal form one must fill out to get the assurances? Even if you do make something wont it hurt others to try to improve it? How long will the patent or payment last? Would it be better to not have a patent and keep ti secret for personal use? If you do make money will you use the money to make something else better or just screw everyone else like all rich which make money got to their head to destroy nations for their ego? You cant make money giving money away. and you cant go forward if you spend your time to make some thing good and cant afford to feed yourself. if Nikola Tesla made money or had plenty of money more things would have been done. Let's say you are smart and can make money if your dont have money no matter how smart you are. Unless you are smart enough to make money and connections which make the world go round then maybe you can influence the world in one thought. while others think they can influence with just ideas. As Christ said about watching out for "CASTING PEARLS BEFORE. SWINE Matthew 7:1-6" But a lot of things in the bible were stated by the ancient Greeks and everything people have now as well. But many push away who they came with the dance with to dance with another and then wonder why it was not so good in the end. In Ancient Greece only the rich paid taxes IF they wanted to. And many wanted to pay taxes to help their fellow man and to help their status and business as well. But the rich mainly went to war too. Now its backwards for poor die for the rich, the non rich pay the most taxes, the rich want to give as little and when they give its for tax breaks, the rich get tax money for their business. People seem to give praise to some rich despite they are ripping them off. Maybe the masses like to be ripped off and the rich give them what they want since people are conditioned to be that way. And the Rich will get richer and only focus on money and if you feel you are morally right and give things away for free then dont blame them if they profit off you. You can only blame yourself. I am not saying dont give things away I am saying dont hurt yourself and others. Play it smart since if you are smart enough to make something find someone else smart enough to protect you. But dont hurt the masses that can benefit from your idea. Kind of all those big tech companies getting rich by you using their product since they make money with people going on the site. you can be part of the problem if you disagree with them. Sure they will make their money without you but the mentality of the masses is the issue. Which maybe that can never change but maybe your help to use their tactics against them if you have the capability. Maybe resistance is futile and give up everything. As the Ancient Greeks said leisure time is used to learn something new.
    0 replies | 53 view(s)
  • Trench's Avatar
    4th July 2020, 23:11
    ​JamesCool. I thought about that too to replace the most used with a smaller one and the least used with bigger but in another way. But its also kind of used in coding in some ways I think. Gotty agreed. nice associations, so my wording was wrong and I emphasized it too much. But that was a side comment. Similarities from one field to another. The main point is not addressed which is programmers need completely different other fiends for perspective as for randomness you are right for the most part. when you open up a combination lock you have a limit of patterns to put in. the more digits the more numbers. if its 1 digit and binary you have 50% odds, if its 2 digits and binary its 4, 3 digits and binary etc you get the idea. I dont know if you saw my other post about randomness but I explained more in more details with examples. but in short a computer does not know the difference between random or order and we define it with the formula in what we understand. Maybe you are 100% right but as for not I do not agree fully. Also sorry but I disagree with discouraging other to disagree with random files. You have to push yourself to achieve something harder which makes the other feel easier. Randomness file compression is the future I feel despite almost everyone does not see it. https://encode.su/threads/3338-Random-files-are-compressed-all-the-time-by-definition-is-the-issue I forgot my programming 20 years ago and only do simple things like html, excel, or hex edit. Its a different mindset when dealing with other things and to be away form coding. Compgt very interesting comments. Did you have proof that it would be an issue? but if you can you can at least make one for yourself and have a dead man switch. I made a post about that too. https://encode.su/threads/3346-No-hope-for-better-compression-even-if-possible People think of the positive aspects of finding the ultimate compression but the issue is many ignore or imagine the negative side about it. Good programmers but not practical. What if you were in charge of a nations GDP, what if you are in charge of a companies fiduciary duty, what if you are in charge of livelihood of others. 1000 steps forward 2000 steps back. If one is going to release fire they better be able to control it. This forum is for compression but the balance is more than that, but not talked about since again this forum is just for file compression. Its hard to balance many aspects. yes they benefit from the occurrence of patterns, and that the edge you take and exploit. Just like a boxer exploits the opponents weakness the same with the coding. As for making money on their ideas. Well how did this work for Gif? I should make a new topic. Since I feel many are holding back out of fear,out of money, etc. Anyway I suggest people do what Christ said. Be like a child to at least start from the begging and understand how they learn. The obvious is not so obvious. I talk vague since I am trying to make others think about it and dont like to say much about it.
    20 replies | 461 view(s)
  • cssignet's Avatar
    4th July 2020, 20:32
    ​these are the results i expected. i planned changes for rc2 45 as it could require more trials. thanks for your tests, it was very useful
    478 replies | 127422 view(s)
  • compgt's Avatar
    4th July 2020, 18:39
    compgt replied to a thread 2019-nCoV in The Off-Topic Lounge
    Update, from me: Coronavirus is not new. We knew about it in the 1970s. In the end, i had many thought-up vaccines for coronaviruses, even for mutations. Many were following me, asking for my inputs. Because researcher groups were tipping me on their results too, even from on-the-spot lectures. But I recall a group deliberately brainstorming powerful coronaviruses mutations in the 1970s Cold War, maybe in early EDSA, QC, Philippines. They were the bio-weapons type of guys, who would willingly monetize on coronaviruses vaccines too. Now, this year 2020, many nations are offering billion$ worth for funding covid-19 vaccine research, to find an immediate vaccine. Need i say that the vaccines "hydroxychloroquine, avigan, and remdesivir" etc. were probably designed, named or suggested by me with my Ramizo relatives who were medical researchers saving the world from coronaviruses or bio-weapons? In the 1970s, actually. Japan, my ally, can probably validate this claim. If i was the one who designed remdesivir, then how many million$ for me from designing this vaccine? But that is not needed if i get my Hollywood and tech billion$. (5/7/2020)
    41 replies | 3483 view(s)
  • Scope's Avatar
    4th July 2020, 18:35
    I did a test on the entire PNG set (after these multithreading changes are in Pingo, I will redo the speed results of all optimizers when I have time). 498 files (2 053 230 418 bytes) ect -1 -strip --mt-file *.png Processed 498 files Saved 332.32MB out of 1.91GB (16.9717%) Kernel Time = 0.015 = 0% User Time = 0.000 = 0% Process Time = 0.015 = 0% Virtual Memory = 9 MB Global Time = 342.581 = 100% Physical Memory = 8 MB proto -s0 -strip *.png proto - (213.94s): ------------------------------------------------------------------------- 498 files => 419141.53 KB - (20.90%) saved ------------------------------------------------------------------------- Kernel Time = 0.015 = 0% User Time = 0.000 = 0% Process Time = 0.015 = 0% Virtual Memory = 9 MB Global Time = 213.986 = 100% Physical Memory = 8 MB
    478 replies | 127422 view(s)
  • cssignet's Avatar
    4th July 2020, 16:26
    ​ here we are. proto is pingo, just with fair comparison of threading. thanks to your test, i would fix that later just chunks removal, this would be 'fixed' now, if you are still up for it, the last trial: proto -s0 -strip, on the set you have test (~900 files) on your benchmark (heuristic test), and a comparison if possible with ECT -1 -strip. thanks!
    478 replies | 127422 view(s)
  • compgt's Avatar
    4th July 2020, 16:18
    Gotty, the idea is to inform the computer science world that these tech companies were started up or planned during the Cold War. American students are now reaping the benefits of world peace which we were working on in the 1970s to the 80s. World peace happened because those militaristic power groups were satisfied already they will own these billion$-companies that i was creating and planning. I negotiated for world peace immediately because i was also thinking of my ownerships, of course! The next idea is clearly for money purposes now (amidst this pandemic and economic recessions around the world). They owe me. Plain and simple.
    22 replies | 1282 view(s)
  • compgt's Avatar
    4th July 2020, 15:54
    Maybe there was a "Gotty" handle then, see there's a 'G' and 't' in Gotty? But i can't recall fully, his work on paq might be new indeed, done at present realtime, not 1980s. ivan2k2, i'm fine. Maybe even finer than you. I'm remembering right? :)
    22 replies | 1282 view(s)
  • Jyrki Alakuijala's Avatar
    4th July 2020, 15:25
    Entropy codings tend to be less than 10 gbit/s on software. If you have a 10 GbE network connection 4 : 1 compression, you need 400 % of CPU to fill the 10 gbits network. 1 % is about 3 orders of magnitude off. It might be possible to be done with relatively simple hardware. Still, you'd be using more than 10 % of the memory bus for storing the decompressed data. ​So, no, it is not possible with 1 %.
    12 replies | 707 view(s)
  • Scope's Avatar
    4th July 2020, 15:10
    Same set, timer64 (Timer 14.00), pingo (43), proto. Hmm, not bad, proto is noticeably faster and more efficient at speed 5 (including -mp=8, and faster, but slightly less efficient at speed 0 (maybe HDD in this configuration can affect, so I tested slower speed 5 too). ​ First run: pingo.exe -s0 -strip *.png pingo - (181.04s): ----------------------------------------------------------------- 236 files => 128508.08 KB - (15.57%) saved ----------------------------------------------------------------- Kernel Time = 0.015 = 0% User Time = 0.000 = 0% Process Time = 0.015 = 0% Virtual Memory = 9 MB Global Time = 181.088 = 100% Physical Memory = 8 MB pingo.exe -s5 -strip *.png pingo - (499.17s): ----------------------------------------------------------------- 236 files => 148348.89 KB - (17.97%) saved ----------------------------------------------------------------- Kernel Time = 0.015 = 0% User Time = 0.000 = 0% Process Time = 0.015 = 0% Virtual Memory = 9 MB Global Time = 499.209 = 100% Physical Memory = 8 MB pingo.exe -s0 -strip *.png -mp=8 pingo - (122.29s): ----------------------------------------------------------------- 236 files => 128508.08 KB - (15.57%) saved ----------------------------------------------------------------- Kernel Time = 0.015 = 0% User Time = 0.000 = 0% Process Time = 0.015 = 0% Virtual Memory = 9 MB Global Time = 122.331 = 100% Physical Memory = 8 MB pingo.exe -s5 -strip *.png -mp=8 pingo - (487.98s): ----------------------------------------------------------------- 236 files => 148348.89 KB - (17.97%) saved ----------------------------------------------------------------- Kernel Time = 0.031 = 0% User Time = 0.000 = 0% Process Time = 0.031 = 0% Virtual Memory = 9 MB Global Time = 488.028 = 100% Physical Memory = 8 MB proto.exe -s0 -strip *.png proto - (97.50s): ------------------------------------------------------------------------- 236 files => 128497.20 KB - (15.56%) saved ------------------------------------------------------------------------- Kernel Time = 0.000 = 0% User Time = 0.015 = 0% Process Time = 0.015 = 0% Virtual Memory = 9 MB Global Time = 97.553 = 100% Physical Memory = 8 MB proto.exe -s5 -strip *.png proto - (262.32s): ------------------------------------------------------------------------- 236 files => 151476.87 KB - (18.35%) saved ------------------------------------------------------------------------- Kernel Time = 0.031 = 0% User Time = 0.000 = 0% Process Time = 0.031 = 0% Virtual Memory = 9 MB Global Time = 262.347 = 100% Physical Memory = 8 MB Second run: pingo.exe -s0 -strip *.png pingo - (164.35s): ----------------------------------------------------------------- 236 files => 128508.08 KB - (15.57%) saved ----------------------------------------------------------------- Kernel Time = 0.015 = 0% User Time = 0.000 = 0% Process Time = 0.015 = 0% Virtual Memory = 9 MB Global Time = 164.398 = 100% Physical Memory = 8 MB pingo.exe -s5 -strip *.png pingo - (504.40s): ----------------------------------------------------------------- 236 files => 148348.89 KB - (17.97%) saved ----------------------------------------------------------------- Kernel Time = 0.031 = 0% User Time = 0.000 = 0% Process Time = 0.031 = 0% Virtual Memory = 9 MB Global Time = 504.451 = 100% Physical Memory = 8 MB pingo.exe -s0 -strip *.png -mp=8 pingo - (124.96s): ----------------------------------------------------------------- 236 files => 128508.08 KB - (15.57%) saved ----------------------------------------------------------------- Kernel Time = 0.031 = 0% User Time = 0.015 = 0% Process Time = 0.046 = 0% Virtual Memory = 9 MB Global Time = 124.992 = 100% Physical Memory = 8 MB pingo.exe -s5 -strip *.png -mp=8 pingo - (489.69s): ----------------------------------------------------------------- 236 files => 148348.89 KB - (17.97%) saved ----------------------------------------------------------------- Kernel Time = 0.000 = 0% User Time = 0.015 = 0% Process Time = 0.015 = 0% Virtual Memory = 9 MB Global Time = 489.742 = 100% Physical Memory = 8 MB proto.exe -s0 -strip *.png proto - (97.89s): ------------------------------------------------------------------------- 236 files => 128497.20 KB - (15.56%) saved ------------------------------------------------------------------------- Kernel Time = 0.015 = 0% User Time = 0.000 = 0% Process Time = 0.015 = 0% Virtual Memory = 9 MB Global Time = 97.936 = 100% Physical Memory = 8 MB proto.exe -s5 -strip *.png ​proto - (262.13s): ------------------------------------------------------------------------- 236 files => 151476.87 KB - (18.35%) saved ------------------------------------------------------------------------- Kernel Time = 0.000 = 0% User Time = 0.015 = 0% Process Time = 0.015 = 0% Virtual Memory = 9 MB Global Time = 262.171 = 100% Physical Memory = 8 MB
    478 replies | 127422 view(s)
  • ivan2k2's Avatar
    4th July 2020, 15:00
    One day he will say something like: "i gave Gotty few ideas about paq8px, but he dont want to mention me anywhere". The only help he needs is better doctors and/or forum ban.
    22 replies | 1282 view(s)
  • Gotty's Avatar
    4th July 2020, 14:17
    I also don't know how to respond. Sorry, compgt. I know a girl, who when she was still attending kindergarten told us many "true stories" that she owned dragons and distinguished fires (her father is a firefighter) and about many heroic acts she did. It was cute, but sometimes I could not handle her stories properly. Still unsure how to properly handle them. Now she is attending school, and these imaginations of hers slowly fade away. I can understand: she needed attention, more than she got. Maybe since she had a younger brother? I don't know. Today she is more mature. She still needs more attention than an average kid. It's also true that she is extremely intelligent - very smart girl and very active. What you wrote - the style and content - reminds me of her stories. I have no idea why you would write what you wrote, and don't know how to respond properly. Probably the reason is the same: you need attention, and don't get enough? But you are certainly not attending kindergarten, so I'm puzzled. And JamesWasil is also puzzled. We would tell you something useful, give you something that helps, but don't know what. ​ How can we help?
    22 replies | 1282 view(s)
  • cssignet's Avatar
    4th July 2020, 11:04
    ​from user pov, perhaps. from devs, it makes sense to compare stuff in the same scope. anyway, the huge speed difference here would not be about compiler/flags, but an issue which seem to be related to my tool itself (possibly mp or heuristics that would failed on the specific set you have tested). if i could solve this, then pingo *should* be faster, as expected
    168 replies | 41521 view(s)
  • compgt's Avatar
    4th July 2020, 10:38
    I'm not trolling. I don't intend it. I am not sowing discord among you. I am simply stating here the real history of modern computing. That the Philippines was the main venue of its making. (We were a military superpower, my clan. We were NASA/Starfleet.) And it's about justice, me being excluded as co-owner of the tech giants, and me being unpaid of my Hollywood music and movies. I made Star Wars, Star Trek and Transformers, you think that's cool? I say it would be cooler if i am duly paid for making these movies. So i ask million$, even billion$, from them. https://grtamayoblog.blogspot.com/2018/10/hollywood-billion.html?m=1 Well, i'll say it again. I was a child genius in the 1970s to early 80s dictating on computer science matters. Don't be intimidated by genius keyword; well maybe "talented, prolific, precocious" child, though i failed in realtime college in the 1990s. I was designing Intel cpus, DOS and Microsoft Windows, Microsoft Office, Borland compilers, Visual Studio, etc. I moderated on the tech giants because i got shares in them and ownership bonds. I favored Microsoft, IBM and Intel. I accepted AMD and Cyrix, so they existed. This is the timetable i dictated for data compression and encryption too. I co-developed many ZIP compressors with my cousins and aunts (pkzip, WinZip and WinRAR), snappy, arj. The bakery bread-named compressors by Google were probably developed with me; dnd's lzturbo optimization techniques related to cpu processing, even ZSTD webpage in Facebook website is familiar, suggesting i co-developed zstd core algorithm too, like bzip2 and nanozip (i was the co-programmer, our ideas). I created and approved many ciphers too that i now rediscover in Wikipedia. Yet my ownership bonds were not honored! Understand me. I co-own Apple, Microsoft, IBM, Intel, AMD, Yahoo, Google, and Facebook in the 1970s. I remember i was designing the Facebook GUIs while making/shooting the "Star Trek: Enterprise" tv series. These companies, to me, were already existent as we were planning the timetable of their products and technologies. I negotiated among these companies for our future plans. I outlined the computer science timetable in Windows OSes, Visual compilers, and data compression and encryption technologies, among others. I co-own Apple that Wozniak considered me his Boss. I was genius designing computers and algorithms and software. We planned github and LinkedIn too. Then they all stole the corporate side of me, totally pushed me out. But in the 1980s they would still come to me to ask me on computer matters, exploiting me, especially on quantum computing which i and my family pioneered. The fact that they still went to me in the 1980s is proof i was a major player in tech. Others were there to steal my shares and ownerships, wanted to take videos of me saying i didn't own the companies, wanted me to sign papers or agreements with their constant threats. Already owning Apple, Microsoft, IBM, and Intel, i guess my plan was for me to officially be co-founder of Yahoo, Google, and Facebook at their official start up dates in the 1990s and 2000s which they just had to follow--should had followed! I moderated on everything tech that i co-own these tech giants! They're too hardcore greedy that they wanted my ownerships for themselves, brainwashed me. That sums it up. We're talking of immense wealth here. People will do anything to be in Google, for example. Naturally, the taller, bigger, and handsome Americans and Europeans look more credible than me. But modern computer science we designed from here, in the Philippines. See, the freedom to be and to do on the Net is spawning many geniuses' creative works in the many sciences around the globe now. And on top of all these achievements, i knew quantum computing will change the world.
    22 replies | 1282 view(s)
  • JamesWasil's Avatar
    4th July 2020, 04:59
    I'm not sure how to answer this poll. I remember receiving spam emails about this, but I'm not sure if this is supposed to be an effort at trolling or an exercise for mental health awareness?
    22 replies | 1282 view(s)
  • cssignet's Avatar
    4th July 2020, 01:21
    would you please do few more tests, preferably on the same set againts pingo rc2 43 vs proto pingo -s0 -strip pingo -s0 -strip -mp=8 proto -s0 -strip proto -s0 -strip -mp=8 it would be nice if you can post the log from pingo + timer/PP64 instead of pshell. thanks
    478 replies | 127422 view(s)
  • Jarek's Avatar
    4th July 2020, 00:16
    In https://sites.google.com/site/powturbo/entropy-coder the fastest rANS has ~600/1500 MB/s/core enc/dec ... AC 33/22 MB/s/core. But in https://github.com/jkbonfield/rans_static there is faster AC: 240/150 MB/s/core. Generally ANS is much more convenient for vectorization due to state being single number, in AC one needs to process two numbers ... might be doable, but I haven't seen it. Another story is SIMD 4bit adaptive rANS - started in LZNA, simultaneously updates 16 probabilities, and compares with all CDFs to find the proper subrange.
    12 replies | 707 view(s)
  • Sportman's Avatar
    3rd July 2020, 23:04
    Sportman replied to a thread Fp8sk in Data Compression
    TS40.txt: 79,571,976 bytes, 2,152.885 sec., fp8sk1 -8
    17 replies | 565 view(s)
  • CompressMaster's Avatar
    3rd July 2020, 21:37
    Thanks, but I checked videotest in full hd and I am unsatisfied with quality. Thus I need something better - full hd video, and rugged design such as blackview.
    6 replies | 124 view(s)
More Activity