Results 1 to 14 of 14

Thread: GDC Competition: Notices

  1. #1
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts

    GDC Competition: Notices

    Hi,
    Finally, a new contest for lossless data compression has arrived -- the Global Data Compression Competition.
    https://globalcompetition.compression.ru/
    This thread is only for notices related to the competition.
    There is another thread for discussions.

  2. Thanks (3):

    Alexander Rhatushnyak (17th June 2020),Hakan Abbas (21st June 2020),JamesWasil (17th June 2020)

  3. #2
    Administrator Shelwien's Avatar
    Join Date
    May 2008
    Location
    Kharkov, Ukraine
    Posts
    4,007
    Thanks
    301
    Thanked 1,322 Times in 755 Posts
    I'd like to clarify that this competition has 12 separate tasks ((3 data sets + blockwise test) x 3 speed categories), each with its own prizes.
    Its not necessary to make a universal solution.
    Also authors of existing codecs, including lossless image codecs, can just send their work as is, there's no need to do something special
    (except for blockwise test).
    We'd prefer if at least all relevant open-source codecs would be submitted by authors - to avoid random people claiming their prizes.

  4. Thanks (4):

    Hakan Abbas (21st June 2020),Mike (21st June 2020),schnaader (21st June 2020),vteromero (22nd June 2020)

  5. #3
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    Reference speed data for Test 2 (images) was added in https://globalcompetition.compression.ru/rules/

    Note that we use and will use a RAM disk for file I/O.

    There is a wording change in the Test 3 (mixed data) description. It does not really matter since this part is still not final. There are no approved Test 3 and Test 4 at the moment.

  6. #4
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    Test 3 and Test 4 sets are now available.
    Small wording changes in set descriptions.
    http://globalcompetition.compression.ru/rules/#test-set-description



  7. Thanks:

    Mike (30th June 2020)

  8. #5
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    Results for a number of publicly available compressors are published as reference data for Tests 1, 2, 3.
    Hopefully we will have a sufficient number of participants 1-2 months later to build the real leaderboards.
    https://globalcompetition.compression.ru/#leaderboards
    Also API for Test 4 is defined.
    https://globalcompetition.compression.ru/test4api/

  9. Thanks (3):

    Hakan Abbas (31st July 2020),hexagone (11th August 2020),Mike (31st July 2020)

  10. #6
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    We got submissions based on 3rd-party source code which perform marginally better (if at all) than the originals. I'd like to remind our conditions:
    http://globalcompetition.compression...t-requirements
    In particular:
    "Each participant guarantees that the submitted compressor or compressors are that participant’s own work or, if they’re based on third-party source code, they differ essentially from that code and the participant has received all necessary permissions to modify and submit the code to this competition. Each participant must also guarantee that the submitted compressor or compressors violate no third-party intellectual-property rights."

    The spirit of the condition is that your modifications should produce a different compressor which performs very different from the original, and you don't abuse intellectual property rights and copyrights of other people.
    We don't have any exact objective criteria what does "differ essentially" mean, our decisions on this are subjective, but, to give a rule of thumb, don't have any hope if the modified compressor shows compression ratio improvements which are worse than 3% for the same (or similar) speed in case of public parts of the tests.

    Do something your own, don't mechanically train and tune.
    Last edited by Ms1; 28th August 2020 at 22:05.

  11. Thanks (2):

    lz77 (11th August 2020),vteromero (18th August 2020)

  12. #7
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    http://globalcompetition.compression.ru/#leaderboards
    Reference results for Test 4 (32 KiB blocks) are added.
    We changed presets for several reference compressors in other tests in order to improve the compression ratio or score within the processing time limits.
    Results for few new submissions are added as well.

  13. #8
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    http://globalcompetition.compression.ru/#leaderboards
    Leaderboards are updated, see Test 1 rapid, Test 2 rapid and balanced.
    Test 2 (images) balanced category has a new intermediate leader.

    I want to attract attention that any submitted compressor should be able to losslessly process data of all 4 tests in order to get a ranked place even if you submit it for one test/category only.
    Last edited by Ms1; 3rd October 2020 at 17:44.

  14. Thanks:

    Mike (30th September 2020)

  15. #9
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    1. Clarifications on the "Every compressor must be able to encode and bit-accurately decode (decompress) all four test sets" condition:

    It's not necessary that the submitted program can compress data of all test sets, it just should be able to process them and restore losslessly.
    In particular, for an image compressor you can treat the input sequence as a non-rectangular image or, bluntly, just copy non-image data.

    Test 4 (blocks) data is processed as one 1 GB file for this check.


    2. Note on conducting Test 2 (images):
    Data is processed file by file. We run a given compressor for each PNM file individually.

  16. Thanks (2):

    Hakan Abbas (3rd October 2020),Shelwien (4th October 2020)

  17. #10
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    1. Leaderboards are updated overnight and during the day. Several strong new and updated submissions. In particular, one new submission for the long-neglected block compression test.
    2. The new website design is finalized (hopefully). Grammar and style text changes throughout the website.
    3. The explicit legal part hopefully addresses fears and uncertainties.
    4. FAQ is updated.

    Note: the introduced registration is not really necessary to take part in the competition, all the necessary information can be sent using email as before. This new registration mechanism is used to hide data links and count newly interested people.

    I plan and hope that the next update of the interim results will be 2 weeks later.

  18. Thanks:

    Mike (15th October 2020)

  19. #11
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    1. Leaderboards are updated. We deleted most of reference lines in the tables for full (100%) tests.
    2. There will be one more interim update in November, probably by Nov. 15. To be announced.

  20. Thanks:

    Hakan Abbas (30th October 2020)

  21. #12
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    1. The last interim update of the leaderboards is planned to be on Nov. 13 or Nov. 16. In order to be included in this update a submission should be received by Nov. 10 or Nov. 11 at the latest. If somebody is lying in ambush, take that into account depending on your strategy.
    2. Let me remind that the submission deadline is November 20, midnight GMT. If _technical_ issues arise with a submission sent on time, they may be solved until November 27, midnight GMT.
    3. We will not disclose any new results after the last interim update and until at least November 28th.

  22. Thanks (2):

    encode (10th November 2020),Hakan Abbas (10th November 2020)

  23. #13
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    Note on "Rapid" categories: the time limit of 40 sec is calculated for c_time + d_time, just like for all the other categories. Decoding time is twice as important as encoding time only for ranking:
    f = c_time + 2 * d_time + (1 / 1,000,000) * c_full_size

  24. #14
    Member
    Join Date
    Apr 2020
    Location
    Russia
    Posts
    43
    Thanks
    0
    Thanked 31 Times in 14 Posts
    1. Leaderboards updated:
    http://globalcompetition.compression.ru/#leaderboards

    We don't disclose command line parameters on purpose to avoid leaking of important information like memory use, dictionary size, context model order and so on. This info will be published in the final leaderboards.

    2. Submission closes November 20, midnight GMT (23:59:59). Last call!

  25. Thanks:

    Mike (14th November 2020)

Similar Threads

  1. Competition on compression ($)
    By Sshingen in forum Data Compression
    Replies: 8
    Last Post: 10th August 2013, 07:02
  2. Compression Competition -- $15,000 USD
    By Fixee in forum Data Compression
    Replies: 153
    Last Post: 27th March 2013, 16:38

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •