Privacy Statement

Last updated: Jan 26, 2024 by the OpenRank Team

OpenRank ("us", "we", or "our") operates https://openrank.cc (the "Site"). This page informs you of our policies regarding the collection, use and disclosure of Personal Information we receive from users of the Site.

NB: OpenRank is not affiliated with OpenReview.

Personally Identifiable Information (PII)

While using our Site, we will not ask you to provide us with any PII that can be used to contact or identify you. Furthermore, we will not store any PII from third-party conference providers such as OpenReview in the OpenRank database except for as hashed values.

Submission and Author Information

When a conference uses our service, we ask them to provide the following information for the mere purpose of providing the ranking portals for authors:

  • Conference Name and Year
  • Submission ID (hashed), Submission Title, URL Link to Submission
  • Author ID (hashed)
  • Correspondence between hashed Author ID and hashed Submission ID
Each unique (hashed Author ID, Conference Name, Conference Year) tuple (the "record") is stored as in the OpenRank.cc database. Furthermore, for each tuple we will generate a unique random UUID (the "record ID") which will be used to construct the link to each individual's ranking portal. The record ID alone cannot be used to identify any record. Furthermore, information about a record, or even information about the hashed value of this record, cannot be used to identify a record ID (and thus the associated ranking page). In all our operations, the hashed Author ID will not be used at any time. The correspondence between the record and the record ID is kept confidential and is only used when sending back ranking data to conference organizers. The use of UUIDs eliminates the possibiliy of leaking of author identification information at any time during our operation.

Data

Our study involves the rankings provided by the authors as well as the review scores and the accept/reject decisions. The ranking data consist of the record ID, numerical rankings of submissions indexed by submission ID and the last-modified timestamp. The ranking data you submit will stay anonymous as described above, and individual data will never be released. Aggregated statistics of ranking data such as mean, median, and extrema may be released in open-access research articles for academic purposes only. Moreover, all data will be scheduled to be deleted by December 31, 2026. This allows researchers to study long-term effects of rankings. Note that each conference may have more strict policies regarding the collection and use of the data. Please refer to the Privacy Statement of the OpenRank Experiment for conference-specific details.

Cookies

We do not use cookies except for the Cross-Site Request Forgery (CSRF) tokens to provide standard security features.

Security

The security of your Personal Information is important to us, but remember that no method of transmission over the Internet, or method of electronic storage, is 100% secure. While we strive to use commercially acceptable means to protect your Personal Information, we cannot guarantee its absolute security.

Changes To This Privacy Policy

This Privacy Policy is effective as of 26/01/2022 and will remain in effect except with respect to any changes in its provisions in the future, which will be in effect immediately after being posted on this page.

We reserve the right to update or change our Privacy Policy at any time and you should check this Privacy Policy periodically. Your continued use of the Service after we post any modifications to the Privacy Policy on this page will constitute your acknowledgment of the modifications and your consent to abide and be bound by the modified Privacy Policy.

If we make any material changes to this Privacy Policy, we will notify you either through the conference organizers, or by placing a prominent notice on our website.

If you have any questions about this Privacy Policy, please contact us.