Check out what’s in store for SIGGRAPH 2020, 19-23 July 2020 in Washington, D.C.!

Learn More

Art Papers: Reviewer Instructions
and Ethics of Review Process

Reviewer Instructions and Ethics of Review Process

Thank you for agreeing to review a paper for SIGGRAPH. Your reviews have a direct and important impact on the quality of the most important conference in computer graphics and interactive techniques. Your reviews also help the community as a whole to improve the quality of its work. To access review materials and the web review forms, please log in to the Submission Portal using your standard submission account.

What to Look For

Look for the good in the paper. Minor flaws can be corrected and shouldn’t be a reason to reject a paper. Each paper that is accepted should, however, be sound and make a substantial contribution to the field. Please familiarize yourself with the information in the Art Papers Call for Submissions.

Ethics & Professionalism

Please read the Ethics of Review Process section listed below. It is extremely important that we uphold our reputation for treating ideas confidentially and professionally.

By accepting a paper for review, you are guaranteeing to review the following author required submission materials in the approved formats:

  • Abstract of 150 or fewer words summarizing the essential points of the manuscript
  • Representative image in JPG format
  • 3,500-words for Long Paper and 2,500-words for Short Paper (maximum) (including references and figure captions) complete with figures, and proofed, in PDF format for review purposes (need not be camera-ready)

And you are agreeing to review the following optional materials if they are included in the submissions:

  • QuickTime (.mov), AVI, or .mp4 format video file, no greater than 100 MB
  • A glossary if specialized or original terms are used in the manuscript, in either a UTF-16 encoded text file or as RTF.

If you are not willing to make this guarantee, please recuse yourself from reviewing the paper.

Blind Reviews

Authors were asked to take reasonable efforts to hide their identities, including not listing their names or affiliations and omitting acknowledgements. This information will, of course, be included in the published version.

Writing Reviews
  • Take enough time to write a thoughtful and detailed review. Short reviews are much less helpful to the authors and to other reviewers.
  • Be specific and detailed. For example, in the discussion of contribution and references, simply saying “This is well known” or “This has been done by others” is not sufficient. Cite specific publications or public disclosures of work.
  • Be generous. Give the authors ideas for how they can improve their work. Your suggestions may be very specific or more general in nature. Your reviews will be returned to the authors.
  • Remember that other reviewers read your reviews. A thoughtful review not only benefits the authors, but may well benefit you, too.
  • Be thorough. The Explanation of Rating section is a very important part of the review. Your discussion, sometimes more than your score, will help the Art Papers Committee decide which papers to accept.
  • If you do not think the paper is right for the SIGGRAPH Art Papers program, suggest other publication possibilities (journals, conferences, workshops) that would be a better match for the paper.
  • Do not give away your identity.
Online Reviewing

All submissions and their reviews are online. To access submitted papers and materials, log in to the Submission Portal the same way you would to make a submission to SIGGRAPH 2019, using your existing electronic submission account.

When You’re Done

When you have completed your review, you should destroy any paper manuscript that you have printed and/or supporting material (such as images and videos) that you downloaded, as described in the ethics guidelines.



Protect Ideas

As a reviewer for SIGGRAPH, you have the responsibility to protect the confidentiality of the ideas represented in the papers you review. SIGGRAPH submissions are by their very nature not published documents. The work is considered new or proprietary by the authors; otherwise they would not have submitted it.

Of course, their intent is ultimately to publish to the world, but most of the submitted papers will not appear in the SIGGRAPH publications. Thus, it is likely that the paper you have in your hands will be refined further and submitted to some other journal or conference, or even to SIGGRAPH next year. Sometimes the work is still considered confidential by the author’s employers. These organizations do not consider sending a paper to SIGGRAPH for review to constitute a public disclosure. Protection of the ideas in the papers you receive means:

  • Do not discuss or show the paper to anyone else, including colleagues or students, unless you have asked them to write a review or to help with your review.
  • Do not show supporting assets (for example, video, images, etc.) to non-reviewers.
  • Do not use ideas from the papers you review to develop new ones.
  • After the review process, destroy all copies of papers and support assets and erase any implementations you have written to evaluate the ideas in the papers, as well as any results of those implementations.
Avoid Conflicts of Interest

As a reviewer of a SIGGRAPH paper, you have a certain power over the reviewing process. It is important for you to avoid any conflict of interest. Even though you would, of course, act impartially on any paper, there should be absolutely no question about the impartiality of your review. Thus, if you are assigned a paper where your review would create a possible conflict of interest, you should return the paper and not submit a review.

Conflicts of interest include (but are not limited to) situations in which:

  • You work at the same institution as one of the authors.
  • You have been directly involved in the work and will be receiving credit in some way. For example, if you are a member of the author’s thesis committee, and the paper is about their thesis work, then you are involved.
  • You suspect that others might see a conflict of interest in your involvement. For example, even though Microsoft Research in Seattle and Beijing are in some ways more distant than Berkeley and MIT, there is likely to be a perception that they are “both Microsoft,” so folks from one should not review papers from the other.
  • You have collaborated with one of the authors in the past three years (more or less). Collaboration is usually defined as having written a paper or grant proposal together, although you should use your judgment.
  • You were the MFA/MS/PhD advisor of one of the authors or the MFA/MS/PhD advisee of one of the authors. Funding agencies typically consider advisees/advisors to represent a lifetime conflict of interest. SIGGRAPH has traditionally been more flexible than this, but you should think carefully before reviewing a paper you know to be written by a former advisee/advisor.

The blind reviewing process will help hide the authorship of many papers, and senior reviewers will try hard to avoid conflicts. But if you recognize the work or the author and feel it could present a conflict of interest, send the paper back to the senior reviewer as soon as possible so they can find someone else to review it.

Be Serious

Paper publishing at SIGGRAPH is very serious indeed: Careers and reputations hinge on publishing, academic tenure decisions are based on them, and patent infringement cases have discussed whether something was considered novel enough to publish.

This does not mean that we cannot have any fun in the paper sessions. But it does mean that we have a responsibility to be serious in the reviewing process. You should make an effort to do a good review. This is obvious. But one of the complaints we have heard about the SIGGRAPH review process is that some reviews can be so sketchy that it looks like the reviewer did not even seem to take the time to read the paper carefully. A casual or flippant review of a paper that the author has seriously submitted is not appropriate. In the long run, casual reviewing is a most damaging attack on the SIGGRAPH conference. There is no dishonor in being too busy to do a good review, or to realize that you have over-committed yourself and cannot review all the papers you agreed to review. But it is a big mistake to take on too much, and then not back out early enough to allow recovery. If you cannot do a decent job, give the paper back and say so. But please, do it early so that the senior reviewer has time to select another reviewer before the deadline.

Be Professional

Belittling or sarcastic comments are unnecessary in the reviewing process. The most valuable comments in a review are those that help the authors understand the shortcomings of their work and how they might improve it. If you intensely dislike a paper, give it a low score. That makes a sufficient statement.

In Summary

Adherence to ethics makes the whole reviewing process more complicated and sometimes less efficient. But convenience, efficiency, and expediency are not good reasons to contravene ethics. It is precisely at those times when it would be easier or more efficient to bend the rules that it is most important to do the right thing. Ultimately, spending that energy and time is an investment in the long-term health of the art papers, the conference, and the community.

Contact Us