Tuesday, May 17, 2011

Rejecting journal submissions

I am getting tired of rejecting submissions to SIAM Journal of Computing. I keep getting referee reports along the lines of "interesting work, but not quite up to the very high standards of SiComp". What does that mean? It's not like a conference, where we simultaneously see all the submissions and can easily put them side by side and try to see which ones we like better. Instead, it's some kind of absolute threshold that apparently exists in people's heads. Because the mandates of SiComp specify that the journal must be extremely selective, I have been following referees' advice and rejecting papers that are fine papers albeit clearly not contenders for best paper awards at STOC or FOCS. But I'm not sure I believe in those hypothetical thresholds.

When I worked for Algorithmica, I normally did not accept a submission unless there was at least one referee who stated with confidence: "this is a clear accept". But for SIAM, hardly anyone seems to be willing to be so affirmative. The journal is supposed to be for the "most significant work taking place", and that is supposed to translate into "significantly more selective than STOC/FOCS/SODA", but it's depressing to reject papers that are clearly worth publishing somewhere.

So, I am looking for more objective criteria. For example, between the time when the result appeared on arxiv or at a conference, and the time when it was submitted to the journal, has the paper been read? Is the result known by people in the field? If so, then it's a sign of impact and maybe that should be compelling evidence to accept the paper. Could I ask referees to compare the paper to similar results previously published in SiComp or in JACM? That would be extra work for them. Could we request authors to provide a short list of comparable papers previously published there? Then at least I would have a benchmark and would not be working in that murky area where the "good, but not good enough" assessments sound so arbitrary.

3 comments:

  1. I don't have any suggestion for setting the threshold, but I do have a suggestion for the future of papers that are below the threshold but still worthy of publication.
    They could be sent along with the referee reports to a less demanding journal (possibly published by the same publisher, if that helps);
    The editor of the lesser journal could then decide to accept (or not) the paper based on the existing reports. This would save a lot of referee time, shorten the publication cycle and decrease fear or rejection.

    ReplyDelete
  2. Pascal, that might be efficient but I doubt that an editor would agree to having his journal officially stamped "second class"...

    ReplyDelete
  3. Actually, I have had that happen before to me and I don't think it's a big deal (and, as an author, it is nice to have your paper accepted to appear somewhere rather than have to go through the 4+ month reviewing process again from scratch). Generally there is a "pecking order" of journals that everyone is aware of, and we are all adults...

    ReplyDelete