ÿþ<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><title>Comment Summary</title><link media="all" href="css/Export.css" type="text/css" rel="stylesheet" charset="utf-8" /><meta http-equiv="Content-Type" content="text/html; charset=utf-8" /><meta http-equiv="Content-Language" content="en" /></head><body style="margin-left:15px;margin-right:15px;margin-top:15px;"><a href="SurveySummary.html" class="NormBtn">&laquo; Back to Summary</a><div style="margin-top:15px;"><table class="rsltsmry" cellspacing="1" cellpadding="0" border="0"><thead><tr><th class="hdr" colspan="8">Do you think the ICML2010 reviews were different in quality from those at related conferences?</th></tr><tr><th class="hdr dflt">#</th><th class="hdr dflt">Response&nbsp;Date</th><th class="hdr dflt" style="width:80%;">What conference are you comparing to and what is the subject area?</th></tr></thead><tbody id="xtrows"><tr><td>1</td><td style="white-space:nowrap;">Jun 10, 2010 7:06 PM</td><td>this year's ecml/pkdd</td></tr><tr><td>2</td><td style="white-space:nowrap;">Jun 10, 2010 7:10 PM</td><td>NIPS</td></tr><tr><td>3</td><td style="white-space:nowrap;">Jun 10, 2010 7:15 PM</td><td>Reviews everywhere have a lot of variance. Hard to compare to an 'average'.</td></tr><tr><td>4</td><td style="white-space:nowrap;">Jun 10, 2010 7:21 PM</td><td>aaai</td></tr><tr><td>5</td><td style="white-space:nowrap;">Jun 10, 2010 7:26 PM</td><td>SIGIR</td></tr><tr><td>6</td><td style="white-space:nowrap;">Jun 10, 2010 8:23 PM</td><td>NIPS</td></tr><tr><td>7</td><td style="white-space:nowrap;">Jun 10, 2010 8:24 PM</td><td>ICDM</td></tr><tr><td>8</td><td style="white-space:nowrap;">Jun 10, 2010 8:25 PM</td><td>my comparison is with graphics conferences, e.g., eurographics, siggraph</td></tr><tr><td>9</td><td style="white-space:nowrap;">Jun 10, 2010 8:34 PM</td><td>AISTATS-2010.</td></tr><tr><td>10</td><td style="white-space:nowrap;">Jun 10, 2010 9:03 PM</td><td>NIPS, AISTATS. I had one outstanding ICML reviewer (negative review), one good one (positive review) and one really poor one (negative and nonsensical). I submitted a paper that was between areas (Bayesian nonparametrics and stochastic optimization) and had difficulty getting capable reviewers. There needs to be a way to get papers like this split between area chairs and possibly have a feedback/rating system for reviewers (those with low marks would not get asked to review again in a certain area).</td></tr><tr><td>11</td><td style="white-space:nowrap;">Jun 10, 2010 9:05 PM</td><td>ecml pkdd 2010</td></tr><tr><td>12</td><td style="white-space:nowrap;">Jun 10, 2010 9:06 PM</td><td>ECML, GECCO, AAMAS, AAAI Reinforcement learning</td></tr><tr><td>13</td><td style="white-space:nowrap;">Jun 10, 2010 9:26 PM</td><td>AAAI, IJCAI</td></tr><tr><td>14</td><td style="white-space:nowrap;">Jun 10, 2010 9:56 PM</td><td>UAI 2010. Subject Area: Gaussian Processes</td></tr><tr><td>15</td><td style="white-space:nowrap;">Jun 10, 2010 10:48 PM</td><td>NIPS, Siggraph.</td></tr><tr><td>16</td><td style="white-space:nowrap;">Jun 10, 2010 10:51 PM</td><td>I find NIPS marginally worse as far as craziness. COLT reviewers seem to be stronger, but their viewpoint often doesn't make sense w.r.t. what is significant work.</td></tr><tr><td>17</td><td style="white-space:nowrap;">Jun 10, 2010 11:59 PM</td><td>E.g., COLT 2010, reinforcement learning</td></tr><tr><td>18</td><td style="white-space:nowrap;">Jun 11, 2010 3:03 AM</td><td>AAAI and SDM machine learning papers</td></tr><tr><td>19</td><td style="white-space:nowrap;">Jun 11, 2010 6:21 AM</td><td>CVPR, ICCV, NIPS -- vision &amp; graphical models.</td></tr><tr><td>20</td><td style="white-space:nowrap;">Jun 11, 2010 8:09 AM</td><td>CVPR, ICCV, NIPS. Computer Vision and Machine Learning</td></tr><tr><td>21</td><td style="white-space:nowrap;">Jun 11, 2010 8:20 AM</td><td>first submission in this type of conference...</td></tr><tr><td>22</td><td style="white-space:nowrap;">Jun 11, 2010 8:42 AM</td><td>ECML - Machine learning</td></tr><tr><td>23</td><td style="white-space:nowrap;">Jun 11, 2010 11:32 AM</td><td>ACM KDD, ECML PKDD</td></tr><tr><td>24</td><td style="white-space:nowrap;">Jun 11, 2010 1:03 PM</td><td>Again, due to variance I don't dare to generalize...</td></tr><tr><td>25</td><td style="white-space:nowrap;">Jun 11, 2010 1:19 PM</td><td>Same remark.</td></tr><tr><td>26</td><td style="white-space:nowrap;">Jun 11, 2010 1:39 PM</td><td>nips</td></tr><tr><td>27</td><td style="white-space:nowrap;">Jun 11, 2010 1:47 PM</td><td>holds for review 1 in the first phase and review 3 in the second phase. the other review in phase 1 was poor.</td></tr><tr><td>28</td><td style="white-space:nowrap;">Jun 11, 2010 1:51 PM</td><td>ICML reviews are much better than SIGIR.</td></tr><tr><td>29</td><td style="white-space:nowrap;">Jun 11, 2010 1:57 PM</td><td>NIPS, KDD ... machine learning, data mining</td></tr><tr><td>30</td><td style="white-space:nowrap;">Jun 11, 2010 1:58 PM</td><td>NIPS</td></tr><tr><td>31</td><td style="white-space:nowrap;">Jun 11, 2010 2:03 PM</td><td>AAAI, CogSci</td></tr><tr><td>32</td><td style="white-space:nowrap;">Jun 11, 2010 2:31 PM</td><td>I guess we were simply unlucky this year.</td></tr><tr><td>33</td><td style="white-space:nowrap;">Jun 11, 2010 2:51 PM</td><td>Nips</td></tr><tr><td>34</td><td style="white-space:nowrap;">Jun 11, 2010 2:58 PM</td><td>nips</td></tr><tr><td>35</td><td style="white-space:nowrap;">Jun 11, 2010 3:38 PM</td><td>My (rejected) paper was about manifold learning which fits ICML well. My home conference is CVPR. I think that papers that fit the core areas of CVPR usually receive more nuanced reviews.</td></tr><tr><td>36</td><td style="white-space:nowrap;">Jun 11, 2010 4:38 PM</td><td>NIPS, MACHINE LEARNING</td></tr><tr><td>37</td><td style="white-space:nowrap;">Jun 11, 2010 4:56 PM</td><td>I'm comparing against NIPS, ECML and AAAI in the area of reinforcement learning</td></tr><tr><td>38</td><td style="white-space:nowrap;">Jun 11, 2010 6:15 PM</td><td>nips (about the same), ecml (better), iconip (better)</td></tr><tr><td>39</td><td style="white-space:nowrap;">Jun 11, 2010 8:44 PM</td><td>Theory, STOC/SODA etc.</td></tr><tr><td>40</td><td style="white-space:nowrap;">Jun 12, 2010 12:27 AM</td><td>AAAI, NIPS</td></tr><tr><td>41</td><td style="white-space:nowrap;">Jun 12, 2010 3:57 AM</td><td>NIPS, CVPR, AISTATS</td></tr><tr><td>42</td><td style="white-space:nowrap;">Jun 12, 2010 10:57 AM</td><td>NIPS: machine learning, CVPR/ICCV/ECCV: computer vision</td></tr><tr><td>43</td><td style="white-space:nowrap;">Jun 12, 2010 11:14 AM</td><td>NIPS, AiSTAT</td></tr><tr><td>44</td><td style="white-space:nowrap;">Jun 12, 2010 1:41 PM</td><td>SDM, KDD, ECML</td></tr><tr><td>45</td><td style="white-space:nowrap;">Jun 12, 2010 2:39 PM</td><td>NIPS</td></tr><tr><td>46</td><td style="white-space:nowrap;">Jun 12, 2010 11:27 PM</td><td>The second-phase reviews have been consistently poor, and this is frustrating because there is no associated response period. Otherwise &quot;about the same&quot;.</td></tr><tr><td>47</td><td style="white-space:nowrap;">Jun 13, 2010 1:15 AM</td><td>Can't say. This is my first Machine Learning submission.</td></tr><tr><td>48</td><td style="white-space:nowrap;">Jun 13, 2010 5:27 PM</td><td>KDD, ICDM, classification, online learning</td></tr><tr><td>49</td><td style="white-space:nowrap;">Jun 14, 2010 4:34 AM</td><td>AISTATS, NIPS; kernel methods sparse methods, supervised learning.</td></tr><tr><td>50</td><td style="white-space:nowrap;">Jun 14, 2010 3:47 PM</td><td>i hoped the icml reviews were substantially better, unfortunately they were not</td></tr><tr><td>51</td><td style="white-space:nowrap;">Jun 15, 2010 9:25 AM</td><td>NIPS</td></tr><tr><td>52</td><td style="white-space:nowrap;">Jun 15, 2010 2:23 PM</td><td>In my personal experience, ICDM has typically offered more helpful feedback and more reasoned reviews than ICML.</td></tr><tr><td>53</td><td style="white-space:nowrap;">Jun 19, 2010 5:18 AM</td><td>NIPS,IJCNN. The subject area is the neural networks.</td></tr><tr><td>54</td><td style="white-space:nowrap;">Jun 25, 2010 6:44 AM</td><td>NIPS, KDD, SDM, ICDM</td></tr><tr><td>55</td><td style="white-space:nowrap;">Jun 25, 2010 8:30 AM</td><td>Depends on the conference, in some of them they are about the same level, and in some others they are worse</td></tr></tbody></table></div></body></html>