Result Summary for Survey:ICML 2010 Feedback

ICML 2010 Feedback

1. Did you serve as an area chair at ICML 2010?
	answered question		560
	skipped question		0
		Response Percent	Response Count
Yes		4.8%	27
No		95.2%	533

2. Did you serve as a reviewer at ICML 2010?
	answered question		560
	skipped question		0
		Response Percent	Response Count
Yes		34.8%	195
No		65.2%	365

3. Are you an author of a rejected ICML 2010 paper?
	answered question		560
	skipped question		0
		Response Percent	Response Count
Yes		51.6%	289
No		48.4%	271

4. Are you an author of an accepted ICML 2010 paper?
	answered question		560
	skipped question		0
		Response Percent	Response Count
Yes		30.5%	171
No		69.5%	389

5. Are you going to attend ICML 2010 in Haifa?
	answered question		560
	skipped question		0
		Response Percent	Response Count
Yes		27.3%	153
No		72.7%	407
viewMy main reason for not attending is:			305

6. What model do you prefer for assigning area chairs to papers? (multiple selections possible)
	answered question		460
	skipped question		100
		Response Percent	Response Count
Authors supply area keywords, and area chairs bid on papers primarily in the areas they agreed to cover. The assignment of area chairs to areas is public to the authors. (this year's model)		75.4%	347
Authors supply area keywords, and the system matches area chairs to papers by keyword overlap.		18.7%	86
Authors bid on area chairs. (last year's model)		17.0%	78
viewI have the following alternative proposal:		3.3%	15

7. What model do you prefer for assigning reviewers to papers? (multiple selections possible)
	answered question		470
	skipped question		90
		Response Percent	Response Count
Two-phase model mixing bidding and manual assignment. In Phase I, reviewer bidding is used to assign two reviewers to each paper. In Phase II, area chairs manually assign additional reviewers based on the Phase I reviews and the author rebuttal. (this year's model)		60.6%	285
Two-phase model like above, but area chairs manually assign reviewers in both phases.		17.7%	83
Single-phase model, where reviewers are assigned to papers based on their bids.		16.8%	79
Single-phase model, where reviewers are manually assigned by the area chairs.		11.7%	55
viewI have the following alternative proposal:		5.7%	27

8. What reviewing model do you prefer?
	answered question		473
	skipped question		87
		Response Percent	Response Count
double-blind (reviewers do not know the authors, and vice versa) (as this year)		81.2%	384
single-blind (reviewers know the authors, but authors don't know the reviewers)		12.1%	57
open (reviewers and authors know each other's identities)		6.8%	32

9. Do you think the Phase I reviews were different in quality from the Phase II reviews?
	answered question		439
	skipped question		121
		Response Percent	Response Count
Phase I substantially better		10.7%	47
Phase I slightly better		15.5%	68
Both were the same		45.1%	198
Phase II slightly better		19.1%	84
Phase II substantially better		9.6%	42

10. Do you think the ICML2010 reviews were different in quality from the reviews at previous ICMLs?
	answered question		369
	skipped question		191
		Response Percent	Response Count
ICML2010 substantially better		4.6%	17
ICML2010 slightly better		14.1%	52
About the same		67.2%	248
Previous ICMLs slightly better		9.2%	34
Previous ICMLs substantially better		4.9%	18
viewAdditional comments:			57

11. Do you think the ICML2010 reviews were different in quality from those at related conferences?
	answered question		427
	skipped question		133
		Response Percent	Response Count
ICML2010 substantially better		11.5%	49
ICML2010 slightly better		26.7%	114
About the same		45.2%	193
Other conferences slightly better		12.2%	52
Other conferences substantially better		4.4%	19
viewWhat conference are you comparing to and what is the subject area?			98

12. What do you think of early rejects by area chairs (i.e., rejecting a paper based on two reviews and author rebuttal)?਀㰀⼀猀瀀愀渀㸀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀⼀琀栀攀愀搀㸀㰀琀昀漀漀琀㸀㰀琀爀㸀㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀愀渀猀眀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀愀渀猀眀攀爀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㐀㘀㜀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀㸀㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀猀欀椀瀀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀猀欀椀瀀瀀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㤀㌀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀昀漀漀琀㸀㰀琀戀漀搀礀㸀㰀琀爀㸀㰀琀栀挀氀愀猀猀㴀∀搀昀氀琀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀☀渀戀猀瀀㬀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀挀渀琀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀䌀漀甀渀琀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀䤀漀戀樀攀挀琀琀漀攀愀爀氀礀爀攀樀攀挀琀猀⸀ 刀攀樀攀挀琀攀搀瀀愀瀀攀爀猀猀栀漀甀氀搀最攀琀愀琀氀攀愀猀琀琀栀爀攀攀爀攀瘀椀攀眀猀⸀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㄀㜀⸀㔀㔀㠀㠀㠀㘀㔀　㤀㘀㌀㘀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㄀㜀⸀㘀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㠀㈀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀戀㸀㰀猀瀀愀渀㸀䤀猀甀瀀瀀漀爀琀攀愀爀氀礀爀攀樀攀挀琀猀Ⰰ 戀甀琀漀渀氀礀椀渀瘀攀爀礀挀氀攀愀爀挀愀猀攀猀 ⠀愀瀀瀀爀漀砀椀洀愀琀攀氀礀㄀㌀─ 漀昀猀甀戀洀椀猀猀椀漀渀猀琀栀椀猀礀攀愀爀⤀⸀㰀⼀猀瀀愀渀㸀㰀⼀戀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㜀㈀⸀㄀㘀㈀㜀㐀　㠀㤀㤀㌀㔀㜀㘀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㜀㈀⸀㈀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㌀㌀㜀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀䄀爀攀愀挀栀愀椀爀猀猀栀漀甀氀搀洀愀欀攀洀漀爀攀氀椀戀攀爀愀氀甀猀攀漀昀攀愀爀氀礀爀攀樀攀挀琀猀⸀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㄀　⸀㈀㜀㠀㌀㜀㈀㔀㤀㄀　　㘀㐀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㄀　⸀㌀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㐀㠀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀戀漀搀礀㸀㰀⼀琀愀戀氀攀㸀㰀⼀搀椀瘀㸀㰀⼀搀椀瘀㸀㰀搀椀瘀猀琀礀氀攀㴀∀洀愀爀最椀渀ⴀ戀漀琀琀漀洀㨀㄀㔀瀀砀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀䌀漀渀琀愀椀渀攀爀∀ 㸀㰀琀愀戀氀攀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀∀ 挀攀氀氀猀瀀愀挀椀渀最㴀∀　∀ 挀攀氀氀瀀愀搀搀椀渀最㴀∀　∀㸀㰀琀栀攀愀搀㸀㰀琀爀挀氀愀猀猀㴀∀琀琀氀∀㸀㰀琀栀挀氀愀猀猀㴀∀栀搀爀∀ 挀漀氀猀瀀愀渀㴀∀㐀∀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㄀㌀⸀ 圀栀愀琀搀漀礀漀甀琀栀椀渀欀漀昀攀愀爀氀礀愀挀挀攀瀀琀猀 ⠀椀⸀攀⸀Ⰰ 愀挀挀攀瀀琀椀渀最愀瀀愀瀀攀爀愀昀琀攀爀漀渀氀礀琀眀漀爀攀瘀椀攀眀猀愀渀搀愀甀琀栀漀爀爀攀戀甀琀琀愀氀⤀㼀㰀⼀猀瀀愀渀㸀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀⼀琀栀攀愀搀㸀㰀琀昀漀漀琀㸀㰀琀爀㸀㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀愀渀猀眀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀愀渀猀眀攀爀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㐀㘀㘀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀㸀㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀猀欀椀瀀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀猀欀椀瀀瀀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㤀㐀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀昀漀漀琀㸀㰀琀戀漀搀礀㸀㰀琀爀㸀㰀琀栀挀氀愀猀猀㴀∀搀昀氀琀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀☀渀戀猀瀀㬀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀挀渀琀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀䌀漀甀渀琀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀戀㸀㰀猀瀀愀渀㸀圀攀猀栀漀甀氀搀渀漀琀愀氀氀漀眀琀栀椀猀 ⠀愀猀椀琀眀愀猀琀栀椀猀礀攀愀爀⤀⸀㰀⼀猀瀀愀渀㸀㰀⼀戀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㔀㤀⸀㘀㔀㘀㘀㔀㈀㌀㘀　㔀㄀㔀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㔀㤀⸀㜀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㈀㜀㠀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀圀攀猀栀漀甀氀搀愀氀氀漀眀琀栀椀猀昀漀爀瀀愀瀀攀爀猀眀椀琀栀攀砀挀攀瀀琀椀漀渀愀氀氀礀最漀漀搀爀攀瘀椀攀眀猀⸀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㐀　⸀㌀㐀㌀㌀㐀㜀㘀㌀㤀㐀㠀㔀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㐀　⸀㌀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㄀㠀㠀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀戀漀搀礀㸀㰀⼀琀愀戀氀攀㸀㰀⼀搀椀瘀㸀㰀⼀搀椀瘀㸀㰀搀椀瘀猀琀礀氀攀㴀∀洀愀爀最椀渀ⴀ戀漀琀琀漀洀㨀㄀㔀瀀砀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀䌀漀渀琀愀椀渀攀爀∀ 㸀㰀琀愀戀氀攀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀∀ 挀攀氀氀猀瀀愀挀椀渀最㴀∀　∀ 挀攀氀氀瀀愀搀搀椀渀最㴀∀　∀㸀㰀琀栀攀愀搀㸀㰀琀爀挀氀愀猀猀㴀∀琀琀氀∀㸀㰀琀栀挀氀愀猀猀㴀∀栀搀爀∀ 挀漀氀猀瀀愀渀㴀∀㐀∀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㄀㐀⸀ 䐀漀礀漀甀琀栀椀渀欀琀栀攀愀甀琀栀漀爀昀攀攀搀戀愀挀欀栀愀猀愀渀椀渀昀氀甀攀渀挀攀漀渀琀栀攀搀攀挀椀猀椀漀渀漀昀愀挀挀攀瀀琀愀渀挀攀⼀爀攀樀攀挀琀椀漀渀㼀㰀⼀猀瀀愀渀㸀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀⼀琀栀攀愀搀㸀㰀琀昀漀漀琀㸀㰀琀爀㸀㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀愀渀猀眀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀愀渀猀眀攀爀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㐀㘀㜀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀㸀㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀猀欀椀瀀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀猀欀椀瀀瀀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㤀㌀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀昀漀漀琀㸀㰀琀戀漀搀礀㸀㰀琀爀㸀㰀琀栀挀氀愀猀猀㴀∀搀昀氀琀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀☀渀戀猀瀀㬀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀挀渀琀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀䌀漀甀渀琀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀嘀攀爀礀猀琀爀漀渀最椀渀昀氀甀攀渀挀攀⸀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㈀⸀㤀㤀㜀㠀㔀㠀㘀㜀㈀㌀㜀㘀㠀㜀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㌀⸀　─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㄀㐀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀匀甀戀猀琀愀渀琀椀愀氀椀渀昀氀甀攀渀挀攀⸀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㄀㜀⸀㔀㔀㠀㠀㠀㘀㔀　㤀㘀㌀㘀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㄀㜀⸀㘀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㠀㈀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀戀㸀㰀猀瀀愀渀㸀䴀愀爀最椀渀愀氀椀渀昀氀甀攀渀挀攀⸀㰀⼀猀瀀愀渀㸀㰀⼀戀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㔀㤀⸀㌀㄀㐀㜀㜀㔀㄀㘀　㔀㤀㤀㘀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㔀㤀⸀㌀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㈀㜀㜀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀一漀椀渀昀氀甀攀渀挀攀⸀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㈀　⸀㄀㈀㠀㐀㜀㤀㘀㔀㜀㌀㠀㜀㘀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㈀　⸀㄀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㤀㐀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀戀漀搀礀㸀㰀⼀琀愀戀氀攀㸀㰀⼀搀椀瘀㸀㰀⼀搀椀瘀㸀㰀搀椀瘀猀琀礀氀攀㴀∀洀愀爀最椀渀ⴀ戀漀琀琀漀洀㨀㄀㔀瀀砀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀䌀漀渀琀愀椀渀攀爀∀ 㸀㰀琀愀戀氀攀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀∀ 挀攀氀氀猀瀀愀挀椀渀最㴀∀　∀ 挀攀氀氀瀀愀搀搀椀渀最㴀∀　∀㸀㰀琀栀攀愀搀㸀㰀琀爀挀氀愀猀猀㴀∀琀琀氀∀㸀㰀琀栀挀氀愀猀猀㴀∀栀搀爀∀ 挀漀氀猀瀀愀渀㴀∀㐀∀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㄀㔀⸀ 圀栀攀渀搀漀礀漀甀琀栀椀渀欀猀栀漀甀氀搀愀甀琀栀漀爀猀戀攀愀猀欀攀搀琀漀瀀爀漀瘀椀搀攀琀栀攀椀爀昀攀攀搀戀愀挀欀㼀㰀⼀猀瀀愀渀㸀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀⼀琀栀攀愀搀㸀㰀琀昀漀漀琀㸀㰀琀爀㸀㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀愀渀猀眀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀愀渀猀眀攀爀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㐀㘀㘀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀㸀㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀猀欀椀瀀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀猀欀椀瀀瀀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㤀㐀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀昀漀漀琀㸀㰀琀戀漀搀礀㸀㰀琀爀㸀㰀琀栀挀氀愀猀猀㴀∀搀昀氀琀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀☀渀戀猀瀀㬀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀挀渀琀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀䌀漀甀渀琀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀戀㸀㰀猀瀀愀渀㸀䄀昀琀攀爀倀栀愀猀攀䤀漀昀琀栀攀爀攀瘀椀攀眀椀渀最瀀爀漀挀攀猀猀Ⰰ 猀漀椀琀挀愀渀椀渀昀漀爀洀琀栀攀猀攀氀攀挀琀椀漀渀漀昀倀栀愀猀攀䤀䤀爀攀瘀椀攀眀攀爀猀愀渀搀椀猀椀洀洀攀搀椀愀琀攀氀礀愀瘀愀椀氀愀戀氀攀搀甀爀椀渀最琀栀攀搀椀猀挀甀猀猀椀漀渀⸀ ⠀琀栀椀猀礀攀愀爀✀猀洀漀搀攀氀⤀㰀⼀猀瀀愀渀㸀㰀⼀戀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㔀㄀⸀㤀㌀㄀㌀㌀　㐀㜀㈀㄀　㌀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㔀㄀⸀㤀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㈀㐀㈀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀䄀昀琀攀爀倀栀愀猀攀䤀䤀漀昀琀栀攀爀攀瘀椀攀眀椀渀最瀀爀漀挀攀猀猀Ⰰ 猀漀愀甀琀栀漀爀猀挀愀渀爀攀猀瀀漀渀搀琀漀愀氀氀爀攀瘀椀攀眀猀Ⰰ 渀漀琀樀甀猀琀琀栀攀倀栀愀猀攀䤀爀攀瘀椀攀眀猀⸀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㄀㤀⸀㔀㈀㜀㠀㤀㘀㤀㤀㔀㜀　㠀㈀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㄀㤀⸀㔀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㤀㄀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀䄀猀欀昀漀爀愀甀琀栀漀爀昀攀攀搀戀愀挀欀戀漀琀栀愀昀琀攀爀倀栀愀猀攀䤀愀渀搀倀栀愀猀攀䤀䤀Ⰰ 攀瘀攀渀琀栀漀甀最栀琀栀攀瀀愀瀀攀爀猀甀戀洀椀猀猀椀漀渀搀攀愀搀氀椀渀攀眀漀甀氀搀渀攀攀搀琀漀戀攀洀漀瘀攀搀琀漀䨀愀渀甀愀爀礀㄀㔀⸀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㄀㐀⸀㌀㜀㜀㘀㠀㈀㐀　㌀㐀㌀㌀㔀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㄀㐀⸀㐀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㘀㜀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀䐀漀渀漀琀愀猀欀昀漀爀愀甀琀栀漀爀昀攀攀搀戀愀挀欀愀琀愀氀氀⸀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㜀⸀㈀㤀㘀㄀㌀㜀㌀㌀㤀　㔀㔀㜀㤀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㜀⸀㌀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㌀㐀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀愀挀氀愀猀猀㴀∀吀攀砀琀䈀琀渀∀ 栀爀攀昀㴀∀㄀㔀开㄀⸀栀琀洀氀∀㸀㰀椀洀最眀椀搀琀栀㴀∀㄀㘀∀ 栀攀椀最栀琀㴀∀㄀㘀∀ 猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 愀氀琀㴀∀∀ 挀氀愀猀猀㴀∀瘀椀攀眀∀ ⼀㸀瘀椀攀眀㰀⼀愀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀䤀栀愀瘀攀琀栀攀昀漀氀氀漀眀椀渀最愀氀琀攀爀渀愀琀椀瘀攀瀀爀漀瀀漀猀愀氀㨀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㘀⸀㠀㘀㘀㤀㔀㈀㜀㠀㤀㘀㤀㤀㔀㜀─㬀∀㸀㰀椀洀最猀爀挀㴀∀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀渀漀琀爀愀渀猀氀愀琀攀∀㸀㘀⸀㤀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀渀漀琀爀愀渀猀氀愀琀攀∀㸀㌀㈀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀戀漀搀礀㸀㰀⼀琀愀戀氀攀㸀㰀⼀搀椀瘀㸀㰀⼀搀椀瘀㸀㰀搀椀瘀猀琀礀氀攀㴀∀洀愀爀最椀渀ⴀ戀漀琀琀漀洀㨀㄀㔀瀀砀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀䌀漀渀琀愀椀渀攀爀∀ 㸀㰀搀椀瘀猀琀礀氀攀㴀∀洀愀爀最椀渀ⴀ戀漀琀琀漀洀㨀㄀㔀瀀砀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀䌀漀渀琀愀椀渀攀爀∀ 㸀㰀琀愀戀氀攀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀∀ 挀攀氀氀猀瀀愀挀椀渀最㴀∀　∀ 挀攀氀氀瀀愀搀搀椀渀最㴀∀　∀㸀㰀琀栀攀愀搀㸀㰀琀爀挀氀愀猀猀㴀∀琀琀氀∀㸀㰀琀栀挀氀愀猀猀㴀∀栀搀爀∀ 挀漀氀猀瀀愀渀㴀∀㐀∀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㄀㌀⸀ 䌀漀洀瀀愀爀攀搀琀漀漀琀栀攀爀挀漀渀昀攀爀攀渀挀攀猀Ⰰ 栀漀眀洀甀挀栀攀昀昀漀爀琀眀愀猀椀琀琀漀戀攀愀爀攀瘀椀攀眀攀爀漀爀愀爀攀愀挀栀愀椀爀昀漀爀䤀䌀䴀䰀㈀　㄀　㼀㰀猀瀀愀渀氀愀渀最㴀∀攀渀ⴀ甀猀∀㸀 (Area Chairs only)
	answered question		27
	skipped question		0
		Response Percent	Response Count
Substantially more effort	਀㰀椀洀最猀爀挀㴀∀⸀⸀⼀䄀爀攀愀䌀栀愀椀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㌀Ⰰ㜀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㄀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀匀氀椀最栀琀氀礀洀漀爀攀攀昀昀漀爀琀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㌀㌀⸀㌀㌀㌀㌀㌀㌀㌀㌀㌀㌀㌀㌀㌀─㬀∀㸀	33,3%	9
About average	਀ऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀䄀爀攀愀䌀栀愀椀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㔀㄀Ⰰ㤀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㄀㐀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀匀氀椀最栀琀氀礀氀攀猀猀攀昀昀漀爀琀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㜀⸀㐀　㜀㐀　㜀㐀　㜀㐀　㜀㐀㄀─㬀∀㸀	7,4%	2
Substantially less effort	਀ऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀䄀爀攀愀䌀栀愀椀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㌀Ⰰ㜀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㄀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀愀氀椀最渀㴀∀爀椀最栀琀∀ 挀漀氀猀瀀愀渀㴀∀㌀∀㸀 ਀ऀ㰀椀洀最眀椀搀琀栀㴀∀㄀㘀∀ 栀攀椀最栀琀㴀∀㄀㘀∀ 猀爀挀㴀∀⸀⸀⼀䄀爀攀愀䌀栀愀椀爀猀⼀椀⼀琀⸀最椀昀∀ 愀氀琀㴀∀∀ 挀氀愀猀猀㴀∀瘀椀攀眀∀ ⼀㸀瘀椀攀眀㰀⼀愀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀䌀漀洀洀攀渀琀猀㨀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀渀漀琀爀愀渀猀氀愀琀攀∀㸀㜀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀戀漀搀礀㸀㰀⼀琀愀戀氀攀㸀㰀⼀搀椀瘀㸀㰀⼀搀椀瘀㸀㰀搀椀瘀猀琀礀氀攀㴀∀洀愀爀最椀渀ⴀ戀漀琀琀漀洀㨀㄀㔀瀀砀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀䌀漀渀琀愀椀渀攀爀∀ 㸀㰀琀愀戀氀攀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀∀ 挀攀氀氀猀瀀愀挀椀渀最㴀∀　∀ 挀攀氀氀瀀愀搀搀椀渀最㴀∀　∀㸀㰀琀栀攀愀搀㸀㰀琀爀挀氀愀猀猀㴀∀琀琀氀∀㸀㰀琀栀挀氀愀猀猀㴀∀栀搀爀∀ 挀漀氀猀瀀愀渀㴀∀㐀∀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㄀㐀⸀ 吀栀爀漀甀最栀漀甀琀琀栀攀爀攀瘀椀攀眀椀渀最瀀爀漀挀攀猀猀Ⰰ 眀愀猀椀琀愀氀眀愀礀猀挀氀攀愀爀琀漀礀漀甀眀栀愀琀渀攀攀搀攀搀琀漀戀攀搀漀渀攀㼀㰀猀瀀愀渀氀愀渀最㴀∀攀渀ⴀ甀猀∀㸀 (Area Chairs only)
	answered question		27
	skipped question		0
		Response Percent	Response Count
Yes.	਀ऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀䄀爀攀愀䌀栀愀椀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㘀㌀Ⰰ　─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㄀㜀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀䴀漀猀琀漀昀琀栀攀琀椀洀攀⸀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㌀㌀⸀㌀㌀㌀㌀㌀㌀㌀㌀㌀㌀㌀㌀㌀─㬀∀㸀	33,3%	9
Mostly not clear.	਀ऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀䄀爀攀愀䌀栀愀椀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㌀Ⰰ㜀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㄀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀愀氀椀最渀㴀∀爀椀最栀琀∀ 挀漀氀猀瀀愀渀㴀∀㌀∀㸀 ਀ऀऀ㰀椀洀最眀椀搀琀栀㴀∀㄀㘀∀ 栀攀椀最栀琀㴀∀㄀㘀∀ 猀爀挀㴀∀⸀⸀⼀䄀爀攀愀䌀栀愀椀爀猀⼀椀⼀琀⸀最椀昀∀ 愀氀琀㴀∀∀ 挀氀愀猀猀㴀∀瘀椀攀眀∀ ⼀㸀瘀椀攀眀㰀⼀愀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀䌀漀洀洀攀渀琀猀㨀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀渀漀琀爀愀渀猀氀愀琀攀∀㸀㔀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀戀漀搀礀㸀㰀⼀琀愀戀氀攀㸀㰀⼀搀椀瘀㸀㰀⼀搀椀瘀㸀㰀搀椀瘀猀琀礀氀攀㴀∀洀愀爀最椀渀ⴀ戀漀琀琀漀洀㨀㄀㔀瀀砀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀䌀漀渀琀愀椀渀攀爀∀ 㸀㰀琀愀戀氀攀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀∀ 挀攀氀氀猀瀀愀挀椀渀最㴀∀　∀ 挀攀氀氀瀀愀搀搀椀渀最㴀∀　∀㸀㰀琀栀攀愀搀㸀㰀琀爀挀氀愀猀猀㴀∀琀琀氀∀㸀㰀琀栀挀氀愀猀猀㴀∀栀搀爀∀ 挀漀氀猀瀀愀渀㴀∀㜀∀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㄀㔀⸀ 䠀漀眀眀攀氀氀搀漀礀漀甀琀栀椀渀欀搀椀搀琀栀攀倀栀愀猀攀䤀爀攀瘀椀攀眀猀愀渀搀琀栀攀愀甀琀栀漀爀昀攀攀搀戀愀挀欀椀渀昀漀爀洀愀最漀漀搀猀攀氀攀挀琀椀漀渀漀昀倀栀愀猀攀䤀䤀爀攀瘀椀攀眀攀爀猀㼀㰀猀瀀愀渀氀愀渀最㴀∀攀渀ⴀ甀猀∀㸀 (Area Chairs only)
	answered question					27
	skipped question					0
	very important	important	some influence	no influence	Rating Average	Response Count
Phase I reviews	25,9% (7)	22,2% (6)	44,4% (12)	7,4% (2)	2,33	27
Author feedback	0,0% (0)	18,5% (5)	44,4% (12)	37,0% (10)	3,19	27

13. How did you like your assignments in the first reviewing phase? ਀㰀猀瀀愀渀氀愀渀最㴀∀攀渀ⴀ甀猀∀㸀⠀刀攀瘀椀攀眀攀爀猀漀渀氀礀⤀㰀⼀猀瀀愀渀㸀㰀⼀猀瀀愀渀㸀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀⼀琀栀攀愀搀㸀㰀琀昀漀漀琀㸀㰀琀爀㸀㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀愀渀猀眀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀愀渀猀眀攀爀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㄀㘀㐀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀㸀㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀猀欀椀瀀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀猀欀椀瀀瀀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㌀㄀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀昀漀漀琀㸀㰀琀戀漀搀礀㸀㰀琀爀㸀㰀琀栀挀氀愀猀猀㴀∀搀昀氀琀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀☀渀戀猀瀀㬀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀挀渀琀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀䌀漀甀渀琀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀瘀攀爀礀椀渀琀攀爀攀猀琀椀渀最㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀⸀㜀㔀㘀　㤀㜀㔀㘀　㤀㜀㔀㘀㄀─㬀∀㸀				9,8%	16
good fit with my expertise	਀ऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀刀攀瘀椀攀眀攀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㠀㐀Ⰰ㄀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㄀㌀㠀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀洀漀猀琀氀礀渀漀琀洀礀愀爀攀愀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㘀⸀　㤀㜀㔀㘀　㤀㜀㔀㘀　㤀㜀㘀─㬀∀㸀	6,1%	10
terrible		0,0%	0

14. How did you like your assignments in the second reviewing phase? ਀㰀猀瀀愀渀氀愀渀最㴀∀攀渀ⴀ甀猀∀㸀⠀刀攀瘀椀攀眀攀爀猀漀渀氀礀⤀㰀⼀猀瀀愀渀㸀㰀⼀猀瀀愀渀㸀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀⼀琀栀攀愀搀㸀㰀琀昀漀漀琀㸀㰀琀爀㸀㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀愀渀猀眀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀愀渀猀眀攀爀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㄀㐀㄀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀㸀㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀猀欀椀瀀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀猀欀椀瀀瀀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㔀㐀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀昀漀漀琀㸀㰀琀戀漀搀礀㸀㰀琀爀㸀㰀琀栀挀氀愀猀猀㴀∀搀昀氀琀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀☀渀戀猀瀀㬀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀挀渀琀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀䌀漀甀渀琀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀瘀攀爀礀椀渀琀攀爀攀猀琀椀渀最㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㄀㈀⸀㜀㘀㔀㤀㔀㜀㐀㐀㘀㠀　㠀㔀─㬀∀㸀				12,8%	18
good fit with my expertise	਀ऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀刀攀瘀椀攀眀攀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㠀　Ⰰ㤀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㄀㄀㐀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀洀漀猀琀氀礀渀漀琀洀礀愀爀攀愀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㘀⸀㌀㠀㈀㤀㜀㠀㜀㈀㌀㐀　㐀㈀㘀─㬀∀㸀	6,4%	9
terrible		0,0%	0

		Response Percent	Response Count
15. How would you like to receive your assignment? ਀㰀猀瀀愀渀氀愀渀最㴀∀攀渀ⴀ甀猀∀㸀⠀刀攀瘀椀攀眀攀爀猀漀渀氀礀⤀㰀⼀猀瀀愀渀㸀㰀⼀猀瀀愀渀㸀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀⼀琀栀攀愀搀㸀㰀琀昀漀漀琀㸀㰀琀爀㸀㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀愀渀猀眀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀愀渀猀眀攀爀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㄀㜀　㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀㸀㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀猀欀椀瀀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀猀欀椀瀀瀀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㈀㔀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀昀漀漀琀㸀㰀琀戀漀搀礀㸀㰀琀爀㸀㰀琀栀挀氀愀猀猀㴀∀搀昀氀琀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀☀渀戀猀瀀㬀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀挀渀琀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀䌀漀甀渀琀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀䄀渀愀爀攀愀挀栀愀椀爀眀栀漀欀渀漀眀猀洀攀猀栀漀甀氀搀愀猀猀椀最渀琀栀攀洀琀漀洀攀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㄀㈀⸀㤀㐀㄀㄀㜀㘀㐀㜀　㔀㠀㠀㈀─㬀∀㸀				12,9%	22
I want to bid for my papers	਀ऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀刀攀瘀椀攀眀攀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㌀㈀Ⰰ㤀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㔀㘀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀戀㸀㰀猀瀀愀渀㸀圀攀猀栀漀甀氀搀琀爀礀愀洀椀砀漀昀戀漀琀栀洀漀搀攀氀猀㰀⼀猀瀀愀渀㸀㰀⼀戀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㔀㄀⸀㄀㜀㘀㐀㜀　㔀㠀㠀㈀㌀㔀㌀─㬀∀㸀	51,2%	87
Don't care	਀ऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀刀攀瘀椀攀眀攀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㈀Ⰰ㤀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㔀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀戀漀搀礀㸀㰀⼀琀愀戀氀攀㸀㰀⼀搀椀瘀㸀㰀⼀搀椀瘀㸀㰀搀椀瘀猀琀礀氀攀㴀∀洀愀爀最椀渀ⴀ戀漀琀琀漀洀㨀㄀㔀瀀砀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀䌀漀渀琀愀椀渀攀爀∀ 㸀㰀琀愀戀氀攀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀∀ 挀攀氀氀猀瀀愀挀椀渀最㴀∀　∀ 挀攀氀氀瀀愀搀搀椀渀最㴀∀　∀㸀㰀琀栀攀愀搀㸀㰀琀爀挀氀愀猀猀㴀∀琀琀氀∀㸀㰀琀栀挀氀愀猀猀㴀∀栀搀爀∀ 挀漀氀猀瀀愀渀㴀∀㐀∀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㄀㘀⸀ 䐀椀搀礀漀甀氀漀漀欀愀琀琀栀攀猀甀瀀瀀氀攀洀攀渀琀愀爀礀洀愀琀攀爀椀愀氀猀漀昀琀栀攀瀀愀瀀攀爀猀㼀☀渀戀猀瀀㬀 (Reviewers only)
	answered question		171
	skipped question		24
always	਀ऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀刀攀瘀椀攀眀攀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㈀㈀Ⰰ㈀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㌀㠀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀戀㸀㰀猀瀀愀渀㸀猀漀洀攀琀椀洀攀猀㰀⼀猀瀀愀渀㸀㰀⼀戀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㌀㌀⸀㤀㄀㠀㄀㈀㠀㘀㔀㐀㤀㜀　㠀─㬀∀㸀	33,9%	58
never	਀ऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀刀攀瘀椀攀眀攀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㠀Ⰰ㠀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㄀㔀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀洀礀瀀愀瀀攀爀猀搀椀搀渀✀琀栀愀瘀攀愀渀礀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㈀㠀⸀㘀㔀㐀㤀㜀　㜀㘀　㈀㌀㌀㤀─㬀∀㸀	28,7%	49
I don't know whether my papers had any	਀ऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀刀攀瘀椀攀眀攀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㘀Ⰰ㐀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㄀㄀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀戀漀搀礀㸀㰀⼀琀愀戀氀攀㸀㰀⼀搀椀瘀㸀㰀⼀搀椀瘀㸀㰀搀椀瘀猀琀礀氀攀㴀∀洀愀爀最椀渀ⴀ戀漀琀琀漀洀㨀㄀㔀瀀砀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀䌀漀渀琀愀椀渀攀爀∀ 㸀㰀琀愀戀氀攀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀∀ 挀攀氀氀猀瀀愀挀椀渀最㴀∀　∀ 挀攀氀氀瀀愀搀搀椀渀最㴀∀　∀㸀㰀琀栀攀愀搀㸀㰀琀爀挀氀愀猀猀㴀∀琀琀氀∀㸀㰀琀栀挀氀愀猀猀㴀∀栀搀爀∀ 挀漀氀猀瀀愀渀㴀∀㐀∀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㄀㜀⸀ 䄀猀愀爀攀瘀椀攀眀攀爀Ⰰ 栀漀眀搀椀搀礀漀甀爀愀琀攀琀栀攀愀甀琀栀漀爀昀攀攀搀戀愀挀欀漀昀礀漀甀爀瀀愀瀀攀爀猀㼀☀渀戀猀瀀㬀 (Reviewers only)
	answered question		168
	skipped question		27
		Response Percent	Response Count
it changed my mind about a paper	਀ऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀刀攀瘀椀攀眀攀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㜀Ⰰ㜀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㄀㌀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀戀㸀㰀猀瀀愀渀㸀椀琀栀攀氀瀀攀搀琀漀挀氀愀爀椀昀礀愀昀攀眀焀甀攀猀琀椀漀渀猀Ⰰ 戀甀琀搀椀搀渀漀琀挀栀愀渀最攀洀礀洀椀渀搀㰀⼀猀瀀愀渀㸀㰀⼀戀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㜀㔀─㬀∀㸀	75,0%	126
it was not useful	਀ऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀刀攀瘀椀攀眀攀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㄀㐀Ⰰ㤀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㈀㔀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀䤀搀椀搀渀漀琀猀攀攀椀琀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㈀⸀㌀㠀　㤀㔀㈀㌀㠀　㤀㔀㈀㌀㠀─㬀∀㸀	2,4%	4

18. Throughout the reviewing process, was it always clear to you what needed to be done?਀ऀ㰀猀瀀愀渀氀愀渀最㴀∀攀渀ⴀ甀猀∀㸀⠀刀攀瘀椀攀眀攀爀猀漀渀氀礀⤀㰀⼀猀瀀愀渀㸀㰀⼀猀瀀愀渀㸀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀⼀琀栀攀愀搀㸀㰀琀昀漀漀琀㸀㰀琀爀㸀㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀愀渀猀眀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀愀渀猀眀攀爀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㄀㜀　㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀㸀㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀猀欀椀瀀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀猀欀椀瀀瀀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㈀㔀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀昀漀漀琀㸀㰀琀戀漀搀礀㸀㰀琀爀㸀㰀琀栀挀氀愀猀猀㴀∀搀昀氀琀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀☀渀戀猀瀀㬀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀挀渀琀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀䌀漀甀渀琀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀戀㸀㰀猀瀀愀渀㸀夀攀猀⸀㰀⼀猀瀀愀渀㸀㰀⼀戀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㘀㘀⸀㐀㜀　㔀㠀㠀㈀㌀㔀㈀㤀㐀㄀─㬀∀㸀				66,5%	113
Most of the time.	਀ऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀刀攀瘀椀攀眀攀爀猀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㌀㈀Ⰰ㤀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㔀㘀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀䴀漀猀琀氀礀渀漀琀挀氀攀愀爀⸀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀　⸀㔀㠀㠀㈀㌀㔀㈀㤀㐀㄀㄀㜀㘀㐀㜀─㬀∀㸀	0,6%	1
਀ऀऀ㰀愀挀氀愀猀猀㴀∀吀攀砀琀䈀琀渀∀ 栀爀攀昀㴀∀⸀⸀⼀刀攀瘀椀攀眀攀爀猀⼀㄀㠀开㄀⸀栀琀洀氀∀㸀 viewComments:			7

		Response Percent	Response Count
25. Do you think the majority of the reviews of your paper were਀ऀ㰀猀瀀愀渀氀愀渀最㴀∀攀渀ⴀ甀猀∀㸀⠀䄀甀琀栀漀爀猀漀渀氀礀⤀㰀⼀猀瀀愀渀㸀㰀⼀猀瀀愀渀㸀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀⼀琀栀攀愀搀㸀㰀琀昀漀漀琀㸀㰀琀爀㸀㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀愀渀猀眀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀愀渀猀眀攀爀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㌀㐀㄀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀㸀㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀猀欀椀瀀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀猀欀椀瀀瀀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㤀㔀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀昀漀漀琀㸀㰀琀戀漀搀礀㸀㰀琀爀㸀㰀琀栀挀氀愀猀猀㴀∀搀昀氀琀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀☀渀戀猀瀀㬀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀挀渀琀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀䌀漀甀渀琀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀爀椀最栀琀琀漀琀栀攀瀀漀椀渀琀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㄀㌀⸀㐀㠀㤀㜀㌀㘀　㜀　㌀㠀㄀㈀─㬀∀㸀				13,5%	46
high quality	਀ऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀⸀⸀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㔀㌀Ⰰ㄀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㄀㠀㄀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀氀漀眀焀甀愀氀椀琀礀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㈀㐀⸀　㐀㘀㤀㈀　㠀㈀㄀㄀㄀㐀㐀─㬀∀㸀	24,0%	82
the reviewers did not understand my paper	਀ऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀⸀⸀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㤀Ⰰ㐀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㌀㈀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀戀漀搀礀㸀㰀⼀琀愀戀氀攀㸀㰀⼀搀椀瘀㸀㰀⼀搀椀瘀㸀㰀搀椀瘀猀琀礀氀攀㴀∀洀愀爀最椀渀ⴀ戀漀琀琀漀洀㨀㄀㔀瀀砀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀䌀漀渀琀愀椀渀攀爀∀ 㸀㰀琀愀戀氀攀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀∀ 挀攀氀氀猀瀀愀挀椀渀最㴀∀　∀ 挀攀氀氀瀀愀搀搀椀渀最㴀∀　∀㸀㰀琀栀攀愀搀㸀㰀琀爀挀氀愀猀猀㴀∀琀琀氀∀㸀㰀琀栀挀氀愀猀猀㴀∀栀搀爀∀ 挀漀氀猀瀀愀渀㴀∀㐀∀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㈀㘀⸀ 䠀漀眀搀漀礀漀甀爀愀琀攀琀栀攀氀攀渀最琀栀漀昀琀栀攀洀愀樀漀爀椀琀礀漀昀琀栀攀爀攀瘀椀攀眀猀㼀 (Authors only)
	answered question		343
	skipped question		93
too long	਀ऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀⸀⸀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㈀Ⰰ㌀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㠀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀戀㸀㰀猀瀀愀渀㸀樀甀猀琀爀椀最栀琀㰀⼀猀瀀愀渀㸀㰀⼀戀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㜀㜀⸀㠀㐀㈀㔀㘀㔀㔀㤀㜀㘀㘀㜀㘀─㬀∀㸀	77,8%	267
too short	਀ऀऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀⸀⸀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㄀㤀Ⰰ㠀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㘀㠀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀戀漀搀礀㸀㰀⼀琀愀戀氀攀㸀㰀⼀搀椀瘀㸀㰀⼀搀椀瘀㸀㰀搀椀瘀猀琀礀氀攀㴀∀洀愀爀最椀渀ⴀ戀漀琀琀漀洀㨀㄀㔀瀀砀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀䌀漀渀琀愀椀渀攀爀∀ 㸀㰀琀愀戀氀攀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀∀ 挀攀氀氀猀瀀愀挀椀渀最㴀∀　∀ 挀攀氀氀瀀愀搀搀椀渀最㴀∀　∀㸀㰀琀栀攀愀搀㸀㰀琀爀挀氀愀猀猀㴀∀琀琀氀∀㸀㰀琀栀挀氀愀猀猀㴀∀栀搀爀∀ 挀漀氀猀瀀愀渀㴀∀㐀∀㸀㰀猀瀀愀渀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㈀㜀⸀ 䐀漀礀漀甀琀栀椀渀欀琀栀攀爀攀瘀椀攀眀攀爀猀爀攀愀搀礀漀甀爀昀攀攀搀戀愀挀欀㼀 (Authors only)
	answered question		348
	skipped question		88
		Response Percent	Response Count
yes, and they took it into consideration	਀ऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀⸀⸀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㄀㐀Ⰰ㜀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㔀㄀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀礀攀猀Ⰰ 戀甀琀琀栀攀礀椀最渀漀爀攀搀椀琀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㄀㠀⸀㌀㤀　㠀　㐀㔀㤀㜀㜀　㄀㄀─㬀∀㸀	18,4%	64
I'm not sure	਀ऀऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀⸀⸀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㔀㤀Ⰰ㈀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㈀　㘀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀挀攀爀琀愀椀渀氀礀渀漀琀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㜀⸀㜀㔀㠀㘀㈀　㘀㠀㤀㘀㔀㔀㄀㜀─㬀∀㸀	7,8%	27

28. Do you think that the meta reviewer (area chair) adequately summarized the reviewers' opinions and made a right decision? ਀ऀऀ⠀䄀甀琀栀漀爀猀漀渀氀礀⤀㰀⼀猀瀀愀渀㸀
	answered question		336
	skipped question		100
		Response Percent	Response Count
yes	਀ऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀⸀⸀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㌀㤀Ⰰ㌀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㄀㌀㈀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀猀漀洀攀眀栀愀琀Ⰰ 戀甀琀洀漀猀琀氀礀伀䬀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㌀㠀⸀㘀㤀　㐀㜀㘀㄀㤀　㐀㜀㘀㈀─㬀∀㸀	38,7%	130
no	਀ऀऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀⸀⸀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㄀㜀Ⰰ　─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㔀㜀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀琀栀攀爀攀眀愀猀渀漀樀甀猀琀椀昀椀挀愀琀椀漀渀漀昀琀栀攀搀攀挀椀猀椀漀渀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㔀⸀　㔀㤀㔀㈀㌀㠀　㤀㔀㈀㌀㠀㄀─㬀∀㸀	5,1%	17

29. How do you rate the length of the meta review(s)?਀ऀऀ㰀猀瀀愀渀氀愀渀最㴀∀攀渀ⴀ甀猀∀㸀⠀䄀甀琀栀漀爀猀漀渀氀礀⤀㰀⼀猀瀀愀渀㸀㰀⼀猀瀀愀渀㸀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀⼀琀栀攀愀搀㸀㰀琀昀漀漀琀㸀㰀琀爀㸀㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀愀渀猀眀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀愀渀猀眀攀爀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㌀㌀㈀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀㸀㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀猀欀椀瀀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀猀欀椀瀀瀀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㄀　㐀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀昀漀漀琀㸀㰀琀戀漀搀礀㸀㰀琀爀㸀㰀琀栀挀氀愀猀猀㴀∀搀昀氀琀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀☀渀戀猀瀀㬀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀挀渀琀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀䌀漀甀渀琀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀琀漀漀氀漀渀最㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀　⸀㤀　㌀㘀㄀㐀㐀㔀㜀㠀㌀㄀㌀㈀㔀─㬀∀㸀				0,9%	3
just right	਀ऀऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀⸀⸀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㜀㈀Ⰰ㘀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀琀漀瀀∀㸀㈀㐀㄀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀琀漀漀猀栀漀爀琀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㈀㘀⸀㔀　㘀　㈀㐀　㤀㘀㌀㠀㔀㔀─㬀∀㸀	26,5%	88

30. Will you submit again to a future ICML conference?਀ऀऀ㰀猀瀀愀渀氀愀渀最㴀∀攀渀ⴀ甀猀∀㸀⠀䄀甀琀栀漀爀猀漀渀氀礀⤀㰀⼀猀瀀愀渀㸀㰀⼀猀瀀愀渀㸀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀⼀琀栀攀愀搀㸀㰀琀昀漀漀琀㸀㰀琀爀㸀㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀愀渀猀眀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀愀渀猀眀攀爀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㌀㐀㠀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀㸀㰀琀搀㸀㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀栀挀氀愀猀猀㴀∀猀欀椀瀀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀猀欀椀瀀瀀攀搀焀甀攀猀琀椀漀渀㰀⼀琀栀㸀㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㠀㠀㰀⼀戀㸀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀⼀琀昀漀漀琀㸀㰀琀戀漀搀礀㸀㰀琀爀㸀㰀琀栀挀氀愀猀猀㴀∀搀昀氀琀∀ 挀漀氀猀瀀愀渀㴀∀㈀∀㸀☀渀戀猀瀀㬀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀㰀琀栀挀氀愀猀猀㴀∀挀渀琀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀䌀漀甀渀琀㰀⼀琀栀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀戀㸀㰀猀瀀愀渀㸀礀攀猀㰀⼀猀瀀愀渀㸀㰀⼀戀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㜀㘀⸀㜀㈀㐀㄀㌀㜀㤀㌀㄀　㌀㐀㔀─㬀∀㸀				76,7%	267
no	਀ऀऀऀ㰀椀洀最猀爀挀㴀∀⸀⸀⼀⸀⸀⼀椀⼀琀⸀最椀昀∀ 栀攀椀最栀琀㴀∀㄀㈀∀ 愀氀琀㴀∀∀ ⼀㸀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㈀Ⰰ㌀─㰀⼀琀搀㸀㰀琀搀挀氀愀猀猀㴀∀挀渀琀∀㸀㠀㰀⼀琀搀㸀㰀⼀琀爀㸀㰀琀爀挀氀愀猀猀㴀∀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀搀漀渀✀琀欀渀漀眀礀攀琀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀㰀琀搀猀琀礀氀攀㴀∀眀椀搀琀栀㨀㤀㘀─㬀眀栀椀琀攀ⴀ猀瀀愀挀攀㨀渀漀眀爀愀瀀㬀∀㸀㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㈀　⸀㤀㜀㜀　㄀㄀㐀㤀㐀㈀㔀㈀㤀─㬀∀㸀	21,0%	73

਀㰀琀愀戀氀攀挀氀愀猀猀㴀∀爀猀氀琀猀洀爀礀∀ 挀攀氀氀猀瀀愀挀椀渀最㴀∀　∀ 挀攀氀氀瀀愀搀搀椀渀最㴀∀　∀㸀 ਀ऀऀ㰀琀爀挀氀愀猀猀㴀∀琀琀氀∀㸀 31. Which conference tool do you like best?਀ऀऀ㰀⼀琀爀㸀 ਀ऀ㰀琀昀漀漀琀㸀 ਀ऀऀऀ㰀琀搀㸀☀渀戀猀瀀㬀㰀⼀琀搀㸀 answered question਀ऀऀऀ㰀琀搀挀氀愀猀猀㴀∀愀渀猀眀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㈀㠀㠀㰀⼀戀㸀㰀⼀琀搀㸀 ਀ऀऀ㰀琀爀㸀 ਀ऀऀऀ㰀搀椀瘀挀氀愀猀猀㴀∀猀瀀愀挀攀爀∀㸀☀渀戀猀瀀㬀㰀⼀搀椀瘀㸀㰀⼀琀搀㸀 skipped question਀ऀऀऀ㰀琀搀挀氀愀猀猀㴀∀猀欀椀瀀渀漀琀爀愀渀猀氀愀琀攀∀㸀㰀戀㸀㈀㜀㈀㰀⼀戀㸀㰀⼀琀搀㸀 ਀ऀ㰀⼀琀昀漀漀琀㸀 ਀ऀऀ㰀琀爀㸀 ਀ऀऀऀ㰀琀栀挀氀愀猀猀㴀∀昀爀攀焀∀㸀刀攀猀瀀漀渀猀攀㰀戀爀⼀㸀倀攀爀挀攀渀琀㰀⼀琀栀㸀 Response
Count਀ऀऀ㰀⼀琀爀㸀 ਀ऀऀऀ㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀戀㸀㰀猀瀀愀渀㸀䌀䴀吀 ⠀琀栀椀猀礀攀愀爀⤀㰀⼀猀瀀愀渀㸀㰀⼀戀㸀㰀⼀琀搀㸀 ਀ऀऀऀ㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㠀㈀⸀㤀㠀㘀㄀㄀㄀㄀㄀㄀㄀㄀㄀㄀─㬀∀㸀

਀ऀऀऀ㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀琀漀瀀∀㸀㠀㌀⸀　─㰀⼀琀搀㸀 239਀ऀऀ㰀⼀琀爀㸀 ਀ऀऀऀ㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀䌀礀戀攀爀䌀栀愀椀爀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀 ਀ऀऀऀ㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㄀㈀⸀㔀─㬀∀㸀

਀ऀऀऀ㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㄀㈀⸀㔀─㰀⼀琀搀㸀 36਀ऀऀ㰀⼀琀爀㸀 ਀ऀऀऀ㰀琀搀挀氀愀猀猀㴀∀爀漀眀䰀愀戀攀氀∀㸀㰀猀瀀愀渀㸀匀吀䄀刀吀㰀⼀猀瀀愀渀㸀㰀⼀琀搀㸀 ਀ऀऀऀ㰀搀椀瘀挀氀愀猀猀㴀∀昀爀攀焀戀愀爀∀ 猀琀礀氀攀㴀∀眀椀搀琀栀㨀㐀⸀㔀㄀㌀㠀㠀㠀㠀㠀㠀㠀㠀㠀㠀㤀─㬀∀㸀

਀ऀऀऀ㰀琀搀挀氀愀猀猀㴀∀昀爀攀焀∀㸀㐀⸀㔀─㰀⼀琀搀㸀 13਀ऀऀ㰀⼀琀爀㸀 ਀ऀऀऀ㰀琀搀愀氀椀最渀㴀∀爀椀最栀琀∀ 挀漀氀猀瀀愀渀㴀∀㌀∀㸀㰀愀挀氀愀猀猀㴀∀吀攀砀琀䈀琀渀∀ 栀爀攀昀㴀∀㌀㄀开㄀⸀栀琀洀氀∀㸀

viewOther (please specify)਀ऀऀऀ㰀琀搀挀氀愀猀猀㴀∀挀渀琀渀漀琀爀愀渀猀氀愀琀攀∀㸀㌀㘀㰀⼀琀搀㸀 ਀ऀ㰀⼀琀戀漀搀礀㸀

32. Did you find CMT
	answered question		411
	skipped question		149
		Response Percent	Response Count
great		9.2%	38
comfortable		39.9%	164
o.k.		42.3%	174
clumsy		6.6%	27
awful		1.9%	8

33. Do you have any suggestions for improving CMT that we should pass on to its developers?
	answered question	53
	skipped question	507
		Response Count
view		53

34. With ca. 160 accepted and invited papers, the program currently fills 5 parallel tracks on three days to the limit. Should we allow the conference to grow further?
	answered question		401
	skipped question		159
		Response Percent	Response Count
No, we already accept too many papers.		15.7%	63
No, we should not accept more papers even if we get substantially more submissions.		25.7%	103
Yes, but include accepted papers that will only be presented as posters.		31.9%	128
Yes, add another parallel track.		11.0%	44
Yes, add another day of sessions to the program.		15.7%	63
viewOther suggestions?			17

35. This year, we invited 7 application papers, which got a free entry to the program and a slot in the proceedings. Do you think this is a good idea?
	answered question		424
	skipped question		136
		Response Percent	Response Count
Yes, we should keep that.		15.8%	67
Sounds good in principle, but I have not yet seen the papers.		52.6%	223
No, application papers are fine, but we do not need additional incentives for attracting them		18.6%	79
No, we should find another way for attracting application papers.		13.0%	55
viewOther comments?			24

36. At this year´s conference, proceedings on paper, USB or CD will not be available, but papers can be downloaded from the Web page. Does this work for you?
	answered question		436
	skipped question		124
		Response Percent	Response Count
Yes.		89.0%	388
Yes, but I think it's a bad idea.		7.6%	33
No.		3.4%	15

37. As in previous years, printed proceedings will be available from Omnipress (this year only after the conference). This service is not free (about 6$ per registration). Do you think we should still produce printed proceedings for archival purposes?
	answered question		430
	skipped question		130
		Response Percent	Response Count
Yes.		35.1%	151
Yes, but try to find a cheaper way.		11.6%	50
No.		53.3%	229

38. What other conferences do you regularly attend?
	answered question		337
	skipped question		223
		Response Percent	Response Count
NIPS		68.2%	230
AIStats		19.3%	65
UAI		19.3%	65
COLT		11.6%	39
ECML/PKDD		31.5%	106
SIGKDD		18.4%	62
ICDM		12.5%	42
IJCAI		20.8%	70
AAAI		22.8%	77
ECAI		6.8%	23
EMNLP		6.2%	21
CoNLL		1.2%	4
SIGIR		7.7%	26
viewOther (please specify)			61