SASO 2016: Talkback

[referees]

This post is closed; thank you for your feedback. If you would like to provide constructive criticism, please contact the mods directly. All further replies to this entry are screened.

The mods still plan to reply to the topics listed at the bottom of the post.

--

This is not the final wrap-up results/etc. post—that's coming in a couple of days. But while the mods tabulate final scores and create prize graphics, now's a good time to look back and reflect on your SASO 2016 experience.

Please leave comments giving us feedback on the event this year! What did you like? What did you dislike or find frustrating? What can we improve for next year, and how can we improve it? What was your favorite part of the event? Least favorite? Would you participate next year or not? Why? If you could mention your team when making your comment, we'd appreciate it.

If you would prefer to submit your comments in private, you can e-mail us at anime.espn@gmail.com or send us a Dreamwidth PM. We would prefer it if you'd put "Talkback" in the subject line.

Here's what the mod team plans to improve for next year:

• Voting program reliability. We'd like to apologize again for all of the server dowtnime, and definitely plan to make it much more stable for next year. The voting system in general, though, will remain the same.


• Bonus round program reliability. We think we got most of the kinks out during this year, but want to keep it stable for next year too.


• Dreamwidth capability for NSFW cross-posting. We didn't have time to implement it this year, but next year it should be ready to go.


• Clarifying the rules, especially on what "popular culture media" is acceptable to include in SASO work.

We also wanted to thank you again for being patient with us this year. We had a lot of technical hiccups, and you were all so kind while our heroic codermods worked out the kinks. We really appreciated your support.

--

Mod Replies: (updated 12:55PM EDT 8/28/16)

Please note that inclusion of a topic on this list indicates that we're going to address it, not that we've made any decisions on judging/implementing or not implementing it.

Voting:

The preliminary vote system

Triggers in a participant's assigned vote pool

Juried panel (having the mods decide which entries were the best)

Voting mechanics

Bonus Rounds:

Promptless rounds

One day break between bonus rounds

Bonus round prompt and fill tracking/filtering

Recs round work count

Image size limit

Remix round

Remix/rec round timing

Rec round

Quality control (both prompts and fills)

What is allowed as a fill (tags and ratings)

Unscreening bonus rounds

Fairness to small teams

Comment screening

Main Rounds:

The anonymity policy

Professionalism:

Twitter tone

What information gets posted where

Considering a dreamwidth announcement community

Mod participation in the event

Comments

(frozen comment)

[catlarks]

Yep, that's how it was last year! I assume a lot of people just don't have context for how voting has evolved, because there isn't really a space in the rules where you can go "and this is what it was like before, and it sucked."

Previously, the mods used DW polls because it was the only option that would verify someone was ACTUALLY signed up for the event; people have suggested other pre-existing options, and that's the problem with them. The voting program used this year was coded specifically for SASO and it just wasn't possible to test it on the scale of the event ahead of time, because where would you even get 300 people to test your program before the event starts? I know I actually think it's REALLY COOL how well the code worked, downtime aside, for this being its ~maiden voyage~

(and I for one very much prefer the opacity of this voting system, versus being able to see the results unfolding live and being able to change your vote in accordance with trends.)

(frozen comment)

[clefairy]

Yoo the entire idea that you could change your votes to vote strategically sounds absolutely terrible. If it was going to be a transparent poll then edits shouldn't have been a thing, but that's all a bygone.

The opaqueness is definitely a much better thing right now, though I personally am curious of the final tallies after results are announced just to see how big the gaps were (or how close they were). Though that might just be me and some prefer to live in ignorance.