Not logged in. (Log In / Sign Up)

Frequently Asked Questions

  • Why do I have to edit at least 50 headlines and rate at least 200 to be considered for the prize money?
    This ensures that players who can consistently do a good job at editing and rating are rewarded.

  • Why are there limits on the number of edits and ratings that I can do? Will these limits be lifted in the future?
    All participants are allowed to submit a maximum of edits and ratings. This way, the competition is fair to all participants where the goal is to reward participants on quality of editing and rating, not on spending the most time on the platform. If we find that the participants and the competition will benefit from having a higher editing limit, we will increase the limit and we will notify you. Also, these limits will be lifted after the competition ends.

  • Can you give tips on how to do well in the competition? What is a good strategy to earn a large number of points?
    Focus on making each edit as funny as possible, not necessarily to yourself but definitely to a large audience. This could mean writing jokes and using references that a large number of people can understand. There are plenty of headlines to edit; only attempt editing those that you think you can make very funny and skip editing the others.
    Before you rate headlines, check out these sample headline ratings we have provided to help you calibrate your rating scale. When rating a headline, try to judge objectively, and try not to let your biases influence your ratings. Instead, think how a large crowd would rate the headline and rate as if you represent the crowd. After you rate a headline, sometimes you will receive instant feedback on how your rating compares to ratings from other players. Use this feedback to adjust your rating.
    Take advantage of your performance feedback. See which of your headlines players are finding funny to understand what kind of edited headlines appeal to the audience. Analyze how much you are significantly over-rating or under-rating headlines. For example, if you are doing a large amount of under-rating (assigning much lower ratings than other players), then it is probably wise to adjust your rating scale and be a bit more lenient when rating headlines for humor.
    Since you can only edit and rate a finite number of headlines (max 150 edits and 500 ratings), try to make each of your edit and rating count. This could mean editing and rating a low number of headlines per day for many days to keep yourself fresh every day. Binge editing or rating could lead to decision fatigue where you lose track of what is funny and how funny a headline is.
    Also, maximize your task balancing score, as described below.


  • What is the point of the task balancing score? How can I optimize it?
    The task balancing score is there to ensure everyone does both editing and rating. Especially, Leaderboard 1 assesses and rewards players in terms of both how good they are as writers of humor as well as judges of humor. You can easily obtain the maximum task balancing points by ensuring that you rate anywhere between 3 to 10 times the number of headlines that you edit. For example, if you edit 50 headlines, this score is maximized if you rate between 150 and 500 headlines. If you edit 150 headlines, you can maximize task balancing points by rating anywhere between 450-1500 headlines (actually 450-500 since you cannot rate more than 500 headlines). You can see task balancing recommendation in the My Performance section.

  • What could be examples of spamming and abusive user behavior? How do you handle them?
    In general, spamming or abusive behavior is any action that could pollute the data and hurt other players' performance. Spam editing involves randomly inserting replacement words that do not make any sense given the context. Spam rating includes randomly picking ratings without properly assessing a headline for funniness.
    Abusive behavior includes violating editing rules, for example, using slang, hate speech, crude sexual references, bathroom humor, jibberish words (e.g. "jkwqe") and combining multiple words into one. Abusive rating includes intentionally assigning wrong ratings to headlines.
    We've implemented automated methods that constantly look for these behaviors, and we allow players to flag spamming/abusive behavior. We review all flagged behavior and remove all illegal editing and rating. Sometimes we give initial warnings to misbehaving users, and occassionally we've suspended their accounts.


  • What if a player tries to hurt other players by always assigning low ratings?
    In most cases, such ratings will be detected as spamming and will be ignored and therefore the other players won't be affected, and most likely this player will be suspended from the competition. If for some reason the player is not suspended, the majority of his ratings will not agree with ratings from others, leading him to incur negative points and therefore lower his overall points earned.

  • Do my ratings come from a diversified set of players?
    Yes, each editor receives ratings from a variety of players, and never receives a large portion of ratings from a few players.

  • Why can't I rate a headline immediately after rating another headline?
    We've added a minimum time delay between successive ratings to ensure that a player spends at least the time needed to read a headline before rating it.

  • Why don't you allow removing or adding more than 1 word? I can create much better humor and more easily provided more flexibility.
    We shall run future iterations of the competition where we allow more words to be changed. For now, the point of the competition is to see how much humor can be obtained under this very strict rule of allowing only 1 word change.

  • I keep seeing headlines that I don't want to edit or rate. Can I do something to permanently stop them from showing?
    Yes, for both editing and rating, you can click the SKIP button for the headlines you do not want to be shown anymore.