We use several weighted metrics for calculating your score for a rank question: Levenshtein distance, Hamming distance, and longest common substring. Generally speaking, the closer the order you make to the right answer, the more points you get, and vice versa. The maximum (positive and negative) points available are stated for each question and depend on the complexity of the question.
Overall you should focus on getting the general direction right, placing the “good” assets at the top and the “bad” ones at the bottom:
- To get the most points you need to correctly forecast the top and the bottom items — that will get you about 40% of the available points for the question;
- If you place an item that should have been at the top in second position, then you’ll get about 20%;
- Similarly, if you put an item that should have been at the bottom in the second to last position, you’ll get about 20%;
- For a correctly predicted second or second-to-last item you’ll get about 10% of the available points for each of these two;
- Even if you get the items in the middle correct, you won’t get any points. That’s because these items don’t really matter for real trades.