What do you think of the new panel rankings?

[spider]

I understand that surveypolice is trying to make the rankings more fair, but how could surveyspot, mypoints and hotspex ( who doesn't even seem to be operating anymore) make the top ten list!! I guess we need to write more reviews to make a more accurate top ten.

[Administrator]

Hi spider,

Thanks for starting a discussion about this issue. In order for a panel to be ranked in the top 10 position for any country, they must now have a minimum number of reviews. This minimum reviews number is not arbitrary, but was set based on a calculation that involved median and mean review numbers based on different panel metrics.

The more reviews a panel has, the more accurate their ranking. The problem we had before was that panels who had only 4 or 5 positive reviews were ranked higher than those with hundreds. So now, panels have to "earn" a top 10 spot. 10 or even 20 reviews is not enough for a panel to make it to the top 10 list.

The problem of ranking is a difficult one in mathematics. We are very proud to use an algorithm that we feel assigns a very fair score to each panel on SurveyPolice. And now with this rule about the top 10 panels, we feel we've made SurveyPolice even more accurate. What we have in place is not perfect, but the more reviews that come in, the better the site truly becomes.

As a note, you can still access the old rankings page which still orders all panels (regardless of where they accept membership from) using the old method: http://www.surveypolice.com/rankings If you scroll down to the bottom of the page, you will also see survey panels that have no reviews at all. Again, user reviews is what makes SurveyPolice so great - please help us keep the site accurate as possible by ensuring you've submitted yours.