First, points are awarded for each “Yes” answer. The number of points awarded for each "Yes" varies by variable depending on its significance. Next, the total points earned from “Yes” answers is divided by the total points possible to calculate a final
Yes/No score, also known as a Variable score.
Example: Broker XYZ has nine of ten features for category Research and earns 14 out of a possible 15 total points (remember, points allotted to each individual variable varies). Thus, Broker XYZ earns a Variable score of 93.33% for category Research.
Next, the editorial team gives an opinion score to each broker for the category. Opinion scores range from 1 – 10, with one being “very bad” and ten being “very good”. Half points are used, e.g. "9.5", so scoring isn't restricted to just whole numbers.
Note: While the editorial team does take into consideration the Variable score, the Opinion score is more focused on the editorial view of how well the broker performs overall as compared to the industry standard and its
Example: Broker XYZ does a great job with its Research offering, exceeding the industry standard. Not only are a variety of tools available to conduct research, but they are rich with depth and also easy to use. The editorial team awards Broker XYZ a
score of "10" for its Opinion score, which equates to 100%.
Finally, to determine a final percentage score for the category, the Variable score and Opinion score are independently weighted and added together. This score is then also translated to a star rating. Weightings vary by category depending on the complexity
of the category, e.g. 70% Variable, 30% Opinion.
Example: Broker XYZ earned a Variable score of 93.33% and a Opinion score of 100%. For category Research, the Variable score is 60% of the total and the Opinion score is 40%. Thus, Broker XYZ earns a final score of 96% for Research, which is calculated
as "(0.9333*.6)+(1*.4)". Translated into a star rating, Broker XYZ earns 5 Stars for Research.