I am not really sure a ranking can give a fair representation of players abilities if it relies so heavily on which tournaments you attend as well as individual score keeping. I am not just thinking from my own perspective, but also as a Tournament Director. Especially since 21 years of ASO scenarios aren't included in this new list (except for those who have their own records of their games AND have discovered this thread). It just doesn't seem viable to me.
I am not knocking Aarons' efforts. It is much needed to get something we can use for the tournament scene.
There's no chance I can dig up scenario codes for 15 years worth of going to tournaments. This, to me, looks like a significant flaw in your system. Looking at other players (like fellow dane Michael Hastrup-Leth) about half his games has disappeared in the APCR rankings. I suspect that it is the same issue. As AREA never required that information it was not gathered. At least not on a regular basis. It may be standard in (some) US tournaments and VASL tournaments but not everywhere.
GIGO. (Garbage in Garbage out), if I have really bad data the outputs of the system will be considerably compromised
Requiring correct data is definitely a feature rather than a flaw
What can be done is that any game from January 1 2019 will need winning side and Scenario Code (No Exceptions) but that I will do a one off population of Area Data with no winning side or scenario code.
I will put things in with a scenario code "Dummy" and Winning Side "Dummy" where needed. The problem with this kind of ugly workaround is that it requires all sort of kludge on summary statistics.
I will need to make all games recorded with a dummy side be excluded form any winning %'s for attackers/defenders. For the cases where a scenario code has been recorded but no winning side this sort
of issue becomes even uglier.
Currently 18456 AREA games are in roar
I think about ~3500 are not in (Will update with a more exact number shortly)
Of the bad records some are more smelly than others
Ones with PT (Playtest) in the scenario code, should these be included or excluded, or included for peoples records but not for statistics, really should peoples ratings be changed based on results of unpublished scenarios. My preference
is not to included (Supporting Fire is obviously different as the scenarios are pre-pub in this case)
Where one players name is like bob XXXXX should we include or not (This is a small number of records 10-15 and I am strongly inclined not to include).