Hey guys, sorry for not being forthcoming earlier, I was simply interested in investigating some of your concerns!
I'm a dev at BHG and in between developing features I try to dive into our War Matchmaking system and compare it to what I've seen you guys talk about. We are certainly aware that bad matches do happen in our system (let's face it, no matchmaking system is perfect) and that there are alliances that at times seem to get especially bad streams of luck with matches. We are still looking into ways to lessen that bad luck.
Having said all that, I do want to clear up some things as I've seen them.
The biggest thing for me is Domistats' war mismatches. First, Domistats is NOT an officially supported system by BHG and while a ton of great community effort went into developing it, it is by no means a definitive representation of what happens with our Matchmaking system. I've tried to figure out how they might calculate mismatches, but would love more details on how their system generates these results..
I've seen quite a few suggestions on what values to focus on, or not focus on, for matchmaking and have a few comments I'd like to share:
"Only use glory for matchmaking" - The problem here is that while your alliance may always go to war with the same 10, 15, 20, or 30 members, not all alliances do. If you went to war with your best members for a while, then you'd reach a higher glory with your alliance. But say you stop for a bit, and start taking lower-leveled members to war in order to show them the ropes? Now your glory doesn't actually match the power of your alliance and therefore is not an accurate metric on its own. As glory is a skill-based metric (the better you are, the more glory you get) it isn't reliable when the overall "skill" of your alliance can change from one war to another based on who you bring along with you.
"I had X level while they had X+Y level!" - While I certainly understand using this value to compare strength, it is important to remember that your level can advance by purely building eco buildings too. It is A metric to use, but a not fully accurate one as your level does not just represent your offensive and/or defensive power alone.
"We had only X drone/auto age players while they had X+Y!" - This follows along the same lines as the above, I could be drone age with only my eco buildings leveled up accordingly and therefore still be a fair match against an Information age player. Of course, eventually I'll be stronger than them if I'm upgrading properly but that is a difference in the future, not one right now.
Now, having said that, I definitely understand that there are wars that get to a point where you are just definitively outmatched. This will still happen at times especially when you're in a "bubble" where there aren't many (or any) alliances of your caliber in matchmaking for a time. We want to match you up with someone though, so we do the best we can with what we've got. This is why joining war sizes with more alliances in them (like 10v10 and 20v20) has worked for many, but we understand it can be more fun to fight in larger wars and so are trying to look into solutions there as well.
Hopefully the above explanations help to shed some light on why we use both glory and "war weight" in our matchmaking, alongside other variables. Yes, there are other variables too, but no I sadly can not share them with you right now however much I may want to in order to have more good discussion!
We are trying to look into ways to improve these issues but a matchmaking system with as many variables and moving parts as ours is easily one of the most complicated systems in our game. The small change we made a bit ago has definitely seemed to help those that we were attempting to help. We are simply looking at all of the knobs and levers we can pull to try to make the best impact with the least consequences and like all things in making games, this takes time.
I do very much appreciate all of the discussion and information you all have around this! While I may intimately know how everything works "under the hood" it is you guys that interact with the system and the results every day more than I ever could! So please do continue to share your thoughts, concerns, ideas, and complaints (in a nice way please
) and I will continue to do my best to help monitor the matchmaking system where I am able and when not working on other cool features to come
All the best,
IDaedalusI