My previous experience of MMOs and ARPGs would tell me that balance changes āafter-the-factā seem to be generally perceived as coming ātoo lateā to the table, or simply end up taking much longer to come into play than they perhaps could have done, because by the time the systems are implemented, development is usually already moving away from that system, onto the next.
This process usually seems to leave behind the idea of making tweaks to that system, since it is then āfinishedā-ish; even on the balance, which can be hard to predict ā unless the balance of that system really does affect a core part of gameplay.
And from the developer point of view, it can of course be a dangerous thing to do to get the balance too far in a buffed direction, to then have to nerf it, and have players be upset because there is a perceived nerf even if the situation is still better than the original one.
But in my mind, that does highlight the importance of making balance changes while we are in Testing and not leaving it ātoo lateā for a release candidate version or for a post-release version; an āafter-the-factā version, if you will.
That said, I understand why you are asking us, as fellow players, to find the data to contribute to making the systems better, or balanced in a fair way ā but these are indeed somewhat large time-scales for a gameplay system with, in fairness, quite a bit of depth to it. A single player has to dedicate a lot of their own personal time to be able to gather any significant data on this.
Players like me and @AeneaGames do have plenty of time on our hands, but collecting data isnāt necessarily always something fun, and we are, I would expect, a minority. If it feels like such a large endeavour to us (well, it does to me), what must it feel like for players with a fraction of the time we have available?
I am not disputing the potential usefulness of the data, however. I think my line of thought comes from the fact that I, personally, find it hard to believe that the developers canāt already track and access all the relevant data, based on the actions of players in-game every day.