# 1000 tributes collected. Here are the results. Worrying

Looking at the data, it seems somewhat likely that the kingdom tribute chance and the statue tribute chance are considered two isolated events. Meaning that for each kingdom you get two rolls, one on the kingdom chance and one on the statue chance, if either one hits you receive tribute.

1 Like

There is no “gambling fairy” that makes sure that, by the time you reach some number of trials, you have exactly the “right” number of results for every option.

If you toss a coin 1,000 times, it is very rare you’ll get 500/500.

If you roll a D4 1,000 times, it is very rare you’ll see 250 of each face.

If you roll a D10 1,000 times, it is very rare you’ll see 100 of each face.

What Ivar means is, in all of these cases, if you look how far “off” you are and quantify that “miss” with a number like standard deviation, we expect that as “number of trials” gets bigger, or as more people do 1,000 samples, that deviation will get smaller and smaller.

So while it’s rare to get 500/500 out of 1,000 coin tosses, when you get to 10,000 tosses it’s more likely you are CLOSER to 5000/5000 than you were to 500/500. But if, as you accumulate more and more data, you get further and further away from the expected result, things get concerning.

But probability is a cruel mistress. It is completely within the realm of possibilities that you could get a 9999/1 result out of 1,000 coin tosses. Especially if you aren’t taking video to prove it. How many samples is “enough”? It can be subjective.

Considering how many kingdoms there are and the relatively low probability of any one kingdom giving a tribute, 1,000 seems like a small (but tedious) number of trials. I’d spend more rolls proving a D20 is fair than I’d spend coin tosses.

Ok, thanks! I will still wait for a dev to confirm that but it transform the impossible into just a very very bad luck thing.
Now could I receive 2 times a tribute from the same kingdom? One time with the 20 or 30% and then 1 time with the 6%?

If you toss 10x 100 times a coin, its also very rare you will always get much more heads every 100 tries. and never one time more tails. Especially considering you have more chance to receive tails (read 2 kingdoms at 36% and not just all 30 kingdoms at 26%)

Sirrian would probably respond with at least half an essay, too bad he doesn’t frequent the boards any longer. Anyway, 1000 samples gives a very high confidence rating that the two probabilities aren’t just added up.

I’m afraid not, your tribute counters would be much higher.

1 Like

(in which the total sample between all of them was much smaller, showed a trend, was investigated, was determined to not be working correctly, and subsequently “fixed” but the fix was not specified)

There is also a precedent of them accidentally leaving an entire kingdom off the tribute table for several months (it was impossible to tribute from that kingdom, skewing the values).

We could see a trend away from expectation with any given data set, no matter how big, it just becomes increasingly unlikely and eventually enough to be called “statistically impossible”. So the while the sample isn’t conclusive, there is no way we’d be able to get that kind of data from our end either way. At the same time, this isn’t the 415th post of someone complaining about AI resurrects, devours, explodes, cascades, or anything else supplying anecdotal evidence and not actually recording anything. We have 1000 samples here. Not 1000 coin flips. 30,000 independent trials grouped into 1000 sets of 30 consecutive trials each, grouped into smaller sets of 100 that show a trend. I think this deserves a bit more scrutiny than “yeah, but it could still happen because random is random so everything is working fine as is, but if you showed me a million samples, then we’ll talk”.

This isn’t the same as the 415 other threads complaining about RNG or AI bias because they have a “feeling” or they saw that one time that one extremely improbable event happening or a bunch of “bad” events happening more than they think they should but without recording any hard data, or with them starting with skewed data by recording the edge case first and ending on another arbitrary number where they got a result confirming their assertion. If it was, I’d be right there siding with the skeptics. I think this warrants investigation, or at very least a response. That way, when the next person comes up claiming they “feel” their tributes are slightly lower than the expected 26%, I can just say “yeah, but its actually 24.8% because they are rolled independently but you can’t double tribute the same kingdom. Here is the dev response. Assuming that, these numbers are now much closer to the expected values”, and save them from either thinking the game is somehow “cheating” them or gathering 1000 tribute samples (months of data gathering, mind you) and have it just brushed aside by “yeah, RNG is RNG, what can you do?”.

6 Likes

Thanks for this post! About the little quote of the kingdom skipped and never giving tributes: I am asking since now 2 years to have the option to see the kingdom names who awarded tributes with detailed explanation. But without success. I would love to see when I receive 10 tributes, the name of the 10 kingdoms who awarded the tributes with detailed explanation of glory, gold and souls gained from all of them. I still hope to see this feature one day.

1 Like

Yes we ‘could’, and its very possible. but I doubt it. For being close to max on the same system as @anon43026234 my tributes are not quite where they were ~4 months ago. Even adding a new Kingdoms has not pulled things up.

Unfortunately I have no recorded data, but frequently fire the game up just to collect so I keep an eye on it, for over two years now I’ve been watching Tributes totals.

I would not be surprised to learn that a small bug was accidently introduced a few months ago.

2 Likes

Out of 1000 tributes what was your highest tribute?

I tracked my own data for a while some months ago. Probably close to 1000 tributes. I spent two or three months well below my expectation value. At one point I was more than 99% confident that I wasn’t getting the correct tributes. Made a thread and everything.

Then, the next month, I was so far above the expected values that things rapidly approached the mean again. I was pulling 12, 13 and 14-kingdom tributes like crazy.

I suspect, but obviously can’t prove, that Truxton is in a similar place to where I was. People who track tribute chances and get normal/high results don’t make threads about it.

In response to someone else’s question, I have seen 15-kingdom tributes multiple times. I don’t remember seeing anything 16 or higher, but those are so rare it’s entirely possible that I wouldn’t have seen one anyway, even across months of tracking.

I was wrong about how many tributes I tracked. It was less than 1000, but easily thousands of individual chances for kingdoms to give tribute. Which, if they are all independent, is just as good as tracking tribute totals.

3 Likes

As noted in the thread you linked, they specifically said they didn’t change any tribute values as of 3.1, but all the numbers posted in your thread would fit better if you assume tribute chance was 24.8% rather than 26. Pre April 2017, the 6% was being applied multiplicatively (so we were getting 21.2% per kingdom) and was supposedly fixed to be additive at that time (posted the link above), which should be 26% for three star and above kingdoms (before 9 star). Your thread was dated September 2017 and specified post 3.1, so all your data should have come from after that fix.

It looks like you didn’t post the numbers when you started trending back toward 26%, which I really think would be useful here. As of now, all data sets posted on the forums, including the ones you collected and were sent to you, are showing below the expected 26%.

Either way, if it does turn out they purposely implemented it in a different way that causes slightly lower numbers than expected but still a mathematically sound 6% (eg., independently rolled checks for the 6% statue and the 20% kingdom chance, as has been postulated, giving an effective 24.8%), I’d be fine with that (others might not be, but really, what could we do either way), it would just be nice to know. But if it is an actual mistake, it can be corrected.

4 Likes

Good post. You may be on to something here, although I’d like a larger sample size. I suspect there may be an issue with the formula as you propose.

15 was my highest tribute. I received it 2 times (its expected to receive 3x a 15 tributes over 1000 tributes collected).

I haven’t cleared my recycle bin in months, which means I still have the spreadsheet. How convenient!

The last time I posted a table in my old thread, here’s what I saw:

Kingdoms # Times Expected # Difference
0 0 0.04 0
1 0 0.42 0
2 3 2.05 1
3 9 6.47 3
4 15 14.8 0
5 29 26.0 3
6 44 36.5 8
7 56 42.1 14
8 30 40.7 -11
9 29 33.4 -4
10 19 23.4 -4
11 8 14.2 -6
12 8 7.50 1
13 2 3.44 -1
14 1 1.38 0
15 0 0.49 0

The next many tributes came and went, and here’s what I ended up with:

Kingdoms # Times Expected # Difference
0 0 0.10 0
1 1 1.00 0
2 4 4.94 -1
3 16 15.6 0
4 42 35.7 +6
5 72 62.7 +9
6 93 88.1 +5
7 115 102 +13
8 81 98.3 -17
9 63 80.6 -18
10 61 56.6 +4
11 29 34.4 -5
12 18 18.1 0
13 10 8.32 +2
14 4 3.34 +1
15 2 1.17 +1
16 0 0.36 0

These numbers are a good mix of above/below average. Earlier versions of this table, as shown above, were always below expectation above my average value, and always above expectation below the average. It’s still not quite at average, but it’s better. The net success rate is about 25.5%, with a 95% confidence interval that includes both 24.8% and 26%.

1 Like

I understand what you mean, but thats not what I experienced. I even received 3 more 12 tributes and 4 more 13 tributes than expected.

My problem was to see every new blocks of 100 tributes going always more than expected in the 0 to 6 tributes group. You can see in my opening post that, excepted the 0 tribute that I never received, all other tributes in the 0 to 6 group were collected more than expected. Especially more strange when you consider my expected numbers are for 30 kingdoms at 26% but I had in reality 1 and then 2 kingdoms at 36% for the whole 1000 tributes collected! (I just had no idea how to calculate the probabilities when not all kingdoms are at same chances. Thats why I used the probabilities for 30 kingdoms at 26%).

But as some players mentionned above, the problem could come from how the guild statue give the 6% bonus. (26%, 24,8% or 21,2%) I hope a dev will explain us how its calculated.

Focussing only on the opening post - I don’t think those results are skewed far south enough of the expected values to draw anything other than a minor sense of unease. 35% in the low band instead of 30% is hardly disastrous.

I am not rubbishing the post @anon43026234 or the effort behind it, but I don’t think anyone needs to be too alarmist just on this data.

I do sense myself that tributes feel low… but that’s an emotional response, I have no evidence really…

Thanks for posting these 2 stats.

You can see you have same prob as me the 2 times.
on 1st page you received 15 more tributes in the 0 to 6 tributes group and 11 less than expected in the 7 to 30 group.
On the 2nd page, you received 19 more tributes than expected in the 0 to 6 group and 19 less in the 7 to 30 group.

You might be right but keep in mind I had 1 kingdom at 36% chance (for the 1st 837 tributes collected) and then 2 kingdoms at 36% chance (for the last 163 tributes collected) so I had in reality for the whole 1000 tributes LESS than 30,3% chance to receive a tribute in the 0 to 6 group.
My math have limits and I cant tell you exactly the exact probability, but obviously lower than this 30,3%.

I bet the whole game (including tributes) runs from the same questionable & streaky RNG algorithm.

1 Like

As we discussed with Grundulum previously about his data, to actually reliably do any statistical test, the data has to be recorded in the order it was generated. Then, it is possible to determine whether t is random and what is the expected 95% or 99% confidence interval. If this is the case, please let me know and upload your spreadsheet somewhere. I can run the tests or tell you how to do it.

The rolls for tribute are apparently run on the server. So, that means most likely pRNG seed based on server clock for a particular session sequence. To put it bluntly, it might be not very random but it might as well be. This can be only determined with exact sequence from tribute 1 to tribute 1000.

it is also possible to compare the results with a simulation which can be created in Excel (any version after MS Office 2010 will suffice).

1 Like