Please check the total key drops from the last vault event before this weekend

Many players and guilds experienced a statistically unlikely lack of epic vault key drops during the last vault event. Because vault keys are so rare, it’s difficult for players to see if something is actually wrong. Can someone look at the logs from the last vault event and report either:

-The number of vault keys that dropped, and the number of epic keys that dropped, or
-The observed ratio of epic keys to vault keys during the vault event

It was previously stated that the code looks fine, but that doesn’t mean very much. One popular theory is that the epic vault key droprate isn’t increased on vault weekends, making epic keys a significantly smaller proportion of total keys than was intended. There could be many other explanations, but if things are working correctly, a quick look at the data would put our minds at ease.

Droprates are absolutely sacred in a game like this, especially when the rates are very low. If players don’t trust the promised odds, they won’t want to spend money or engage with your content. People are going to spend hundreds of hours farming and collecting data this weekend; it would be greatly appreciated if someone could check the logs in advance.

Thanks for considering this request! I know that your development schedule is very hectic, especially in the current year, and that it’s frustrating to explain things to people who don’t understand Statistics. It would be great to have some kind of statement before people start running hypothesis tests and building confidence intervals.

6 Likes

This has been asked many times, and has led me to believe that ∞+2 doesn’t control the whole development pipeline (pure conjecture).
The official reply has been given along the lines of code audit, and we’ll just have to put our faith into that, :crossed_fingers:t2:, hope for :four_leaf_clover: this weekend and look at the data again.

The code has been audited. It is working correctly.
                          ^
                          |
         (hoping secret sauce added in between**)

** if it ever was faulty in the first place :wink: :man_shrugging:t2: :upside_down_face:

FYI - data collection is open for business again this weekend here

Nope. I trust the devs on a lot of things, but they’ve lost my trust on admissions of error when the data clearly shows that something went wrong. It looks like we’re going to have at least one more Vault weekend with horrendously low Epic Key drop rates before something is done (either to correct the drop rate or admit they never intended to give us 10% Epic Keys).

1 Like

Why does a fix** to the drop rate need to be dependent on this?
I care only about the former, I couldn’t care less about the latter and won’t get hung up over it. I don’t care to abuse developers to get the latter, but would like to help in any way to cause the former.

** if it was ever wrong…

I will commit to tracking all gnomes and keys. Looks like a rainy weekend…

2 Likes

Exactly this. If there was a problem and it was stealth fixed between events, I’m completely (well, 99%) fine with this. I just want to make sure it’s working correctly before I spend dozens of additional hours casting Phoenicia.

Giving this one hopeful bump before the work week ends. Thanks to everyone who’s committed to tracking drops in the other thread!

Is anyone finding gnomes? I’ve only found 2 gnomes in 20 minutes, yet the first one dropped a regular vault key…

edit: 3 in 24 minutes, 3rd gnome dropped a vault key

I’ve found 5, 1 vault key.

1 Like

Nope they are not appearing at all. But I’m at work so that might have something to do with it. :joy:

3 Likes

Three gnomes in ~ 1 hour of explore. 1 Gem Key, 1000 Glory, and 2500 Gold.

image

1 Like

One last post-weekend bump.

Players spent hundreds of hours collecting precommitted data across thousands of drops, and have shown with 99.99% confidence that the drop rate is dramatically lower than was advertised and was double-checked. The math points to the drop rate being off by nearly an order of magnitude.

There hasn’t yet been any response, but hopefully that’s because the issue is being investigated further and compensation for time wasted is being decided on.

This is more important than the value of an epic key or the associated achievement; this update, along with several others, has completely shattered my faith in advertised drop rates. As someone who spent a few dozen hours across two weekends grinding for an epic key drop, I’m really struggling to find the motivation to keep playing this game.

Ok, that’s all from me on this issue. Thanks again to everyone who collected data!

6 Likes

I don’t even think I’d be that upset if they were actually supposed to be this rare. Especially not if they were ever a guaranteed reward somewhere at some point.

What bothers me is the mis-stated rate, and the failure to address it. And no — that doesn’t mean don’t tell me the rates.

That means when you state the intended rates (as you should), be sure that you are both correct-in-statement and confident that the coding pans out results that match the stated rate.

6 Likes

I would say we are an active guild, 30 members. Not one person in our guild has come forward to say they got an Epic key from playing this gnome weekend. Also, I did PvP for many hours. I found 2 pet gnomes, and very few gnomes overall this time. Because of my hours of grinding PvP and Explore, I did reach but not complete the 2nd tier of gnome rewards. Very disappointed in the outcome, but not surprised.

1 Like