Museum pop survey - What's the chance of getting an 11%er?

Quali

Approved user
Joined
Dec 22, 2016
Messages
230
I can see that. But you don’t have anywhere near enough of a sample size to come to that conclusion yet. The other thing you need to be really careful of is when people give you stuff they aren’t being selective on what they remember to tell you, otherwise you void the whole sample.
 

Ulysses

Approved user
Joined
Nov 14, 2017
Messages
165
Yeah, I'd agree with you there... NoVelcroShoes ran his analysis 985 times... Danron & I have only run ours 425 times... so we need to add more data before we can say anything

But it is interesting...

On whether Danron can tell the difference between what '11%' looks like versus '6%' versus '1%', I'd give him the benefit of the doubt.
He sounds sensible, his numbers add up, and he isn't telling me something subjective like they were 'great' or 'good' or 'awful'. Just the numbers.
I know with absolute certainty that my CWA stats are accurate. I'm screenshotting, triple checking as I go along, and keeping it all in Excel.

That's why I decided to run the analysis.
Because many players felt that they were finding it harder to craft 11% artefacts than they were in the first few weeks after the Museum launched.
You're totally right that the Museum was new then, so some players may remember it being 'great', then gradually realising it's hard to get anything good.
I can't analyse 'felt'. But I can analyse numbers...

It would be really cool to see your stats, Quali?
 
Last edited:

Quali

Approved user
Joined
Dec 22, 2016
Messages
230
No, I did it 985 artifacts, not 985 times. At least I think I did. I will have to check
 

Ulysses

Approved user
Joined
Nov 14, 2017
Messages
165
I assume 197 artefacts?
With 5 lines per artefact?
Effectively running the analysis 985x...?

(btw that's A LOT of fragments!! you have some stamina, buddy!! :) )
 

Ulysses

Approved user
Joined
Nov 14, 2017
Messages
165
If you've got your original data, do you mind re-confirming that your chance for an 11% really was 6.0%?
Just anecdotally, that does feel kinda high...

PS. I'll correct the source from NoVelcroShoes to NVS+Quali. It's great work and was really useful at Museum launch.
 
Last edited:

Quali

Approved user
Joined
Dec 22, 2016
Messages
230
I had several in the alliance helping me. They would screen shot every one and I collated it. This was before we even knew all the different categories you could get, so we wanted to know.
 

Ulysses

Approved user
Joined
Nov 14, 2017
Messages
165
Yeah, your section on what each of the artefacts could buff/nerf across all of the different categories was exactly what we all needed, right up front.
Inspired work, my friend...!! Your alliance is lucky to have you...
 

Quali

Approved user
Joined
Dec 22, 2016
Messages
230
In answer to your earlier question, yes I do still have the analysis. I am not near it right now though. It was around 200 artifacts yes, but I wasn’t happy to say it was 6% for 11% on a line - my sample size was too low. Rather, I would take about the odds of getting better than 1% - that was around 40%. I tended to round the odds of an 11% to about 5% (a “rounder” number) but I think looking at the odds of 6 or 11% is more valid with such a small sample
 

Ulysses

Approved user
Joined
Nov 14, 2017
Messages
165
Thanks Quali ,

I guess what I want to be sure of is whether the 'observed mean' values that NoVelcroShoes quoted are what you actually found for your sample of N=985, at Museum launch, ie.
- 11% artefact lines came up 6% of the time
- 6% artefact lines came up 33% of the time
- 1% artefact lines came up 61% of the time

Obviously if you only found 11%s five percent of the time, that's very different to what NoVelco quoted?

The 'observed mean' values that Danron & I are finding now, in our smaller but growing sample of N=450, ie.
- 11% artefact lines are coming up 3.2%-4.5% (range dependent on era)
- 6% artefact lines are coming up 32.8%-40.8%
- 1% artefact lines are coming up 56%-64%

Simple observation suggests that there's no meaningful difference between the 1% and 6% observations that you made at Museum launch, and the ones that Danron & I are seeing now. Your results are at our lower end for 6%s, but both are within our ranges.

That your observed mean for 11% at Museum launch is outside, quite a lot higher than, the range that Danron & I are experiencing now is interesting. Absolutely, I agree that it's too early to say for sure whether anything has changed, but once observations get into the 1,000s it starts to become significant. It would be enough to approve a new medicine, for example...

6% of 1,000 tests is 60. So when you did it, your guys created approximately 60x 11% lines in their crafting.
3-4.5% of 1,000 tests is 30-45. So, at our current run rate, you'd expect Danron & me to score 11%s only 30-45x by the time we get to 1,000 runs.

I'd need to drop all the numbers into an SPSS app, which I can't do right now, but I can do in a couple of weeks, to calculate the actual confidence intervals. But I'm pretty sure 1,000 runs should be enough to show if the mean has shifted, within 95% confidence (forgive the boring stats, guys). Of course, only Nexon know for sure, if they modified the probabilities to get an 11%... We do know, with certainty, that Nexon reduced the sell back value of artefacts.

I kinda like the Museum. It's grown on me. It's powerful if you work it, and there are clever ways to improve it. Like Seraph and @Centurion 's ideas below. The numbers that Danron & I are running now, and that you run too when you run them, will be helpful to establish current probabilities... It's already changed the way that I play... Knowing I can only score an 11% every 1-in-25, I keep a lot more of them now! :)

Ully
.
EraEnlightenmentGlobalCold WarOriginal average at Museum launch*
Chance for 11% line3.2% (4 lines)3.2% (4 lines)4.5% (9 lines)6%
Chance for 6% line32.8% (41 lines)40.8% (51 lines)36.0% (72 lines)33%
Chance for 1% line64% (80 lines)56% (70 lines)59.5% (119 lines)61%
Chance for a dodo artefact (all lines 1%)8.0% (2 artefacts)8.0% (2 artefacts)7.5% (3 artefacts)N/A
Number of runs (so far)N=125N=125N=200N=985
.
Suggestions to improve Museum crafting: There are two current forum posts with clever suggestions to improve artefact crafting, possibly by allowing "recrafting" and "reshuffling", with the ability to "lock" the lines that you want to keep. If you like the idea, read the posts and talk to the TinSoldier :
https://forum.nexonm.com/forum/nexon...ving-artifacts (by Centurion96 )
https://forum.nexonm.com/forum/nexon...um-change-idea (by Seraph )
 
Last edited:

danron1376

Approved user
Joined
Dec 9, 2015
Messages
302
more results for the Enlightenment age (and yes I am careful to be as accurate as possible. this is the data that I got):
11: 5/125 = 4%
6: 39/125 = 31.2%
1: 81/125 = 64.8%
edited to ad: 2/25 artifacts had 1% for all the lines
 
Last edited:

danron1376

Approved user
Joined
Dec 9, 2015
Messages
302
more results for Global:
11: 8/125 = 6.4%
6: 39/125 = 31.2%
1: 78/125 = 62.4%
all 1%: 2/25
 

Ulysses

Approved user
Joined
Nov 14, 2017
Messages
165
Haha, yup, I figured as much D!
Is that a second set of 125 lines?
So 250 total for Enlightenment now?
 

Ulysses

Approved user
Joined
Nov 14, 2017
Messages
165
No Title

Results from ninth run at crafting five artefacts...

Cold war era - level 257
11% boosts - 3 across 3 artefacts
6% boosts - 13 across 5 artefacts
Dodo artefacts (all five lines score 1%) - nil

Once you get used to what 'normal' looks like, a couple of these weren't too bad... not great, but definitely not awful...
Monile Necklace - +11% NTG chance in 1st line, +6% food looted in 4th
Mycenas Heater - +6% in 1st, 2nd, 3rd & 4th; for vault interest, gold from caravans x2, forest expansion
Authepsa Heater - +11% Hunting in 1st line, -6% library tech food cost, +6% vault, +1% vault, +6% oil from oil wells
(screenshots below)

I'll update the master table after 10th run...
 

Attachments

  • photo12018.jpg
    photo12018.jpg
    22.6 KB · Views: 53
  • photo12019.jpg
    photo12019.jpg
    19.8 KB · Views: 56
  • photo12020.jpg
    photo12020.jpg
    19.8 KB · Views: 54

BeerMan

Approved user
Joined
May 10, 2017
Messages
415
Here are the results from my CWA account:

11: 10/125 = 8%
6: 43/125 = 34.4%
1: 72/125 = 57.6%

I had two artifacts that were all ones.
 

Ulysses

Approved user
Joined
Nov 14, 2017
Messages
165
Whoah!! Way to go, BeerMan .
You got x2 the rate of 11%s versus me & Danron.

Can you post screenshots of some of those 11%ers?
I'm curious to see what you got...
Were your 11%s spread around?
Or any combined together to create a really hot artefact...???

If it's not too much trouble, please can you go another 125.
I'd like to know if your results 'normalise'.
Or if your 11% rate stays up at double ours...
 
Last edited:

BeerMan

Approved user
Joined
May 10, 2017
Messages
415
I sold most of them and didn't take any screenshots, but I do have the distribution in a spreadsheet. The 11s were pretty spread out, and only one had the 11 in the first or second slot. I only saved one of them, it had 11% for food in slot 2 and 3. I don't have any use for it now, but if they release a new wall level I figured it might be one I could swap to for wall building. I will do another test and post the results later.
 

shukra

Approved user
Joined
Jul 12, 2017
Messages
355
level 222 atomic 20 artifacts: 10x 11%, 34x 6%, 0 'dud' artifacts.
level 220 atomic 20 artifacts: 3x 11%, 35x 6%, 3 'dud' artifacts with all 1%.
 

Ulysses

Approved user
Joined
Nov 14, 2017
Messages
165
Thanks for the updates Danron!

Shukra, I'll add yours to the table. You're our only Atomic so far.

BeerMan, I'm gonna wait for your next set; your results are so far out of line with 'normal' from everybody else that you're kind of an outlier right now. I'm curious to see if you 'normalise' back to everybody else, when you get more data? But if you don't, heck, can I buy your account??? :)

Results from my tenth run at crafting five artefacts...

Cold war era - level 257
11% boosts - nil
6% boosts - 8
Dodo artefacts (all five lines score 1%) - nil
 
Top