I am currently running a page test with 2 page variants: Page A (original) Page B (modified with some additional components and personalisation)
I can see that sitecore is currently splitting the traffic 30% to Page A and 70% to Page B which is not what I expected. I have run a few tests previously and all of them have a 50/50 split, but for some reason my current test has an odd 30/70 split.
From what I've read in the sitecore documentation the variants shown should be controlled using the subgroup round robin sticky strategy and since there are only 2 variants in the test the split should roughly be 50/50 but the split is distinctly 30/70 from what I can see. I thought maybe sitecore would equal out the spit allocation but it's been 8 days already an the split is consistently 30/70.
I am currently using the following settings for my page test: Test Strategy: Subgroup Round Robin Sticky Traffic allocation: 100%, Expected effect: Positive, Confidence level: 90%, Duration min: 3 days, Duration max: 30 days
The only difference in set up between this test and my previous test is that I selected No change for the expected effect previously, also my previous test didn't have any personalisation. In this test there is some personalisation to hide certain components if the device is mobile or tablet, however I wouldn't expect this personalisation to effect the split allocation because this is a page test as opposed to a content or component test.
If anyone has an answer to why this might be happening then it would be much appreciated.