Questions tagged [content-testing]
For questions related to Sitecore's content testing capabilities and features, including its multivariate A/B testing and EXM Email variant AB testing.
57
questions
4
votes
2
answers
196
views
A/B testing is showing a change of 42% in Top Goal Converted. How Sitecore calculate this change value?
I implemented A/B testing in Sitecore 10.1.2. Now we are getting a result of Top Goal Converter. Now I am not able to understand how this Change value 42% is calculated, please check the image below. ...
0
votes
1
answer
44
views
AB Testing is not working on custom database but working on web database
I have started AB Testing in Sitecore 10.0.1 and in local it is working fine, I am able to see 2 different content.
On higher environment it is working on server with web database, but not working ...
- 31
1
vote
1
answer
389
views
Is it possible to do A/B or Multivariate testing in Sitecore XM scaled topology?
Can we use Sitecore A/B and multivariate testing in XM scaled topology? If no, what can be the possible options?
- 145
3
votes
1
answer
192
views
Sitecore A/B testing always shows default variant
I am using Sitecore 9.1 update 1.
I have setup A/B testing on component level. As it has workflow, I followed the article https://doc.sitecore.com/xp/en/developers/82/sitecore-experience-platform/...
- 760
2
votes
1
answer
63
views
Goals are not showing in Experience Editor when setting up a Test in Sitecore 9.3
I have created a new Goal in Sitecore’s Marketing Control Panel to track a certain page visit and successfully deployed it. Now I want to use that goal to measure an experience effect for my AB Test, ...
- 1,221
2
votes
1
answer
354
views
Setup a content test failed with NullReferenceException
I am new to Sitecore. We are using Sitecore SXA and Sitecore 9.3. I need to set up a simple A/B rendering test. When I provide a variation for the test in Experience Editor and click ok (see Picture ...
- 163
0
votes
0
answers
117
views
Always getting latest version of page item while test is running in sitecore 9.1
This is regarding the A/B test issue. We have prepared the test with page version 1 with content 1 and page version 2 with content 2. So whenever we browse the page then the content is changing ...
- 717
0
votes
0
answers
43
views
Issue in getting token using PowerBI
We are upgrading from Sitecore 8.2 to 9.3, and working on validating the PowerBI reporting features in 9.3. While validating, we got an issue as mentioned below:
AADSTS90002: Tenant '' not found. This ...
- 113
1
vote
0
answers
52
views
Personalisation Overview Preview is loading empty image
I am using Sitecore 9.2 in Azure environment. I see in Azure the Personalization Overview preview is empty which means it does not render page.
There is no firewall setting configured. I checked all ...
- 760
2
votes
0
answers
38
views
Page Test results changed page name
I successfully set up a page test achieved the results I wanted and picked a winner based on the stats (Page 1). I then noticed that my original Page 1 name in the content tree was changed to match ...
- 21
1
vote
1
answer
143
views
EXM A/B test statistics not displayed
Sitecore Version: 9.1 Update 1
In EXM, we created an A/B test campaign. We choose a winner manually (eg. Variant A) for this test. Now once this test is finished, we are unable to see the variant-wise ...
- 2,389
2
votes
1
answer
551
views
Content Testing error if Analytics cookie is not present in the request
Due to GDPR we have implemented a Cookie Consent banner on our Sitecore solution. As part of this implementation, we have created a custom pipeline to remove the SC_ANALYTICS_GLOBAL_COOKIE from the ...
- 303
1
vote
0
answers
148
views
Experience Optimization active tests aren't counting visitors
Version 9.2.0
Summary
After creating a content test, the number of visitors aren't reducing on page visits nor does it seem to be selecting content based on the Percentage of visitors exposed to the ...
- 11
1
vote
1
answer
310
views
"Index sitecore_suggested_test_index was not found" on CM 8.2 after changing the default Solr index name
I am running:
8.2 Update 7
Solr
xDB and Tracking enabled
The Solr instance is shared across DEV and QA, so I need to prefix the index names for all of the indexes so that they do not conflict. I ...
- 21
2
votes
1
answer
269
views
Page test not splitting 50/50
I am currently running a page test with 2 page variants:
Page A (original)
Page B (modified with some additional components and personalisation)
I can see that sitecore is currently splitting the ...
- 23
2
votes
1
answer
90
views
AB Split Test Based On Click Event
When setting up an AB split test, I know we have to set up goals on our destination pages and that can be used to determine whether the A or B is more valuable based on what the user clicked. This is ...
- 61
4
votes
0
answers
620
views
Disable unicorn sync for a specific field
On all our environments we decided to stop synchronisation of the page tests (aka A/B test). However there is a synchronisation on each item on the field "__Content test", which links it to ...
- 141
0
votes
1
answer
100
views
A/B testing using custom email template
I have created a custom message template.
I followed this link https://doc.sitecore.com/developers/exm/90/email-experience-manager/en/walkthrough--building-a-custom-message-template.html
Now I ...
- 121
1
vote
1
answer
50
views
Who are audience/user for Content Testing?
I am newbie for content testing. Once start testing using optimization tool(under experience editor) Is testing variation published to CD server and view by external user.
Please suggest.
- 1,484
1
vote
0
answers
34
views
Multi variant testing reporting issue
I have created a multivariant test for two different components and I have activated test.
Issue:
When I go to experience editor and click on Test Result, all fields are blank.
Error
Below error I ...
- 2,810
0
votes
1
answer
651
views
Want to disable Content Testing in Sitecore 9.0.1, having issues patching configuration
I've been asked by my client to disable content testing in Sitecore, as it will not be used in the near future and the hope is disabling it will improve site performance.
I've searched the ...
- 475
0
votes
0
answers
422
views
Component testing showing no results on Optimization tab in Sitecore 8.2
I have created a simple AB test for a compenent with 2 variations following the below link.
https://doc.sitecore.com/users/91/sitecore-experience-platform/en/preview-and-start-a-content-test.html
...
- 19
1
vote
2
answers
220
views
Content Testing Thumbnail 403 error in Azure
Locally I can start a content test and preview the variant thumbnails no problem.
In Sitecore 9.1.1 Azure PaaSsingle instance environment all I see are 403 errors instead of the thumbnails.
I have ...
- 1,383
3
votes
0
answers
59
views
A/B Testing - Why Variant A mail is being sent to all the recipients as default?
I'm Performing A/B Testing.Having 2 variant mails and 10 recipients. I specified the size of test as 40%. So the mail was sent to 4 recipients. In that 4 recipients, person who received variant B mail,...
- 121
1
vote
1
answer
262
views
Content testing - Variant preview is not appearing
I have set two variants ( two data sources for content testing) but it's not showing preview in "preview and start test" screen. Also when i click "start test" button, its keep on processing and never ...
- 906
1
vote
1
answer
119
views
Earlier version of item in multivariate test showing up as not found in preview
I set up a multivariate test by creating a new version of an item and changing the datasource of a certain render, I had no issues getting the pages to show up in the "review and start" section, but ...
- 531
0
votes
2
answers
129
views
AB Testing (Component Level) Variant Preview floating bar is disappearing after page load in Experience Editor
While doing component testing Variant Preview floating bar is disappearing after page load in Experience Editor. We are using Sitecore 8.2 (rev. 170728). Please let us know if anyone faced this issue ...
- 1
0
votes
0
answers
164
views
The site always displays the latest version of the item that is under the page test
I created and started a page test in Experience Optimization in Sitecore. During the test creation I created a new version of item that I was going to test. Then I moved the new version of item to the ...
- 11
1
vote
1
answer
450
views
Multiple versions of sitecore item under the page testing are retrieved from solr index
After the creation a page test for item, which is recorded to SOLR index, in Experience Optimization and creation some page versions to test against (during the test creation), when I get items from ...
- 11
4
votes
1
answer
179
views
Check personalization views on a component without AB tests
What should be done in order for one to check how many views a personalized view of a component has x the default version of that same component?
This component is on a homepage of a website and ...
- 5,678
2
votes
0
answers
129
views
Create a page test in Sitecore in multiple languages
We are trying to setup an A/B page test in Sitecore.
Since the site in which we want to start the test is in english and french, we want the test to apply to both languages.
However, when you ...
- 33
3
votes
1
answer
91
views
A/B Testing Data by Day
I realize this may be an odd request, but our Marketing department really wants to get A/B Testing Data per day. I can't seem to find an easy way to do this. Is this something that I'd be able to find ...
- 83
1
vote
1
answer
332
views
Sitecore roles required for content testing
I'm using Sitecore 8.2 Update 7 and I'm trying to restrict access to my Sitecore Content Editors. One of them wants to run a content test using the built-in testing controls. When I go to "Create a ...
- 2,938
0
votes
1
answer
246
views
How to set a goal that only counts two specific pages visited in succession?
How do I set up a goal that uses a rule in Sitecore that only counts those users who have visited two pages in succession? It's important that I exclude all traffic that haven't visited these pages in ...
- 1
0
votes
1
answer
556
views
Sitecore AB Page test setup issue - Test combination does not match the test definition
I'm trying to setup a A/B page test in Sitecore 8.2 Update 5 and when I start the test, I see the below error message and the page blows up.
Exception: System.InvalidOper1tionException
Message: Test ...
1
vote
1
answer
224
views
Sitecore AB Testing issue - 8.2 Update 5
I have setup a AB Test at page level in Sitecore 8.2 Update 5 and cancelled it manually.
When I try to setup the same AB Test again, it is throwing an error message in Experience Optimization.
Do ...
5
votes
1
answer
700
views
A/B testing a product landing page
I am trying to figure out if the following use cases are supported natively in Sitecore 9 or if there would be custom development (and if so, the best approach to leverage):
Simplified Test Scenario - ...
- 51
5
votes
1
answer
791
views
Sitecore AB Testing with different components
I know I am touching a bit of Personalization here. But I am trying to understand something pretty basic.
I want to do A/B testing but not with a different set of content (data source) but two ...
- 519
0
votes
1
answer
103
views
Test Suggestion log error
Log showing message as “Error Occurred” when page displayed in edit mode.
Un-commented the definition of Sitecore_suggested_test_index. The error is not showing up now. Is this index needs to be ...
- 562
1
vote
0
answers
382
views
"Forbidden" error when attempting to create test through Experience Editor
I need some help on creating Content level testing in my pages through Experience Editor. I get a "Forbidden" message when trying to create a test on a page on my website page through Experience ...
- 703
1
vote
0
answers
249
views
Page test in Experience Optimization on Azure Fails
Sitecore Experience Optimization Page Testing.
On Sitecore 9, I am trying to test created simple page in Experience Optimization. Locally everything working fine. When i tried same steps in Azure ...
- 21
2
votes
2
answers
2k
views
How to disable Content Testing in Sitecore 8.2
I tried to disable Optimization stuff for Experience editor and did everything that described here:
https://sitecoresaga.wordpress.com/2016/12/21/disabling-content-testing-in-sitecore-8-2/
and
...
- 1,198
4
votes
1
answer
259
views
Historical test results for A/B & MV testing
During an A/B test, I was able to see results such as number of visitors to each version, conversions rates etc.
But now when the test has ended, I cannot see any of the data. I have looked at ...
- 41
4
votes
1
answer
195
views
View MV test results after finishing a test
A question popped up yesterday when I was discussing MV testing with a client.
When starting a MV test, there is the option to automatically select a winner after either the result is statistically ...
- 305
1
vote
1
answer
145
views
How to measure personalization efforts
The big question! You can have all the personalization scenarios in the world, at some point you want to know what the hard numbers are. Sitecore gives the opportunity to test components, however A/B ...
- 173
1
vote
0
answers
394
views
Intermittent Null reference error Sitecore 8.0 update 6
I am currently facing intermittent null reference error related to content testing pipeline. When I refresh the page Sitecore doesn't throw any error.
After sometime when I click on any content item, ...
- 1,676
4
votes
1
answer
486
views
Page level tests with different templates
I currently have the requirement to set up page level tests to test two different pages against each other. I am doing this in the Experience Optimization application using the 'use existing' button ...
- 392
4
votes
1
answer
427
views
How can I get the variable names / each outcome of an A/B test from the code?
From a rendering controller, I am trying to list the variable names / each outcome of an A/B test programmatically.
Here is my A/B test:
Firstly, I inspected the renderings using the code below but ...
- 2,051
3
votes
1
answer
823
views
How do I do a component test for a personalized component?
I'm running Sitecore 8.1 (Original Release), using the personalization features of Sitecore. Here's what my setup looks like:
I have a "donate" banner component that is personalized based on how much ...
- 2,938
0
votes
1
answer
130
views
Multivariant Testing for Components
Can we apply for Multivariant testing on Static Components?
If Yes, then how or Is Multivariant testing recommended only for Dynamic Components?
- 113