Questions tagged [content-testing]

For questions related to Sitecore's content testing capabilities and features, including its multivariate A/B testing and EXM Email variant AB testing.

Filter by
Sorted by
Tagged with
4 votes
1 answer
474 views

Page level tests with different templates

I currently have the requirement to set up page level tests to test two different pages against each other. I am doing this in the Experience Optimization application using the 'use existing' button ...
0 votes
1 answer
39 views

AB Testing is not working on custom database but working on web database

I have started AB Testing in Sitecore 10.0.1 and in local it is working fine, I am able to see 2 different content. On higher environment it is working on server with web database, but not working ...
1 vote
1 answer
104 views

Is it possible to do A/B or Multivariate testing in Sitecore XM scaled topology?

Can we use Sitecore A/B and multivariate testing in XM scaled topology? If no, what can be the possible options?
3 votes
1 answer
78 views

Sitecore A/B testing always shows default variant

I am using Sitecore 9.1 update 1. I have setup A/B testing on component level. As it has workflow, I followed the article https://doc.sitecore.com/xp/en/developers/82/sitecore-experience-platform/...
2 votes
1 answer
75 views

AB Split Test Based On Click Event

When setting up an AB split test, I know we have to set up goals on our destination pages and that can be used to determine whether the A or B is more valuable based on what the user clicked. This is ...
1 vote
1 answer
380 views

Multiple versions of sitecore item under the page testing are retrieved from solr index

After the creation a page test for item, which is recorded to SOLR index, in Experience Optimization and creation some page versions to test against (during the test creation), when I get items from ...
4 votes
1 answer
170 views

Check personalization views on a component without AB tests

What should be done in order for one to check how many views a personalized view of a component has x the default version of that same component? This component is on a homepage of a website and ...
0 votes
2 answers
121 views

AB Testing (Component Level) Variant Preview floating bar is disappearing after page load in Experience Editor

While doing component testing Variant Preview floating bar is disappearing after page load in Experience Editor. We are using Sitecore 8.2 (rev. 170728). Please let us know if anyone faced this issue ...
4 votes
1 answer
193 views

View MV test results after finishing a test

A question popped up yesterday when I was discussing MV testing with a client. When starting a MV test, there is the option to automatically select a winner after either the result is statistically ...
4 votes
1 answer
252 views

Historical test results for A/B & MV testing

During an A/B test, I was able to see results such as number of visitors to each version, conversions rates etc. But now when the test has ended, I cannot see any of the data. I have looked at ...
2 votes
1 answer
41 views

Goals are not showing in Experience Editor when setting up a Test in Sitecore 9.3

I have created a new Goal in Sitecore’s Marketing Control Panel to track a certain page visit and successfully deployed it. Now I want to use that goal to measure an experience effect for my AB Test, ...
0 votes
0 answers
106 views

Always getting latest version of page item while test is running in sitecore 9.1

This is regarding the A/B test issue. We have prepared the test with page version 1 with content 1 and page version 2 with content 2. So whenever we browse the page then the content is changing ...
2 votes
1 answer
532 views

Content Testing error if Analytics cookie is not present in the request

Due to GDPR we have implemented a Cookie Consent banner on our Sitecore solution. As part of this implementation, we have created a custom pipeline to remove the SC_ANALYTICS_GLOBAL_COOKIE from the ...
2 votes
1 answer
275 views

Setup a content test failed with NullReferenceException

I am new to Sitecore. We are using Sitecore SXA and Sitecore 9.3. I need to set up a simple A/B rendering test. When I provide a variation for the test in Experience Editor and click ok (see Picture ...
0 votes
0 answers
42 views

Issue in getting token using PowerBI

We are upgrading from Sitecore 8.2 to 9.3, and working on validating the PowerBI reporting features in 9.3. While validating, we got an issue as mentioned below: AADSTS90002: Tenant '' not found. This ...
1 vote
0 answers
51 views

Personalisation Overview Preview is loading empty image

I am using Sitecore 9.2 in Azure environment. I see in Azure the Personalization Overview preview is empty which means it does not render page. There is no firewall setting configured. I checked all ...
2 votes
0 answers
38 views

Page Test results changed page name

I successfully set up a page test achieved the results I wanted and picked a winner based on the stats (Page 1). I then noticed that my original Page 1 name in the content tree was changed to match ...
1 vote
1 answer
132 views

EXM A/B test statistics not displayed

Sitecore Version: 9.1 Update 1 In EXM, we created an A/B test campaign. We choose a winner manually (eg. Variant A) for this test. Now once this test is finished, we are unable to see the variant-wise ...
1 vote
0 answers
123 views

Experience Optimization active tests aren't counting visitors

Version 9.2.0 Summary After creating a content test, the number of visitors aren't reducing on page visits nor does it seem to be selecting content based on the Percentage of visitors exposed to the ...
4 votes
0 answers
566 views

Disable unicorn sync for a specific field

On all our environments we decided to stop synchronisation of the page tests (aka A/B test). However there is a synchronisation on each item on the field "__Content test", which links it to ...
1 vote
1 answer
293 views

"Index sitecore_suggested_test_index was not found" on CM 8.2 after changing the default Solr index name

I am running: 8.2 Update 7 Solr xDB and Tracking enabled The Solr instance is shared across DEV and QA, so I need to prefix the index names for all of the indexes so that they do not conflict. I ...
2 votes
1 answer
238 views

Page test not splitting 50/50

I am currently running a page test with 2 page variants: Page A (original) Page B (modified with some additional components and personalisation) I can see that sitecore is currently splitting the ...
1 vote
2 answers
216 views

Content Testing Thumbnail 403 error in Azure

Locally I can start a content test and preview the variant thumbnails no problem. In Sitecore 9.1.1 Azure PaaSsingle instance environment all I see are 403 errors instead of the thumbnails. I have ...
1 vote
1 answer
234 views

Content testing - Variant preview is not appearing

I have set two variants ( two data sources for content testing) but it's not showing preview in "preview and start test" screen. Also when i click "start test" button, its keep on processing and never ...
0 votes
1 answer
96 views

A/B testing using custom email template

I have created a custom message template. I followed this link https://doc.sitecore.com/developers/exm/90/email-experience-manager/en/walkthrough--building-a-custom-message-template.html Now I ...
1 vote
1 answer
50 views

Who are audience/user for Content Testing?

I am newbie for content testing. Once start testing using optimization tool(under experience editor) Is testing variation published to CD server and view by external user. Please suggest.
1 vote
0 answers
34 views

Multi variant testing reporting issue

I have created a multivariant test for two different components and I have activated test. Issue: When I go to experience editor and click on Test Result, all fields are blank. Error Below error I ...
0 votes
1 answer
617 views

Want to disable Content Testing in Sitecore 9.0.1, having issues patching configuration

I've been asked by my client to disable content testing in Sitecore, as it will not be used in the near future and the hope is disabling it will improve site performance. I've searched the ...
0 votes
0 answers
398 views

Component testing showing no results on Optimization tab in Sitecore 8.2

I have created a simple AB test for a compenent with 2 variations following the below link. https://doc.sitecore.com/users/91/sitecore-experience-platform/en/preview-and-start-a-content-test.html ...
3 votes
0 answers
57 views

A/B Testing - Why Variant A mail is being sent to all the recipients as default?

I'm Performing A/B Testing.Having 2 variant mails and 10 recipients. I specified the size of test as 40%. So the mail was sent to 4 recipients. In that 4 recipients, person who received variant B mail,...
1 vote
1 answer
109 views

Earlier version of item in multivariate test showing up as not found in preview

I set up a multivariate test by creating a new version of an item and changing the datasource of a certain render, I had no issues getting the pages to show up in the "review and start" section, but ...
0 votes
0 answers
140 views

The site always displays the latest version of the item that is under the page test

I created and started a page test in Experience Optimization in Sitecore. During the test creation I created a new version of item that I was going to test. Then I moved the new version of item to the ...
2 votes
0 answers
117 views

Create a page test in Sitecore in multiple languages

We are trying to setup an A/B page test in Sitecore. Since the site in which we want to start the test is in english and french, we want the test to apply to both languages. However, when you ...
3 votes
1 answer
91 views

A/B Testing Data by Day

I realize this may be an odd request, but our Marketing department really wants to get A/B Testing Data per day. I can't seem to find an easy way to do this. Is this something that I'd be able to find ...
1 vote
1 answer
322 views

Sitecore roles required for content testing

I'm using Sitecore 8.2 Update 7 and I'm trying to restrict access to my Sitecore Content Editors. One of them wants to run a content test using the built-in testing controls. When I go to "Create a ...
0 votes
2 answers
1k views

AB testing: Only getting "Item has a test in draft message" in Sitecore 8.1

AB Testing: In Test Definition Item under the Test Lab I have set the workflow as sample Workflow and workflow state as Awaiting Approval. But when I saved the item I am only getting "item has a test ...
0 votes
1 answer
240 views

How to set a goal that only counts two specific pages visited in succession?

How do I set up a goal that uses a rule in Sitecore that only counts those users who have visited two pages in succession? It's important that I exclude all traffic that haven't visited these pages in ...
0 votes
1 answer
550 views

Sitecore AB Page test setup issue - Test combination does not match the test definition

I'm trying to setup a A/B page test in Sitecore 8.2 Update 5 and when I start the test, I see the below error message and the page blows up. Exception: System.InvalidOper1tionException Message: Test ...
1 vote
1 answer
219 views

Sitecore AB Testing issue - 8.2 Update 5

I have setup a AB Test at page level in Sitecore 8.2 Update 5 and cancelled it manually. When I try to setup the same AB Test again, it is throwing an error message in Experience Optimization. Do ...
1 vote
1 answer
145 views

How to measure personalization efforts

The big question! You can have all the personalization scenarios in the world, at some point you want to know what the hard numbers are. Sitecore gives the opportunity to test components, however A/B ...
5 votes
1 answer
692 views

A/B testing a product landing page

I am trying to figure out if the following use cases are supported natively in Sitecore 9 or if there would be custom development (and if so, the best approach to leverage): Simplified Test Scenario - ...
5 votes
1 answer
750 views

Sitecore AB Testing with different components

I know I am touching a bit of Personalization here. But I am trying to understand something pretty basic. I want to do A/B testing but not with a different set of content (data source) but two ...
0 votes
1 answer
101 views

Test Suggestion log error

Log showing message as “Error Occurred” when page displayed in edit mode. Un-commented the definition of Sitecore_suggested_test_index. The error is not showing up now. Is this index needs to be ...
1 vote
0 answers
379 views

"Forbidden" error when attempting to create test through Experience Editor

I need some help on creating Content level testing in my pages through Experience Editor. I get a "Forbidden" message when trying to create a test on a page on my website page through Experience ...
1 vote
0 answers
249 views

Page test in Experience Optimization on Azure Fails

Sitecore Experience Optimization Page Testing. On Sitecore 9, I am trying to test created simple page in Experience Optimization. Locally everything working fine. When i tried same steps in Azure ...
2 votes
2 answers
2k views

How to disable Content Testing in Sitecore 8.2

I tried to disable Optimization stuff for Experience editor and did everything that described here: https://sitecoresaga.wordpress.com/2016/12/21/disabling-content-testing-in-sitecore-8-2/ and ...
1 vote
0 answers
382 views

Intermittent Null reference error Sitecore 8.0 update 6

I am currently facing intermittent null reference error related to content testing pipeline. When I refresh the page Sitecore doesn't throw any error. After sometime when I click on any content item, ...
4 votes
1 answer
403 views

How can I get the variable names / each outcome of an A/B test from the code?

From a rendering controller, I am trying to list the variable names / each outcome of an A/B test programmatically. Here is my A/B test: Firstly, I inspected the renderings using the code below but ...
2 votes
1 answer
156 views

Multivariant tests goals vs a page visit [closed]

What is the best approach for setting up a goal to measure the success of a component test within Sitecore? Let's say I have two components in my test and they have a different colored button. I have ...
3 votes
1 answer
808 views

How do I do a component test for a personalized component?

I'm running Sitecore 8.1 (Original Release), using the personalization features of Sitecore. Here's what my setup looks like: I have a "donate" banner component that is personalized based on how much ...