Periodically cleanup Sitecore Analytics data

Question

We want to clean up Sitecore Analytics data (MongoDB + SQL) that are old (say 3 months).

I already looked at Sitecore ADM and this question

However, it seems that Sitecore ADM does not support scheduling of clean up.

Is there a way to do this task periodically in Sitecore 8.1 (update 3), e.g. once a day?

The only data i can see which you can clear is from the Interaction collection in MongoDB. The steps is first to remove the interaction from MongoDB which has a savedatetime greater than 3 months and then you will need to trigger the rebuild reporting database for the experience analytics dashboard to get updated. Note that rebuild reporting database can take time to complete depending on the amount of data in MongoDB — Hishaam Namooya, Aug 11, 2018 at 10:19
@HishaamNamooya Thank you - I will use this approach with a few additions (inspired by the Sitecore ADM module). For every interaction entry, clean up the associated contact, formdata, device and useragent collections. If you post a comment with your suggested approach I will mark it as an answer. — Hos, Aug 14, 2018 at 12:33
I've posted the above comment as an answer. Can you please approve it — Hishaam Namooya, Aug 14, 2018 at 12:37

Hishaam Namooya · Accepted Answer · 2018-08-14 12:35:12Z

2

The only data I can see which you can clear is from the Interaction collection in MongoDB. The steps are

First to remove the interaction from MongoDB which has a savedatetime greater than 3 months
Trigger the rebuild reporting database for the experience analytics dashboard to get updated.

Note that rebuild reporting database can take time to complete depending on the amount of data in MongoDB.

You can customize the approach based on your requirement if needed.

answered Aug 14, 2018 at 12:35

Hishaam Namooya

9,6261 gold badge17 silver badges37 bronze badges

How do you get around the limitation, that you need to add/remove a secondary connectionString 'reporting.secondary' for rebuilding the Analytics db? During rebuilding it has to exist, but after rebuilding is done, it should be removed again as far as I understand.
– Hos
Aug 20, 2018 at 9:18
Yes rebuild should be on the reporting.secondary. Once the rebuild is completed, you switch the connection string bu commenting the reporting.secondary then you update the primary one with the new analytics database. This is performed manually
– Hishaam Namooya
Aug 20, 2018 at 9:21
Ah too bad. I was hoping to create a 100% automatic task without any manual steps.
– Hos
Aug 20, 2018 at 11:23

Add a comment |

1 Answer 1