1

Please let me know if you need any more information from my side.

I am new to Solr and Solr Indexing. I have 2 Million Records to be indexed and adding more soon, it is taking 16 hours to complete the index now for 2 Million Records.

Can you please provide Suggestions and helpful links on Improving the Indexing Speed.

Improve this question
3
  • 1
    Have you considered using multiple indexes? For example, instead of using just sitecore_web_index you can break it out into one for each of your websites.
    – Michael West
    Commented Oct 11, 2019 at 21:11
  • Need lots more information here. By 2 million records, do you mean 2 million Sitecore items? Does it take 16 hours to rebuild the default indexes like sitecore_master_index? Do you have any modifications to those indexes? Is this a local Solr installation or something externally hosted?
    – Matthew FitzGerald-Chamberlain
    Commented Oct 11, 2019 at 21:17
  • Are you also indexing media files? I've noticed indexing media adds considerable time to indexing speeds. I would definitely look at Sharding if you can. That will increase throughput and performance. If you are using later versions of sitecore, consider SOLR Cloud.
    – Mikeyp
    Commented Oct 15, 2019 at 16:34

1 Answer 1

Reset to default
5

Some of the steps that can be followed to increase the performance of Solr indexing are:

  1. Limit the items getting into Solr: You can limit the number of items that are getting indexed by changing the <Root>/sitecore</Root> parameter in Sitecore index configuration file.
  2. Stored Vs Indexed: Not all fields needs to be both Stored as well as indexed. Some items just needs to be indexed but won't be stored thereby reducing the documents going into Solr. More on this here: Stored vs Indexed
  3. Check the JVM memory consumption: As you mentioned that there are more than 2million records, there is a good chance that the current JVM Memory setting isn't sufficient and there maybe a case to increase it.
  4. Increasing Server Configuration: You can increase the Server RAM and cores to boost the performance.
  5. Upgrading Solr itself: Depending on the Sitecore version you are using, if there is an upgrade in scope, you can also upgrade Solr to achieve the better performance.
Improve this answer

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.