0

When we try to do complete master index rebuild it gives the below error.

Job started: Index_Update_IndexName=sitecore_master_index|#Exception: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> SolrNet.Exceptions.SolrConnectionException: The specified CGI application encountered an error and the server terminated the process. ---> System.Net.WebException: The remote server returned an error: (502) Bad Gateway.
   at System.Net.HttpWebRequest.GetResponse()
   at HttpWebAdapters.Adapters.HttpWebRequestAdapter.GetResponse()
   at SolrNet.Impl.SolrConnection.GetResponse(IHttpWebRequest request)
   at SolrNet.Impl.SolrConnection.PostStream(String relativeUrl, String contentType, Stream content, IEnumerable`1 parameters)
   --- End of inner exception stack trace ---
   at SolrNet.Impl.SolrConnection.PostStream(String relativeUrl, String contentType, Stream content, IEnumerable`1 parameters)
   at SolrNet.Impl.SolrConnection.Post(String relativeUrl, String s)
   at SolrNet.Commands.OptimizeCommand.Execute(ISolrConnection connection)
   at SolrNet.Impl.SolrBasicServer`1.SendAndParseHeader(ISolrCommand cmd)
   at Sitecore.ContentSearch.SolrProvider.SolrSearchIndex.PerformRebuild(Boolean resetIndex, Boolean optimizeOnComplete, IndexingOptions indexingOptions, CancellationToken cancellationToken)
   at Sitecore.ContentSearch.SolrProvider.SolrSearchIndex.Rebuild(Boolean resetIndex, Boolean optimizeOnComplete)
   --- End of inner exception stack trace ---
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at Sitecore.Reflection.ReflectionUtil.InvokeMethod(MethodInfo method, Object[] parameters, Object obj)
   at Sitecore.Jobs.JobRunner.RunMethod(JobArgs args)
   at (Object , Object[] )
   at Sitecore.Pipelines.CorePipeline.Run(PipelineArgs args)
   at Sitecore.Pipelines.DefaultCorePipelineManager.Run(String pipelineName, PipelineArgs args, String pipelineDomain)
   at Sitecore.Jobs.Job.DoExecute()
   at Sitecore.Jobs.Job.ThreadEntry(Object state)

If anyone experiences the same issue pls help here.

We are using Sitecore 9.0.1, solr 6.6.2, and deployed into Azure.

We have huge data like more than 600,000 to 700,000 items.

Thanks in advance.

12
  • 1
    Does your Solr run out of memory issues maybe? How do you host it?
    – Marek Musielak
    Jun 15 at 9:45
  • We are not experience any out of memory error. Deployed Solr in azure
    – Reddy
    Jun 15 at 9:46
  • Is Solr running on a virtual machine in Azure? Are you able to browse to the Solr admin panel to view the Solr logs? Has Solr ever worked properly in this environment? Jun 15 at 12:39
  • The remote server returned an error: (502) Bad Gateway - that's usually when there is timeout. Looks like your Solr cannot handle amount of traffic/data/requests/operations of full master index rebuild.
    – Marek Musielak
    Jun 15 at 13:51
  • Does this error you are receiving on Azure, not on local, am I right? If yes are you using the switch on rebuild indexing functionality in your SOLR? Jun 16 at 5:08

1 Answer 1

1

Given the amount of content you are indexing, I think you are well past the experimental threshold when running Solr as an App Service in Azure.

Solr is a resource-intensive (Memory, Disk and Network) application. This is especially true when rebuilding one or many indices.

If you have a Solr expert on your team, I’d suggest spinning up 2-3 virtual machines for hosting Solr. You could also consider a set of containers.

If Solr is not a strength area, you can easily spin up a cloud-based instance of Solr using a paid service in a matter of minutes.

My personal experience is with SearchStax https://www.searchstax.com/solutions/sitecore-solr/

Bitnami also has offerings: https://bitnami.com/stack/solr/cloud/azure

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.