Errors after upgrade to 16.10.1

decpjohn · December 25, 2024, 8:34pm

After a system update and subsequent xwiki update to 16.10.1, I am facing multiple errors. So far I confim I can create pages without issues, I can browse the wiki without problems, but trying to Move/Rename a page I get:

org.xwiki.rendering.RenderingException: Failed to execute renderer
 at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.syncRender(DefaultAsyncRendererExecutor.java:287)
 at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.render(DefaultAsyncRendererExecutor.java:267)
 at org.xwiki.rendering.async.internal.block.DefaultBlockAsyncRendererExecutor.render(DefaultBlockAsyncRendererExecutor.java:154)
 at com.xpn.xwiki.internal.template.InternalTemplateManager.render(InternalTemplateManager.java:904)
 at com.xpn.xwiki.internal.template.InternalTemplateManager.renderFromSkin(InternalTemplateManager.java:866)
 at com.xpn.xwiki.internal.template.InternalTemplateManager.render(InternalTemplateManager.java:853)
 at com.xpn.xwiki.internal.template.InternalTemplateManager.renderNoException(InternalTemplateManager.java:808)
 at com.xpn.xwiki.internal.template.InternalTemplateManager.renderNoException(InternalTemplateManager.java:800)
 at com.xpn.xwiki.internal.template.DefaultTemplateManager.renderNoException(DefaultTemplateManager.java:79)
 at com.xpn.xwiki.internal.template.DefaultTemplateManager.renderNoException(DefaultTemplateManager.java:73)
 at org.xwiki.template.script.TemplateScriptService.render(TemplateScriptService.java:54)
 at jdk.internal.reflect.GeneratedMethodAccessor223.invoke(Unknown Source)
 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.base/java.lang.reflect.Method.invoke(Method.java:569)
 at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.doInvoke(UberspectImpl.java:571)
 at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.invoke(UberspectImpl.java:554)
 at org.apache.velocity.runtime.parser.node.ASTMethod.execute(ASTMethod.java:221)
 at org.apache.velocity.runtime.parser.node.ASTReference.execute(ASTReference.java:368)
 at org.apache.velocity.runtime.parser.node.ASTReference.render(ASTReference.java:492)
 at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
 at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:217)
 at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:331)
 at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:261)
 at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:304)
 at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
 at org.apache.velocity.runtime.parser.node.ASTElseIfStatement.render(ASTElseIfStatement.java:108)
 at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:190)
 at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
 at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:439)
 at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:190)
 at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:439)
 at org.apache.velocity.Template.merge(Template.java:358)
 at org.apache.velocity.Template.merge(Template.java:262)
 at org.xwiki.velocity.internal.InternalVelocityEngine.evaluate(InternalVelocityEngine.java:225)
 at com.xpn.xwiki.internal.template.VelocityTemplateEvaluator.evaluateContent(VelocityTemplateEvaluator.java:107)
 at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.evaluateContent(TemplateAsyncRenderer.java:219)
 at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.renderVelocity(TemplateAsyncRenderer.java:174)
 at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.render(TemplateAsyncRenderer.java:135)
 at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.render(TemplateAsyncRenderer.java:54)
 at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.lambda$syncRender$0(DefaultAsyncRendererExecutor.java:284)
 at com.xpn.xwiki.internal.security.authorization.DefaultAuthorExecutor.call(DefaultAuthorExecutor.java:98)
 at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.syncRender(DefaultAsyncRendererExecutor.java:284)
 at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.render(DefaultAsyncRendererExecutor.java:267)
 at org.xwiki.rendering.async.internal.block.DefaultBlockAsyncRendererExecutor.render(DefaultBlockAsyncRendererExecutor.java:154)
 at com.xpn.xwiki.internal.template.InternalTemplateManager.render(InternalTemplateManager.java:904)
 at com.xpn.xwiki.internal.template.InternalTemplateManager.renderFromSkin(InternalTemplateManager.java:866)
 at com.xpn.xwiki.internal.template.InternalTemplateManager.renderFromSkin(InternalTemplateManager.java:846)
 at com.xpn.xwiki.internal.template.InternalTemplateManager.render(InternalTemplateManager.java:832)
 at com.xpn.xwiki.internal.template.DefaultTemplateManager.render(DefaultTemplateManager.java:91)
 at com.xpn.xwiki.internal.template.DefaultTemplateManager.render(DefaultTemplateManager.java:85)
 at com.xpn.xwiki.XWiki.evaluateTemplate(XWiki.java:2566)
 at com.xpn.xwiki.web.Utils.parseTemplate(Utils.java:180)
 at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:651)
 at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:339)
 at com.xpn.xwiki.web.LegacyActionServlet.service(LegacyActionServlet.java:108)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:764)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
 at com.xpn.xwiki.web.ActionFilter.doFilter(ActionFilter.java:122)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
 at org.xwiki.wysiwyg.filter.ConversionFilter.doFilter(ConversionFilter.java:61)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
 at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
 at org.xwiki.container.servlet.filters.internal.SetHTTPHeaderFilter.doFilter(SetHTTPHeaderFilter.java:63)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
 at org.xwiki.resource.servlet.RoutingFilter.doFilter(RoutingFilter.java:132)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
 at org.xwiki.container.servlet.filters.internal.SavedRequestRestorerFilter.doFilter(SavedRequestRestorerFilter.java:208)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
 at org.xwiki.container.servlet.filters.internal.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:117)
 at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
 at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
 at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197)
 at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
 at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:540)
 at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135)
 at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
 at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:687)
 at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
 at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:359)
 at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:399)
 at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
 at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:889)
 at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1735)
 at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
 at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
 at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
 at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
 at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.xwiki.rendering.RenderingException: Failed to evaluate template with id [environment:/skins/flamingo/renameStep1.vm]
 at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.evaluateContent(TemplateAsyncRenderer.java:221)
 at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.renderVelocity(TemplateAsyncRenderer.java:174)
 at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.render(TemplateAsyncRenderer.java:135)
 at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.render(TemplateAsyncRenderer.java:54)
 at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.lambda$syncRender$0(DefaultAsyncRendererExecutor.java:284)
 at com.xpn.xwiki.internal.security.authorization.DefaultAuthorExecutor.call(DefaultAuthorExecutor.java:98)
 at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.syncRender(DefaultAsyncRendererExecutor.java:284)
 ... 95 more
Caused by: org.xwiki.velocity.XWikiVelocityException: Failed to evaluate content with namespace [environment:/templates/rename.vm]
 at org.xwiki.velocity.internal.InternalVelocityEngine.evaluate(InternalVelocityEngine.java:227)
 at com.xpn.xwiki.internal.template.VelocityTemplateEvaluator.evaluateContent(VelocityTemplateEvaluator.java:107)
 at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.evaluateContent(TemplateAsyncRenderer.java:219)
 ... 101 more
Caused by: org.apache.velocity.exception.MethodInvocationException: Invocation of method 'getBacklinks' in  class com.xpn.xwiki.api.Document threw exception java.lang.RuntimeException: Failed to load component for type [interface org.xwiki.link.LinkStore] for hint [default] at environment:/skins/flamingo/refactoring_macros.vm[line 102, column 34]
 at org.apache.velocity.runtime.parser.node.ASTIdentifier.execute(ASTIdentifier.java:246)
 at org.apache.velocity.runtime.parser.node.ASTReference.execute(ASTReference.java:368)
 at org.apache.velocity.runtime.parser.node.ASTReference.value(ASTReference.java:704)
 at org.apache.velocity.runtime.parser.node.ASTExpression.value(ASTExpression.java:75)
 at org.apache.velocity.runtime.parser.node.ASTSetDirective.render(ASTSetDirective.java:242)
 at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
 at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:217)
 at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:331)
 at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:261)
 at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:304)
 at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:439)
 at org.apache.velocity.Template.merge(Template.java:358)
 at org.apache.velocity.Template.merge(Template.java:262)
 at org.xwiki.velocity.internal.InternalVelocityEngine.evaluate(InternalVelocityEngine.java:225)
 ... 103 more
Caused by: java.lang.RuntimeException: Failed to load component for type [interface org.xwiki.link.LinkStore] for hint [default]
 at com.xpn.xwiki.web.Utils.getComponent(Utils.java:743)
 at com.xpn.xwiki.web.Utils.getComponent(Utils.java:766)
 at com.xpn.xwiki.web.Utils.getComponent(Utils.java:719)
 at com.xpn.xwiki.doc.XWikiDocument.getLinkStore(XWikiDocument.java:1001)
 at com.xpn.xwiki.doc.XWikiDocument.getBackLinkedReferences(XWikiDocument.java:5599)
 at com.xpn.xwiki.doc.XWikiDocument.getBackLinkedPages(XWikiDocument.java:5627)
 at com.xpn.xwiki.api.Document.getBacklinks(Document.java:2360)
 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
 at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.base/java.lang.reflect.Method.invoke(Method.java:569)
 at org.apache.velocity.runtime.parser.node.PropertyExecutor.execute(PropertyExecutor.java:159)
 at org.apache.velocity.util.introspection.UberspectImpl$VelGetterImpl.invoke(UberspectImpl.java:722)
 at org.apache.velocity.runtime.parser.node.ASTIdentifier.execute(ASTIdentifier.java:217)
 ... 116 more
Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.metadata.DefaultLinkStore] identified by type [interface org.xwiki.link.LinkStore] and hint [default]
 at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
 at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
 at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:302)
 at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
 at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
 at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
 at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
 at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
 at com.xpn.xwiki.web.Utils.getComponent(Utils.java:741)
 ... 129 more
Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
 at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
 at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
 at org.xwiki.component.embed.EmbeddableComponentManager.getDependencyInstance(EmbeddableComponentManager.java:591)
 at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:540)
 at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
 at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
 ... 137 more
Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
 at org.xwiki.search.solr.internal.DefaultSolr.initialize(DefaultSolr.java:61)
 at org.xwiki.component.embed.InitializableLifecycleHandler.handle(InitializableLifecycleHandler.java:39)
 at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:550)
 at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
 at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
 ... 142 more
Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
 at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
 at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
 at org.xwiki.search.solr.internal.DefaultSolr.initialize(DefaultSolr.java:59)
 ... 146 more
Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
 at org.xwiki.search.solr.internal.EmbeddedSolr.initialize(EmbeddedSolr.java:154)
 at org.xwiki.component.embed.InitializableLifecycleHandler.handle(InitializableLifecycleHandler.java:39)
 at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:550)
 at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
 at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
 ... 148 more
Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
 at org.xwiki.search.solr.internal.EmbeddedSolr.createCoreContainer(EmbeddedSolr.java:170)
 at org.xwiki.search.solr.internal.EmbeddedSolr.initialize(EmbeddedSolr.java:150)
 ... 152 more

So for now the wiki is not functional and I have a hard time interpreting these java error messages… Nothing else on the server has changed (folder structures, permissions, etc).

Any clues on how to troubleshoot this?
Thanks!

decpjohn · December 25, 2024, 8:35pm

Couldn’t post more on the previous post due to forum limitations…

Trying to delete a page I get:

Error number 4001 in 4: Error while evaluating velocity template delete.vm

Error number 4001 in 4: Error while evaluating velocity template delete.vm
com.xpn.xwiki.XWikiException: Error number 4001 in 4: Error while evaluating velocity template delete.vm
	at com.xpn.xwiki.XWiki.evaluateTemplate(XWiki.java:2571)
	at com.xpn.xwiki.web.Utils.parseTemplate(Utils.java:180)
	at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:651)
	at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:339)
	at com.xpn.xwiki.web.LegacyActionServlet.service(LegacyActionServlet.java:108)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:764)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at com.xpn.xwiki.web.ActionFilter.doFilter(ActionFilter.java:122)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.xwiki.wysiwyg.filter.ConversionFilter.doFilter(ConversionFilter.java:61)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.xwiki.container.servlet.filters.internal.SetHTTPHeaderFilter.doFilter(SetHTTPHeaderFilter.java:63)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.xwiki.resource.servlet.RoutingFilter.doFilter(RoutingFilter.java:132)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.xwiki.container.servlet.filters.internal.SavedRequestRestorerFilter.doFilter(SavedRequestRestorerFilter.java:208)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.xwiki.container.servlet.filters.internal.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:117)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
	at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:540)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
	at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:687)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:359)
	at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:399)
	at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
	at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:889)
	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1735)
	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
	at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
	at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.xwiki.rendering.RenderingException: Failed to execute renderer
	at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.syncRender(DefaultAsyncRendererExecutor.java:287)
	at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.render(DefaultAsyncRendererExecutor.java:267)
	at org.xwiki.rendering.async.internal.block.DefaultBlockAsyncRendererExecutor.render(DefaultBlockAsyncRendererExecutor.java:154)
	at com.xpn.xwiki.internal.template.InternalTemplateManager.render(InternalTemplateManager.java:904)
	at com.xpn.xwiki.internal.template.InternalTemplateManager.renderFromSkin(InternalTemplateManager.java:866)
	at com.xpn.xwiki.internal.template.InternalTemplateManager.renderFromSkin(InternalTemplateManager.java:846)
	at com.xpn.xwiki.internal.template.InternalTemplateManager.render(InternalTemplateManager.java:832)
	at com.xpn.xwiki.internal.template.DefaultTemplateManager.render(DefaultTemplateManager.java:91)
	at com.xpn.xwiki.internal.template.DefaultTemplateManager.render(DefaultTemplateManager.java:85)
	at com.xpn.xwiki.XWiki.evaluateTemplate(XWiki.java:2566)
	... 45 more
Caused by: org.xwiki.rendering.RenderingException: Failed to evaluate template with id [environment:/skins/flamingo/delete.vm]
	at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.evaluateContent(TemplateAsyncRenderer.java:221)
	at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.renderVelocity(TemplateAsyncRenderer.java:174)
	at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.render(TemplateAsyncRenderer.java:135)
	at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.render(TemplateAsyncRenderer.java:54)
	at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.lambda$syncRender$0(DefaultAsyncRendererExecutor.java:284)
	at com.xpn.xwiki.internal.security.authorization.DefaultAuthorExecutor.call(DefaultAuthorExecutor.java:98)
	at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.syncRender(DefaultAsyncRendererExecutor.java:284)
	... 54 more
Caused by: org.xwiki.velocity.XWikiVelocityException: Failed to evaluate content with namespace [environment:/skins/flamingo/delete.vm]
	at org.xwiki.velocity.internal.InternalVelocityEngine.evaluate(InternalVelocityEngine.java:227)
	at com.xpn.xwiki.internal.template.VelocityTemplateEvaluator.evaluateContent(VelocityTemplateEvaluator.java:107)
	at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.evaluateContent(TemplateAsyncRenderer.java:219)
	... 60 more
Caused by: org.apache.velocity.exception.MethodInvocationException: Invocation of method 'getBacklinks' in  class com.xpn.xwiki.api.Document threw exception java.lang.RuntimeException: Failed to load component for type [interface org.xwiki.link.LinkStore] for hint [default] at environment:/skins/flamingo/delete.vm[line 232, column 22]
	at org.apache.velocity.runtime.parser.node.ASTMethod.handleInvocationException(ASTMethod.java:308)
	at org.apache.velocity.runtime.parser.node.ASTMethod.execute(ASTMethod.java:235)
	at org.apache.velocity.runtime.parser.node.ASTReference.execute(ASTReference.java:368)
	at org.apache.velocity.runtime.parser.node.ASTReference.value(ASTReference.java:704)
	at org.apache.velocity.runtime.parser.node.ASTExpression.value(ASTExpression.java:75)
	at org.apache.velocity.runtime.parser.node.ASTSetDirective.render(ASTSetDirective.java:242)
	at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
	at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:217)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:331)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:261)
	at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:304)
	at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
	at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:217)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:331)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:261)
	at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:304)
	at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:439)
	at org.apache.velocity.runtime.parser.node.ASTStringLiteral.value(ASTStringLiteral.java:320)
	at org.apache.velocity.runtime.parser.node.ASTExpression.value(ASTExpression.java:75)
	at org.apache.velocity.runtime.parser.node.ASTSetDirective.render(ASTSetDirective.java:242)
	at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
	at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:439)
	at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:190)
	at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
	at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:439)
	at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:190)
	at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
	at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:217)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:331)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:261)
	at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:304)
	at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:439)
	at org.apache.velocity.Template.merge(Template.java:358)
	at org.apache.velocity.Template.merge(Template.java:262)
	at org.xwiki.velocity.internal.InternalVelocityEngine.evaluate(InternalVelocityEngine.java:225)
	... 62 more
Caused by: java.lang.RuntimeException: Failed to load component for type [interface org.xwiki.link.LinkStore] for hint [default]
	at com.xpn.xwiki.web.Utils.getComponent(Utils.java:743)
	at com.xpn.xwiki.web.Utils.getComponent(Utils.java:766)
	at com.xpn.xwiki.web.Utils.getComponent(Utils.java:719)
	at com.xpn.xwiki.doc.XWikiDocument.getLinkStore(XWikiDocument.java:1001)
	at com.xpn.xwiki.doc.XWikiDocument.getBackLinkedReferences(XWikiDocument.java:5599)
	at com.xpn.xwiki.doc.XWikiDocument.getBackLinkedPages(XWikiDocument.java:5627)
	at com.xpn.xwiki.api.Document.getBacklinks(Document.java:2360)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
	at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.doInvoke(UberspectImpl.java:571)
	at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.invoke(UberspectImpl.java:554)
	at org.apache.velocity.runtime.parser.node.ASTMethod.execute(ASTMethod.java:221)
	... 95 more
Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.metadata.DefaultLinkStore] identified by type [interface org.xwiki.link.LinkStore] and hint [default]
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:302)
	at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
	at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
	at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
	at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
	at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
	at com.xpn.xwiki.web.Utils.getComponent(Utils.java:741)
	... 108 more
Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
	at org.xwiki.component.embed.EmbeddableComponentManager.getDependencyInstance(EmbeddableComponentManager.java:591)
	at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:540)
	at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
	... 116 more
Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
	at org.xwiki.search.solr.internal.DefaultSolr.initialize(DefaultSolr.java:61)
	at org.xwiki.component.embed.InitializableLifecycleHandler.handle(InitializableLifecycleHandler.java:39)
	at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:550)
	at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
	... 121 more
Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
	at org.xwiki.search.solr.internal.DefaultSolr.initialize(DefaultSolr.java:59)
	... 125 more
Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
	at org.xwiki.search.solr.internal.EmbeddedSolr.initialize(EmbeddedSolr.java:154)
	at org.xwiki.component.embed.InitializableLifecycleHandler.handle(InitializableLifecycleHandler.java:39)
	at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:550)
	at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
	... 127 more
Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
	at org.xwiki.search.solr.internal.EmbeddedSolr.createCoreContainer(EmbeddedSolr.java:170)
	at org.xwiki.search.solr.internal.EmbeddedSolr.initialize(EmbeddedSolr.java:150)
	... 131 more

tmortagne · December 26, 2024, 8:10am

What is not working is the store in charge of indexing links between pages.

You probably have something before that error. In general, the most interesting error in the log is the first one after the startup.

decpjohn · December 26, 2024, 2:48pm

Well, your suggestion to look at tomcat’s catalina.log was indeed a good idea as right off the bat I spotted that tomcat was not capable writing to the permanent directory and was falling back to the default one.

The issue is that this permanent directory has not changed in years, unless the recent xwiki upgrade somehow affected it which I highly doubt…

Doing a chown -R tomcat:tomcat on the permanent directory didnt even help! I ended up doing what I hate which is chmod -R 777 and now everything seems to be working just fine…

I have no idea what happened to be honest… It doesnt add up. The pemanent directory is located on a Truenas NFS share so perhaps there’s something fishy going on on that side of things?

Catalina.log after a fresh start and after fixing the directory perms:

26-Dec-2024 09:28:07.200 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name:   Apache Tomcat/9.0.58 (Ubuntu)
26-Dec-2024 09:28:07.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built:          Jan 6 1970 15:09:28 UTC
26-Dec-2024 09:28:07.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.58.0
26-Dec-2024 09:28:07.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name:               Linux
26-Dec-2024 09:28:07.201 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version:            5.15.0-130-generic
26-Dec-2024 09:28:07.202 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture:          amd64
26-Dec-2024 09:28:07.202 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home:             /usr/lib/jvm/java-17-openjdk-amd64
26-Dec-2024 09:28:07.202 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version:           17.0.13+11-Ubuntu-2ubuntu122.04
26-Dec-2024 09:28:07.202 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor:            Ubuntu
26-Dec-2024 09:28:07.202 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE:         /var/lib/tomcat9
26-Dec-2024 09:28:07.203 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME:         /usr/share/tomcat9
26-Dec-2024 09:28:07.222 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED
26-Dec-2024 09:28:07.223 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED
26-Dec-2024 09:28:07.223 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util=ALL-UNNAMED
26-Dec-2024 09:28:07.223 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.base/java.util.concurrent=ALL-UNNAMED
26-Dec-2024 09:28:07.223 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
26-Dec-2024 09:28:07.224 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/var/lib/tomcat9/conf/logging.properties
26-Dec-2024 09:28:07.224 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
26-Dec-2024 09:28:07.224 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.awt.headless=true
26-Dec-2024 09:28:07.224 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xmx4096m
26-Dec-2024 09:28:07.224 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.security.egd=file:/dev/./urandom
26-Dec-2024 09:28:07.225 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djdk.tls.ephemeralDHKeySize=2048
26-Dec-2024 09:28:07.225 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
26-Dec-2024 09:28:07.225 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027
26-Dec-2024 09:28:07.225 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dignore.endorsed.dirs=
26-Dec-2024 09:28:07.225 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/var/lib/tomcat9
26-Dec-2024 09:28:07.229 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/share/tomcat9
26-Dec-2024 09:28:07.230 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/tmp
26-Dec-2024 09:28:07.234 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.2.31] using APR version [1.7.0].
26-Dec-2024 09:28:07.234 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true], >
26-Dec-2024 09:28:07.234 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true]
26-Dec-2024 09:28:07.240 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 3.0.2 15 Mar 2022]
26-Dec-2024 09:28:07.792 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"]
26-Dec-2024 09:28:07.831 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [913] milliseconds
26-Dec-2024 09:28:07.882 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina]
26-Dec-2024 09:28:07.883 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.58 (Ubuntu)]
26-Dec-2024 09:28:07.894 INFO [main] org.apache.catalina.startup.HostConfig.deployDescriptor Deploying deployment descriptor [/etc/tomcat9/Catalina/localhost/xwiki.xml]
26-Dec-2024 09:28:07.913 WARNING [main] org.apache.catalina.startup.HostConfig.deployDescriptor The path attribute with value [/xwiki] in deployment descriptor [/etc/tomcat9/Catalina/lo>
26-Dec-2024 09:28:41.650 INFO [main] org.apache.catalina.startup.HostConfig.deployDescriptor Deployment of deployment descriptor [/etc/tomcat9/Catalina/localhost/xwiki.xml] has finished>
26-Dec-2024 09:28:41.651 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory [/var/lib/tomcat9/webapps/ROOT]
26-Dec-2024 09:28:43.678 INFO [main] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for >
26-Dec-2024 09:28:43.683 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory [/var/lib/tomcat9/webapps/ROOT] has finished in [2,03>
26-Dec-2024 09:28:43.687 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"]
26-Dec-2024 09:28:43.740 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [35908] milliseconds

tmortagne · December 26, 2024, 3:00pm

No idea, sorry, not really my area of expertise. All I can say is that XWiki is not doing anything exotic refarding file access AFAIK.

decpjohn · December 26, 2024, 3:11pm

No problem for the NFS thing… I will keep an eye on this! I just looked at the journalctl for tomcat9 after a FRESH restart, and I think this is still a no-go…

But strangely the Wiki seems to be working just fine since I chmod the permanent dir (/mnt/data/xwiki-data)

Dec 26 10:03:36 wiki.tuxdomain systemd[1]: Starting Apache Tomcat 9 Web Application Server...
Dec 26 10:03:36 wiki.tuxdomain systemd[1]: Started Apache Tomcat 9 Web Application Server.
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: NOTE: Picked up JDK_JAVA_OPTIONS:  --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Server version name:   Apache Tomcat/9.0.58 (Ubuntu)
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Server built:          Jan 6 1970 15:09:28 UTC
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Server version number: 9.0.58.0
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: OS Name:               Linux
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: OS Version:            5.15.0-130-generic
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Architecture:          amd64
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Java Home:             /usr/lib/jvm/java-17-openjdk-amd64
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: JVM Version:           17.0.13+11-Ubuntu-2ubuntu122.04
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: JVM Vendor:            Ubuntu
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: CATALINA_BASE:         /var/lib/tomcat9
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: CATALINA_HOME:         /usr/share/tomcat9
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: --add-opens=java.base/java.util=ALL-UNNAMED
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: --add-opens=java.base/java.util.concurrent=ALL-UNNAMED
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Djava.util.logging.config.file=/var/lib/tomcat9/conf/logging.properties
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Djava.awt.headless=true
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Xmx4096m
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Djava.security.egd=file:/dev/./urandom
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Djdk.tls.ephemeralDHKeySize=2048
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Dignore.endorsed.dirs=
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Dcatalina.base=/var/lib/tomcat9
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Dcatalina.home=/usr/share/tomcat9
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Command line argument: -Djava.io.tmpdir=/tmp
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: Loaded Apache Tomcat Native library [1.2.31] using APR version [1.7.0].
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true], UDS [true].
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true]
Dec 26 10:03:36 wiki.tuxdomain tomcat9[21342]: OpenSSL successfully initialized [OpenSSL 3.0.2 15 Mar 2022]
Dec 26 10:03:37 wiki.tuxdomain tomcat9[21342]: Initializing ProtocolHandler ["http-nio-8080"]
Dec 26 10:03:37 wiki.tuxdomain tomcat9[21342]: Server initialization in [928] milliseconds
Dec 26 10:03:37 wiki.tuxdomain tomcat9[21342]: Starting service [Catalina]
Dec 26 10:03:37 wiki.tuxdomain tomcat9[21342]: Starting Servlet engine: [Apache Tomcat/9.0.58 (Ubuntu)]
Dec 26 10:03:37 wiki.tuxdomain tomcat9[21342]: Deploying deployment descriptor [/etc/tomcat9/Catalina/localhost/xwiki.xml]
Dec 26 10:03:37 wiki.tuxdomain tomcat9[21342]: The path attribute with value [/xwiki] in deployment descriptor [/etc/tomcat9/Catalina/localhost/xwiki.xml] has been ignored
Dec 26 10:03:45 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:03:45,503 [main] INFO  iPropertiesConfigurationSource - Loading [xwiki.properties] from default location [/etc/xwiki/xwiki.properties]
Dec 26 10:03:45 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:03:45,925 [main] ERROR o.x.e.i.ServletEnvironment     - Configured permanent directory [/mnt/data/xwiki-data] is not writable.
Dec 26 10:03:45 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:03:45,925 [main] WARN  o.x.e.i.ServletEnvironment     - Falling back on [/var/cache/tomcat9/Catalina/localhost/xwiki] as the permanent directory.
Dec 26 10:03:45 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:03:45,926 [main] INFO  o.x.e.i.ServletEnvironment     - Using permanent directory [/var/cache/tomcat9/Catalina/localhost/xwiki]
Dec 26 10:03:53 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:03:53,767 [main] WARN  ltInstalledExtensionRepository - Invalid extension [org.xwiki.platform:xwiki-platform-distribution-flavor-mainwiki/13.9] on namespace [wiki:xwiki] (InvalidExtensionException: Dependency [org.xwiki.platform:xwiki-platform-oldcore-[13.9]] is incompatible with the core extension [org.xwiki.platform:xwiki-platform-legacy-oldcore/16.10.1])
Dec 26 10:03:53 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:03:53,769 [main] WARN  ltInstalledExtensionRepository - Invalid extension [org.xwiki.platform:xwiki-platform-mentions-notifications/13.9] (InvalidExtensionException: Extension [org.xwiki.platform:xwiki-platform-mentions-notifications/13.9] already exists as a core extension)
Dec 26 10:03:53 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:03:53,770 [main] WARN  ltInstalledExtensionRepository - Invalid extension [org.xwiki.platform:xwiki-platform-mentions-api/13.9] (InvalidExtensionException: Extension [org.xwiki.platform:xwiki-platform-mentions-api/13.9] already exists as a core extension)
Dec 26 10:03:53 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:03:53,770 [main] WARN  ltInstalledExtensionRepository - Invalid extension [org.xwiki.platform:xwiki-platform-mentions-default/13.9] (InvalidExtensionException: Extension [org.xwiki.platform:xwiki-platform-mentions-default/13.9] already exists as a core extension)
Dec 26 10:03:53 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:03:53,771 [main] WARN  ltInstalledExtensionRepository - Invalid extension [org.webjars.npm:fast-diff/1.2.0] (InvalidExtensionException: Extension [org.webjars.npm:fast-diff/1.2.0] already exists as a core extension)
Dec 26 10:03:58 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:03:58,119 [main] WARN  .i.DefaultExtensionInitializer - Failed to initialize dependency [org.xwiki.platform:xwiki-platform-user-profile-ui-13.9]: ExtensionException: Extension [org.xwiki.platform:xwiki-platform-like-ui/13.9] cannot be initialized because its dependency ([org.xwiki.platform:xwiki-platform-user-profile-ui-13.9]) could not.
Dec 26 10:04:01 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:01,342 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Updating Solr home directory at [/var/cache/tomcat9/Catalina/localhost/xwiki/store/solr]
Dec 26 10:04:01 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:01,369 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Starting embedded Solr server...
Dec 26 10:04:01 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:01,370 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Using Solr home directory: [/var/cache/tomcat9/Catalina/localhost/xwiki/store/solr]
Dec 26 10:04:03 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:03,313 [main] WARN  o.a.s.c.CoreContainer          - Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
Dec 26 10:04:10 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:10,101 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Started embedded Solr server.
Dec 26 10:04:10 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:10,650 [main] INFO  o.x.s.f.i.FilesystemStoreTools - Using filesystem store directory [/var/cache/tomcat9/Catalina/localhost/xwiki/store/file]
Dec 26 10:04:11 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:11,878 [main] INFO  o.x.o.i.s.DefaultOfficeServer  - Open Office instance started.
Dec 26 10:04:12 wiki.tuxdomain tomcat9[21342]: Deployment of deployment descriptor [/etc/tomcat9/Catalina/localhost/xwiki.xml] has finished in [34,315] ms
Dec 26 10:04:12 wiki.tuxdomain tomcat9[21342]: Deploying web application directory [/var/lib/tomcat9/webapps/ROOT]
Dec 26 10:04:12 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:12,733 [Thread-22] ERROR o.j.l.o.VerboseProcess         -
Dec 26 10:04:12 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:12,734 [Thread-22] ERROR o.j.l.o.VerboseProcess         - (process:21412): dconf-CRITICAL **: 10:04:12.723: unable to create directory '/.cache/dconf': Read-only file system.  dconf will not work properly.
Dec 26 10:04:13 wiki.tuxdomain tomcat9[21342]: At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
Dec 26 10:04:13 wiki.tuxdomain tomcat9[21342]: Deployment of web application directory [/var/lib/tomcat9/webapps/ROOT] has finished in [1,795] ms
Dec 26 10:04:13 wiki.tuxdomain tomcat9[21342]: Starting ProtocolHandler ["http-nio-8080"]
Dec 26 10:04:13 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:13,832 [jodconverter-offprocmng-0] WARN  tartProcessAndConnectRetryable - Office process died with exit code 81; restarting it
Dec 26 10:04:13 wiki.tuxdomain tomcat9[21342]: Server startup in [36243] milliseconds
Dec 26 10:04:14 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:14,226 [Thread-27] ERROR o.j.l.o.VerboseProcess         -
Dec 26 10:04:14 wiki.tuxdomain tomcat9[21342]: 2024-12-26 10:04:14,227 [Thread-27] ERROR o.j.l.o.VerboseProcess         - (process:21440): dconf-CRITICAL **: 10:04:14.226: unable to create directory '/.cache/dconf': Read-only file system.  dconf will not work properly.

decpjohn · December 26, 2024, 4:11pm

Well I found the problem and unless I am mistaken it may indeed have been the xwiki update that caused this issue…

Thanks to this forum post (tomcat - GeoServer data directory not writeable - Geographic Information Systems Stack Exchange) it would appear that tomcat9 now requires adding a line in the systemd service file (systemctl edit --full tomcat9.service) to indicate to tomcat that it can write into the permanent directory.

Per the above mentioned forum, I added:

ReadWritePaths=/mnt/data/xwiki-data/

in the “security” section of the systemd file and now tomcat can use the permanent dir properly and no longer complains that it is not writable.

Would this be a new “feature” that wasn’t present before? Or maybe the systemd file was overwritten to defaults during the update causing this issue in the first place??

Seems most of my issues are always related to updates…

tmortagne · December 26, 2024, 4:34pm

It’s a “new” protection used by the tomcat9 service file provided by the Debian package, but it’s not a tomcat9 feature, it’s something you can put in any systemd service file (there is a note about that in https://www.xwiki.org/xwiki/bin/view/Documentation/AdminGuide/Installation/InstallationViaAPT/#HAccessafilefromXWiki).

I’m pretty sure it has always been like this with the tomcat9 Debian package, it forced us to add something for it in the XWiki Debian package to workaround this. You upgraded from tomcat8 ?

decpjohn · December 26, 2024, 7:12pm

Well I think so because looking at the apt-get log I see:

Upgrade: [...] xwiki-mariadb-common:amd64 (16.5.0, 16.10.1),
[...] xwiki-tomcat9-mariadb:amd64 (16.5.0, 16.10.1),
[...] xwiki-common:amd64 (16.5.0, 16.10.1),
[...] xwiki-tomcat9-common:amd64 (16.5.0, 16.10.1),
[...]

Not sure if xwiki 16.5.0 came with tomcat8 or 9 though but this server has always been installed/upgraded with the official xwiki packages and never manually…

tmortagne · December 26, 2024, 9:01pm

As you can see from the package name, it was tomcat9 already. tomcat8 based packages are a very old thing. Note that the exact Tomcat version does not have much to do with the XWiki package, since it’s just a dependency. It mainly depends on your Debian version.

decpjohn · December 27, 2024, 2:58pm

Hello Thomas,

Seems I am not totally out of the woods…

AFAIK it seems now solr cannot start based on these lines:

Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]: Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
[...]
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]: Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
[...]

I tried to delete a page and got this:

Error number 4001 in 4: Error while evaluating velocity template delete.vm

Error number 4001 in 4: Error while evaluating velocity template delete.vm
com.xpn.xwiki.XWikiException: Error number 4001 in 4: Error while evaluating velocity template delete.vm
	at com.xpn.xwiki.XWiki.evaluateTemplate(XWiki.java:2571)
	at com.xpn.xwiki.web.Utils.parseTemplate(Utils.java:180)
	at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:651)
	at com.xpn.xwiki.web.XWikiAction.execute(XWikiAction.java:339)
	at com.xpn.xwiki.web.LegacyActionServlet.service(LegacyActionServlet.java:108)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:764)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at com.xpn.xwiki.web.ActionFilter.doFilter(ActionFilter.java:122)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.xwiki.wysiwyg.filter.ConversionFilter.doFilter(ConversionFilter.java:61)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.xwiki.container.servlet.filters.internal.SetHTTPHeaderFilter.doFilter(SetHTTPHeaderFilter.java:63)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.xwiki.resource.servlet.RoutingFilter.doFilter(RoutingFilter.java:132)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.xwiki.container.servlet.filters.internal.SavedRequestRestorerFilter.doFilter(SavedRequestRestorerFilter.java:208)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.xwiki.container.servlet.filters.internal.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:117)
	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197)
	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
	at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:540)
	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135)
	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
	at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:687)
	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:359)
	at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:399)
	at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
	at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:889)
	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1735)
	at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
	at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
	at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
	at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: org.xwiki.rendering.RenderingException: Failed to execute renderer
	at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.syncRender(DefaultAsyncRendererExecutor.java:287)
	at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.render(DefaultAsyncRendererExecutor.java:267)
	at org.xwiki.rendering.async.internal.block.DefaultBlockAsyncRendererExecutor.render(DefaultBlockAsyncRendererExecutor.java:154)
	at com.xpn.xwiki.internal.template.InternalTemplateManager.render(InternalTemplateManager.java:904)
	at com.xpn.xwiki.internal.template.InternalTemplateManager.renderFromSkin(InternalTemplateManager.java:866)
	at com.xpn.xwiki.internal.template.InternalTemplateManager.renderFromSkin(InternalTemplateManager.java:846)
	at com.xpn.xwiki.internal.template.InternalTemplateManager.render(InternalTemplateManager.java:832)
	at com.xpn.xwiki.internal.template.DefaultTemplateManager.render(DefaultTemplateManager.java:91)
	at com.xpn.xwiki.internal.template.DefaultTemplateManager.render(DefaultTemplateManager.java:85)
	at com.xpn.xwiki.XWiki.evaluateTemplate(XWiki.java:2566)
	... 45 more
Caused by: org.xwiki.rendering.RenderingException: Failed to evaluate template with id [environment:/skins/flamingo/delete.vm]
	at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.evaluateContent(TemplateAsyncRenderer.java:221)
	at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.renderVelocity(TemplateAsyncRenderer.java:174)
	at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.render(TemplateAsyncRenderer.java:135)
	at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.render(TemplateAsyncRenderer.java:54)
	at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.lambda$syncRender$0(DefaultAsyncRendererExecutor.java:284)
	at com.xpn.xwiki.internal.security.authorization.DefaultAuthorExecutor.call(DefaultAuthorExecutor.java:98)
	at org.xwiki.rendering.async.internal.DefaultAsyncRendererExecutor.syncRender(DefaultAsyncRendererExecutor.java:284)
	... 54 more
Caused by: org.xwiki.velocity.XWikiVelocityException: Failed to evaluate content with namespace [environment:/skins/flamingo/delete.vm]
	at org.xwiki.velocity.internal.InternalVelocityEngine.evaluate(InternalVelocityEngine.java:227)
	at com.xpn.xwiki.internal.template.VelocityTemplateEvaluator.evaluateContent(VelocityTemplateEvaluator.java:107)
	at com.xpn.xwiki.internal.template.TemplateAsyncRenderer.evaluateContent(TemplateAsyncRenderer.java:219)
	... 60 more
Caused by: org.apache.velocity.exception.MethodInvocationException: Invocation of method 'getBacklinks' in  class com.xpn.xwiki.api.Document threw exception java.lang.RuntimeException: Failed to load component for type [interface org.xwiki.link.LinkStore] for hint [default] at environment:/skins/flamingo/delete.vm[line 232, column 22]
	at org.apache.velocity.runtime.parser.node.ASTMethod.handleInvocationException(ASTMethod.java:308)
	at org.apache.velocity.runtime.parser.node.ASTMethod.execute(ASTMethod.java:235)
	at org.apache.velocity.runtime.parser.node.ASTReference.execute(ASTReference.java:368)
	at org.apache.velocity.runtime.parser.node.ASTReference.value(ASTReference.java:704)
	at org.apache.velocity.runtime.parser.node.ASTExpression.value(ASTExpression.java:75)
	at org.apache.velocity.runtime.parser.node.ASTSetDirective.render(ASTSetDirective.java:242)
	at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
	at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:217)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:331)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:261)
	at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:304)
	at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
	at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:217)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:331)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:261)
	at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:304)
	at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:439)
	at org.apache.velocity.runtime.parser.node.ASTStringLiteral.value(ASTStringLiteral.java:320)
	at org.apache.velocity.runtime.parser.node.ASTExpression.value(ASTExpression.java:75)
	at org.apache.velocity.runtime.parser.node.ASTSetDirective.render(ASTSetDirective.java:242)
	at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
	at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:439)
	at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:190)
	at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
	at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:439)
	at org.apache.velocity.runtime.parser.node.ASTIfStatement.render(ASTIfStatement.java:190)
	at org.apache.velocity.runtime.parser.node.ASTBlock.render(ASTBlock.java:147)
	at org.apache.velocity.runtime.directive.VelocimacroProxy.render(VelocimacroProxy.java:217)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:331)
	at org.apache.velocity.runtime.directive.RuntimeMacro.render(RuntimeMacro.java:261)
	at org.apache.velocity.runtime.parser.node.ASTDirective.render(ASTDirective.java:304)
	at org.apache.velocity.runtime.parser.node.SimpleNode.render(SimpleNode.java:439)
	at org.apache.velocity.Template.merge(Template.java:358)
	at org.apache.velocity.Template.merge(Template.java:262)
	at org.xwiki.velocity.internal.InternalVelocityEngine.evaluate(InternalVelocityEngine.java:225)
	... 62 more
Caused by: java.lang.RuntimeException: Failed to load component for type [interface org.xwiki.link.LinkStore] for hint [default]
	at com.xpn.xwiki.web.Utils.getComponent(Utils.java:743)
	at com.xpn.xwiki.web.Utils.getComponent(Utils.java:766)
	at com.xpn.xwiki.web.Utils.getComponent(Utils.java:719)
	at com.xpn.xwiki.doc.XWikiDocument.getLinkStore(XWikiDocument.java:1001)
	at com.xpn.xwiki.doc.XWikiDocument.getBackLinkedReferences(XWikiDocument.java:5599)
	at com.xpn.xwiki.doc.XWikiDocument.getBackLinkedPages(XWikiDocument.java:5627)
	at com.xpn.xwiki.api.Document.getBacklinks(Document.java:2360)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:569)
	at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.doInvoke(UberspectImpl.java:571)
	at org.apache.velocity.util.introspection.UberspectImpl$VelMethodImpl.invoke(UberspectImpl.java:554)
	at org.apache.velocity.runtime.parser.node.ASTMethod.execute(ASTMethod.java:221)
	... 95 more
Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.metadata.DefaultLinkStore] identified by type [interface org.xwiki.link.LinkStore] and hint [default]
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:302)
	at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
	at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
	at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
	at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
	at org.xwiki.component.internal.multi.DelegateComponentManager.getInstance(DelegateComponentManager.java:83)
	at com.xpn.xwiki.web.Utils.getComponent(Utils.java:741)
	... 108 more
Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
	at org.xwiki.component.embed.EmbeddableComponentManager.getDependencyInstance(EmbeddableComponentManager.java:591)
	at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:540)
	at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
	... 116 more
Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
	at org.xwiki.search.solr.internal.DefaultSolr.initialize(DefaultSolr.java:61)
	at org.xwiki.component.embed.InitializableLifecycleHandler.handle(InitializableLifecycleHandler.java:39)
	at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:550)
	at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
	... 121 more
Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
	at org.xwiki.search.solr.internal.DefaultSolr.initialize(DefaultSolr.java:59)
	... 125 more
Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
	at org.xwiki.search.solr.internal.EmbeddedSolr.initialize(EmbeddedSolr.java:154)
	at org.xwiki.component.embed.InitializableLifecycleHandler.handle(InitializableLifecycleHandler.java:39)
	at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:550)
	at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
	at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
	... 127 more
Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
	at org.xwiki.search.solr.internal.EmbeddedSolr.createCoreContainer(EmbeddedSolr.java:170)
	at org.xwiki.search.solr.internal.EmbeddedSolr.initialize(EmbeddedSolr.java:150)
	... 131 more

I tried looking in catalina and I couldnt see anything relevant… I looked in the service logs and its basically the same errors being thrown every few minutes or so like this excerpt from the logs:

Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.extension.index.internal.DefaultExtensionIndex] identified by type [interface org.xwiki.extension.index.ExtensionIndex] and hint [default]
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getDependencyInstance(EmbeddableComponentManager.java:591)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:540)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         ... 250 common frames omitted
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.extension.index.internal.ExtensionIndexStore] identified by type [class org.xwiki.extension.index.internal.ExtensionIndexStore] and hint [default]
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getDependencyInstance(EmbeddableComponentManager.java:591)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:540)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         ... 255 common frames omitted
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getDependencyInstance(EmbeddableComponentManager.java:591)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:540)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         ... 260 common frames omitted
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]: Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.search.solr.internal.DefaultSolr.initialize(DefaultSolr.java:61)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.InitializableLifecycleHandler.handle(InitializableLifecycleHandler.java:39)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:550)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         ... 265 common frames omitted
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.search.solr.internal.DefaultSolr.initialize(DefaultSolr.java:59)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         ... 269 common frames omitted
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]: Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.search.solr.internal.EmbeddedSolr.initialize(EmbeddedSolr.java:154)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.InitializableLifecycleHandler.handle(InitializableLifecycleHandler.java:39)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:550)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         ... 271 common frames omitted
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]: Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.search.solr.internal.EmbeddedSolr.createCoreContainer(EmbeddedSolr.java:170)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         at org.xwiki.search.solr.internal.EmbeddedSolr.initialize(EmbeddedSolr.java:150)
Dec 27 09:36:50 wiki.tuxdomain tomcat9[22546]:         ... 275 common frames omitted

FYI the service log has over 58,000 lines of such messages just since last night while the wiki was not being used! I don think this is normal…

tmortagne · December 27, 2024, 3:06pm

Everything you pasted is consequence of a previous error that was logged when Solr was initialized, you should have it at the beginning of the log in theory.

decpjohn · December 27, 2024, 7:45pm

OK let me dig a bit more

decpjohn · December 27, 2024, 9:57pm

Well, I see the same error messages all the time but I cannot pinpoint the actual root cause…

Is it a corruption in the Solr indexes?

Dec 27 16:34:55 wiki.tuxdomain systemd[1]: Starting Apache Tomcat 9 Web Application Server...
Dec 27 16:34:55 wiki.tuxdomain systemd[1]: Started Apache Tomcat 9 Web Application Server.
Dec 27 16:34:55 wiki.tuxdomain tomcat9[46584]: NOTE: Picked up JDK_JAVA_OPTIONS:  --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Server version name:   Apache Tomcat/9.0.58 (Ubuntu)
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Server built:          Jan 6 1970 15:09:28 UTC
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Server version number: 9.0.58.0
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: OS Name:               Linux
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: OS Version:            5.15.0-130-generic
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Architecture:          amd64
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Java Home:             /usr/lib/jvm/java-17-openjdk-amd64
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: JVM Version:           17.0.13+11-Ubuntu-2ubuntu122.04
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: JVM Vendor:            Ubuntu
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: CATALINA_BASE:         /var/lib/tomcat9
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: CATALINA_HOME:         /usr/share/tomcat9
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: --add-opens=java.base/java.util=ALL-UNNAMED
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: --add-opens=java.base/java.util.concurrent=ALL-UNNAMED
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Djava.util.logging.config.file=/var/lib/tomcat9/conf/logging.properties
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Djava.awt.headless=true
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Xmx4096m
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Djava.security.egd=file:/dev/./urandom
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Djdk.tls.ephemeralDHKeySize=2048
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Dignore.endorsed.dirs=
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Dcatalina.base=/var/lib/tomcat9
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Dcatalina.home=/usr/share/tomcat9
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Command line argument: -Djava.io.tmpdir=/tmp
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Loaded Apache Tomcat Native library [1.2.31] using APR version [1.7.0].
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true], UDS [true].
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true]
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: OpenSSL successfully initialized [OpenSSL 3.0.2 15 Mar 2022]
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Initializing ProtocolHandler ["http-nio-8080"]
Dec 27 16:34:56 wiki.tuxdomain tomcat9[46584]: Server initialization in [1099] milliseconds
Dec 27 16:34:57 wiki.tuxdomain tomcat9[46584]: Starting service [Catalina]
Dec 27 16:34:57 wiki.tuxdomain tomcat9[46584]: Starting Servlet engine: [Apache Tomcat/9.0.58 (Ubuntu)]
Dec 27 16:34:57 wiki.tuxdomain tomcat9[46584]: Deploying deployment descriptor [/etc/tomcat9/Catalina/localhost/xwiki.xml]
Dec 27 16:34:57 wiki.tuxdomain tomcat9[46584]: The path attribute with value [/xwiki] in deployment descriptor [/etc/tomcat9/Catalina/localhost/xwiki.xml] has been ignored
Dec 27 16:35:04 wiki.tuxdomain tomcat9[46584]: 2024-12-27 16:35:04,719 [main] INFO  iPropertiesConfigurationSource - Loading [xwiki.properties] from default location [/etc/xwiki/xwiki.properties]
Dec 27 16:35:05 wiki.tuxdomain tomcat9[46584]: 2024-12-27 16:35:05,164 [main] INFO  o.x.e.i.ServletEnvironment     - Using permanent directory [/mnt/data/xwiki-data]
Dec 27 16:35:14 wiki.tuxdomain tomcat9[46584]: 2024-12-27 16:35:14,876 [main] WARN  ltInstalledExtensionRepository - Invalid extension [org.xwiki.platform:xwiki-platform-distribution-flavor-mainwiki/16.5.0] on namespace [wiki:xwiki] (InvalidExtensionException: Dependency [org.xwiki.platform:xwiki-platform-oldcore-[16.5.0]] is incompatible with the core extension [org.xwiki.platform:xwiki-platform-legacy-oldcore/16.10.1])
Dec 27 16:35:19 wiki.tuxdomain tomcat9[46584]: 2024-12-27 16:35:19,901 [main] WARN  .i.DefaultExtensionInitializer - Failed to initialize dependency [org.xwiki.platform:xwiki-platform-user-profile-ui-16.5.0]: ExtensionException: Extension [org.xwiki.platform:xwiki-platform-like-ui/16.5.0] cannot be initialized because its dependency ([org.xwiki.platform:xwiki-platform-user-profile-ui-16.5.0]) could not.
Dec 27 16:35:22 wiki.tuxdomain tomcat9[46584]: 2024-12-27 16:35:22,997 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Updating Solr home directory at [/mnt/data/xwiki-data/store/solr]
Dec 27 16:35:23 wiki.tuxdomain tomcat9[46584]: 2024-12-27 16:35:23,114 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Starting embedded Solr server...
Dec 27 16:35:23 wiki.tuxdomain tomcat9[46584]: 2024-12-27 16:35:23,115 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Using Solr home directory: [/mnt/data/xwiki-data/store/solr]
Dec 27 16:35:26 wiki.tuxdomain tomcat9[46584]: 2024-12-27 16:35:26,401 [main] WARN  o.a.s.c.CoreContainer          - Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: 2024-12-27 16:35:32,281 [main] ERROR o.x.s.s.i.EmbeddedSolr         - Failed to initialize Solr core with id [search_9]
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: org.apache.solr.common.SolrException: Error opening new searcher
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1232)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1057)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1706)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.core.CoreContainer.lambda$loadInternal$12(CoreContainer.java:1044)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:234)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:294)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.lang.Thread.run(Thread.java:840)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: Caused by: org.apache.solr.common.SolrException: Error opening new searcher
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2467)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2600)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1291)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1176)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         ... 9 common frames omitted
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file found in LockValidatingDirectoryWrapper(NRTCachingDirectory(MMapDirectory@/mnt/data/xwiki-data/cache/solr/search_9/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@170a9ed8; maxCacheMB=48.0 maxMergeSizeMB=4.0)): files: [write.lock]
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:1075)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:145)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:110)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.update.DefaultSolrCoreState.createMainIndexWriter(DefaultSolrCoreState.java:258)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.update.DefaultSolrCoreState.getIndexWriter(DefaultSolrCoreState.java:125)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2418)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         ... 12 common frames omitted
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: 2024-12-27 16:35:32,290 [main] ERROR .o.i.DefaultObservationManager - Failed to lookup listener with role hint [ExtensionIndexCleanupListener]
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.extension.index.internal.listener.ExtensionIndexCleanupListener] identified by type [interface org.xwiki.observation.EventListener] and hint [ExtensionIndexCleanupListener]
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.observation.internal.DefaultObservationManager.initializeListeners(DefaultObservationManager.java:178)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.observation.internal.DefaultObservationManager.getListenersByEvent(DefaultObservationManager.java:143)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.observation.internal.DefaultObservationManager.notify(DefaultObservationManager.java:301)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.internal.StackingComponentEventManager.sendEvent(StackingComponentEventManager.java:151)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.internal.StackingComponentEventManager.flushEvents(StackingComponentEventManager.java:92)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.container.servlet.XWikiServletContextListener.contextInitialized(XWikiServletContextListener.java:133)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4768)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5230)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:726)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:698)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:696)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:690)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig$DeployDescriptor.run(HostConfig.java:1889)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:583)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:473)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1618)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:319)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:123)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.setStateInternal(LifecycleBase.java:423)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.setState(LifecycleBase.java:366)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:946)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:835)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1396)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1386)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:145)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:919)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:263)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardService.startInternal(StandardService.java:432)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:927)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.Catalina.start(Catalina.java:772)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.lang.reflect.Method.invoke(Method.java:569)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:480)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getDependencyInstance(EmbeddableComponentManager.java:591)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:540)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         ... 48 common frames omitted
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.search.solr.internal.DefaultSolr.initialize(DefaultSolr.java:61)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.InitializableLifecycleHandler.handle(InitializableLifecycleHandler.java:39)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:550)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         ... 53 common frames omitted
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:332)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.search.solr.internal.DefaultSolr.initialize(DefaultSolr.java:59)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         ... 57 common frames omitted
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.search.solr.internal.EmbeddedSolr.initialize(EmbeddedSolr.java:154)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.InitializableLifecycleHandler.handle(InitializableLifecycleHandler.java:39)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:550)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         ... 59 common frames omitted
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.search.solr.internal.EmbeddedSolr.createCoreContainer(EmbeddedSolr.java:170)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.search.solr.internal.EmbeddedSolr.initialize(EmbeddedSolr.java:150)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         ... 63 common frames omitted
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: 2024-12-27 16:35:32,562 [main] ERROR h.i.DefaultExtensionJobHistory - Failed to read extension job history from [/mnt/data/xwiki-data/extension/history/2024.06.24.xml].
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]: java.lang.NullPointerException: Cannot invoke "java.util.List.size()" because "list" is null
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.Collections.reverse(Collections.java:379)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.extension.job.history.internal.DefaultExtensionJobHistory.load(DefaultExtensionJobHistory.java:176)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.extension.job.history.internal.DefaultExtensionJobHistory.initialize(DefaultExtensionJobHistory.java:112)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.InitializableLifecycleHandler.handle(InitializableLifecycleHandler.java:39)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:550)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getDependencyInstance(EmbeddableComponentManager.java:591)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.createInstance(EmbeddableComponentManager.java:540)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getComponentInstance(EmbeddableComponentManager.java:636)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:329)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.embed.EmbeddableComponentManager.getInstance(EmbeddableComponentManager.java:320)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.observation.internal.DefaultObservationManager.initializeListeners(DefaultObservationManager.java:178)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.observation.internal.DefaultObservationManager.getListenersByEvent(DefaultObservationManager.java:143)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.observation.internal.DefaultObservationManager.notify(DefaultObservationManager.java:301)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.internal.StackingComponentEventManager.sendEvent(StackingComponentEventManager.java:151)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.component.internal.StackingComponentEventManager.flushEvents(StackingComponentEventManager.java:92)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.xwiki.container.servlet.XWikiServletContextListener.contextInitialized(XWikiServletContextListener.java:133)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4768)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5230)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:726)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:698)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:696)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig.deployDescriptor(HostConfig.java:690)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig$DeployDescriptor.run(HostConfig.java:1889)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:123)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig.deployDescriptors(HostConfig.java:583)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:473)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1618)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:319)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.fireLifecycleEvent(LifecycleBase.java:123)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.setStateInternal(LifecycleBase.java:423)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.setState(LifecycleBase.java:366)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:946)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:835)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1396)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1386)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:145)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:919)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardEngine.startInternal(StandardEngine.java:263)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardService.startInternal(StandardService.java:432)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.core.StandardServer.startInternal(StandardServer.java:927)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.Catalina.start(Catalina.java:772)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at java.base/java.lang.reflect.Method.invoke(Method.java:569)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:345)
Dec 27 16:35:32 wiki.tuxdomain tomcat9[46584]:         at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:480)

decpjohn · December 27, 2024, 10:15pm

To help you help me I cleaned up the entire 171000 lines of the log from the moment Tomcat was freshly started to the moment I posted the above incomplete log:

16:34:55 []: NOTE: Picked up JDK_JAVA_OPTIONS:  --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
16:34:56 []: Server version name:   Apache Tomcat/9.0.58 (Ubuntu)
16:34:56 []: Server built:          Jan 6 1970 15:09:28 UTC
16:34:56 []: Server version number: 9.0.58.0
16:34:56 []: OS Name:               Linux
16:34:56 []: OS Version:            5.15.0-130-generic
16:34:56 []: Architecture:          amd64
16:34:56 []: Java Home:             /usr/lib/jvm/java-17-openjdk-amd64
16:34:56 []: JVM Version:           17.0.13+11-Ubuntu-2ubuntu122.04
16:34:56 []: JVM Vendor:            Ubuntu
16:34:56 []: CATALINA_BASE:         /var/lib/
16:34:56 []: CATALINA_HOME:         /usr/share/
16:34:56 []: Command line argument: --add-opens=java.base/java.lang=ALL-UNNAMED
16:34:56 []: Command line argument: --add-opens=java.base/java.io=ALL-UNNAMED
16:34:56 []: Command line argument: --add-opens=java.base/java.util=ALL-UNNAMED
16:34:56 []: Command line argument: --add-opens=java.base/java.util.concurrent=ALL-UNNAMED
16:34:56 []: Command line argument: --add-opens=java.rmi/sun.rmi.transport=ALL-UNNAMED
16:34:56 []: Command line argument: -Djava.util.logging.config.file=/var/lib//conf/logging.properties
16:34:56 []: Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
16:34:56 []: Command line argument: -Djava.awt.headless=true
16:34:56 []: Command line argument: -Xmx4096m
16:34:56 []: Command line argument: -Djava.security.egd=file:/dev/./urandom
16:34:56 []: Command line argument: -Djdk.tls.ephemeralDHKeySize=2048
16:34:56 []: Command line argument: -Djava.protocol.handler.pkgs=org.apache.catalina.webresources
16:34:56 []: Command line argument: -Dorg.apache.catalina.security.SecurityListener.UMASK=0027
16:34:56 []: Command line argument: -Dignore.endorsed.dirs=
16:34:56 []: Command line argument: -Dcatalina.base=/var/lib/
16:34:56 []: Command line argument: -Dcatalina.home=/usr/share/
16:34:56 []: Command line argument: -Djava.io.tmpdir=/tmp
16:34:56 []: Loaded Apache Tomcat Native library [1.2.31] using APR version [1.7.0].
16:34:56 []: APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true], UDS [true].
16:34:56 []: APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true]
16:34:56 []: OpenSSL successfully initialized [OpenSSL 3.0.2 15 Mar 2022]
16:34:56 []: Initializing ProtocolHandler ["http-nio-8080"]
16:34:56 []: Server initialization in [1099] milliseconds
16:34:57 []: Starting service [Catalina]
16:34:57 []: Starting Servlet engine: [Apache Tomcat/9.0.58 (Ubuntu)]
16:34:57 []: Deploying deployment descriptor [/etc//Catalina/localhost/xwiki.xml]
16:34:57 []: The path attribute with value [/xwiki] in deployment descriptor [/etc//Catalina/localhost/xwiki.xml] has been ignored
16:35:04 []: 2024-12-27 16:35:04,719 [main] INFO  iPropertiesConfigurationSource - Loading [xwiki.properties] from default location [/etc/xwiki/xwiki.properties]
16:35:05 []: 2024-12-27 16:35:05,164 [main] INFO  o.x.e.i.ServletEnvironment     - Using permanent directory [/mnt/data/xwiki-data]
16:35:14 []: 2024-12-27 16:35:14,876 [main] WARN  ltInstalledExtensionRepository - Invalid extension [org.xwiki.platform:xwiki-platform-distribution-flavor-mainwiki/16.5.0] on namespace [wiki:xwiki] (InvalidExtensionException: Dependency [org.xwiki.platform:xwiki-platform-oldcore-[16.5.0]] is incompatible with the core extension [org.xwiki.platform:xwiki-platform-legacy-oldcore/16.10.1])
16:35:19 []: 2024-12-27 16:35:19,901 [main] WARN  .i.DefaultExtensionInitializer - Failed to initialize dependency [org.xwiki.platform:xwiki-platform-user-profile-ui-16.5.0]: ExtensionException: Extension [org.xwiki.platform:xwiki-platform-like-ui/16.5.0] cannot be initialized because its dependency ([org.xwiki.platform:xwiki-platform-user-profile-ui-16.5.0]) could not.
16:35:22 []: 2024-12-27 16:35:22,997 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Updating Solr home directory at [/mnt/data/xwiki-data/store/solr]
16:35:23 []: 2024-12-27 16:35:23,114 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Starting embedded Solr server...
16:35:23 []: 2024-12-27 16:35:23,115 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Using Solr home directory: [/mnt/data/xwiki-data/store/solr]
16:35:26 []: 2024-12-27 16:35:26,401 [main] WARN  o.a.s.c.CoreContainer          - Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
16:35:32 []: 2024-12-27 16:35:32,281 [main] ERROR o.x.s.s.i.EmbeddedSolr         - 
16:35:32 []: org.apache.solr.common.SolrException: 
16:35:32 []: Caused by: org.apache.solr.common.SolrException: Error opening new searcher
16:35:32 []: Caused by: org.apache.lucene.index.IndexNotFoundException: 
16:35:32 []: 2024-12-27 16:35:32,290 [main] ERROR .o.i.DefaultObservationManager - 
16:35:32 []: org.xwiki.component.manager.ComponentLookupException: 
16:35:32 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
16:35:32 []: Caused by: org.xwiki.component.phase.InitializationException: 
16:35:32 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
16:35:32 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
16:35:32 []: Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
16:35:32 []: 2024-12-27 16:35:32,562 [main] ERROR h.i.DefaultExtensionJobHistory - Failed to read extension job history from [/mnt/data/xwiki-data/extension/history/2024.06.24.xml].
16:35:32 []: java.lang.NullPointerException: Cannot invoke "java.util.List.size()" because "list" is null
16:35:32 []: 2024-12-27 16:35:32,812 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Updating Solr home directory at [/mnt/data/xwiki-data/store/solr]
16:35:32 []: 2024-12-27 16:35:32,894 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Starting embedded Solr server...
16:35:32 []: 2024-12-27 16:35:32,895 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Using Solr home directory: [/mnt/data/xwiki-data/store/solr]
16:35:33 []: 2024-12-27 16:35:33,123 [main] WARN  o.a.s.c.CoreContainer          - Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
16:35:33 []: 2024-12-27 16:35:33,839 [main] ERROR o.x.s.s.i.EmbeddedSolr         - Failed to initialize Solr core with id [search_9]
16:35:33 []: org.apache.solr.common.SolrException: Error opening new searcher
16:35:33 []: Caused by: org.apache.solr.common.SolrException: Error opening new searcher
16:35:33 []: Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file found in LockValidatingDirectoryWrapper(NRTCachingDirectory(MMapDirectory@/mnt/data/xwiki-data/cache/solr/search_9/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@170a9ed8; maxCacheMB=48.0 maxMergeSizeMB=4.0)): files: [write.lock]
16:35:33 []: 2024-12-27 16:35:33,842 [main] ERROR .o.i.DefaultObservationManager - Failed to lookup listener with role hint [RecordableEventListener]
16:35:33 []: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.store.internal.RecordableEventListener] identified by type [interface org.xwiki.observation.EventListener] and hint [RecordableEventListener]
16:35:33 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.internal.DefaultEventStore] identified by type [interface org.xwiki.eventstream.EventStore] and hint [default]
16:35:33 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to get the configured event store [solr]
16:35:33 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.store.solr.internal.SolrEventStore] identified by type [interface org.xwiki.eventstream.EventStore] and hint [solr]
16:35:33 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
16:35:33 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
16:35:33 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
16:35:33 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
16:35:33 []: Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
16:35:33 []: 2024-12-27 16:35:33,868 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Updating Solr home directory at [/mnt/data/xwiki-data/store/solr]
16:35:33 []: 2024-12-27 16:35:33,954 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Starting embedded Solr server...
16:35:33 []: 2024-12-27 16:35:33,955 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Using Solr home directory: [/mnt/data/xwiki-data/store/solr]
16:35:34 []: 2024-12-27 16:35:34,070 [main] WARN  o.a.s.c.CoreContainer          - Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
16:35:34 []: 2024-12-27 16:35:34,656 [main] ERROR o.x.s.s.i.EmbeddedSolr         - Failed to initialize Solr core with id [search_9]
16:35:34 []: org.apache.solr.common.SolrException: Error opening new searcher
16:35:34 []: Caused by: org.apache.solr.common.SolrException: Error opening new searcher
16:35:34 []: Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file found in LockValidatingDirectoryWrapper(NRTCachingDirectory(MMapDirectory@/mnt/data/xwiki-data/cache/solr/search_9/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@170a9ed8; maxCacheMB=48.0 maxMergeSizeMB=4.0)): files: [write.lock]
16:35:34 []: 2024-12-27 16:35:34,659 [main] ERROR .o.i.DefaultObservationManager - Failed to lookup listener with role hint [solr.availablelocales]
16:35:34 []: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.SolrIndexAvailableLocalesListener] identified by type [interface org.xwiki.observation.EventListener] and hint [solr.availablelocales]
16:35:34 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.SolrClientInstance] identified by type [interface org.xwiki.search.solr.internal.api.SolrInstance] and hint [default]
16:35:34 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
16:35:34 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
16:35:34 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
16:35:34 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
16:35:34 []: Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
16:35:34 []: 2024-12-27 16:35:34,670 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Updating Solr home directory at [/mnt/data/xwiki-data/store/solr]
16:35:34 []: 2024-12-27 16:35:34,758 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Starting embedded Solr server...
16:35:34 []: 2024-12-27 16:35:34,759 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Using Solr home directory: [/mnt/data/xwiki-data/store/solr]
16:35:34 []: 2024-12-27 16:35:34,928 [main] WARN  o.a.s.c.CoreContainer          - Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
16:35:35 []: 2024-12-27 16:35:35,374 [main] ERROR o.x.s.s.i.EmbeddedSolr         - Failed to initialize Solr core with id [search_9]
16:35:35 []: org.apache.solr.common.SolrException: Error opening new searcher
16:35:35 []: Caused by: org.apache.solr.common.SolrException: Error opening new searcher
16:35:35 []: Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file found in LockValidatingDirectoryWrapper(NRTCachingDirectory(MMapDirectory@/mnt/data/xwiki-data/cache/solr/search_9/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@170a9ed8; maxCacheMB=48.0 maxMergeSizeMB=4.0)): files: [write.lock]
16:35:35 []: 2024-12-27 16:35:35,377 [main] ERROR .o.i.DefaultObservationManager - Failed to lookup listener with role hint [org.xwiki.eventstream.store.solr.internal.WikiDeletedListener]
16:35:35 []: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.store.solr.internal.WikiDeletedListener] identified by type [interface org.xwiki.observation.EventListener] and hint [org.xwiki.eventstream.store.solr.internal.WikiDeletedListener]
16:35:35 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
16:35:35 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
16:35:35 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
16:35:35 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
16:35:35 []: Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
16:35:35 []: 2024-12-27 16:35:35,385 [main] INFO  o.x.s.f.i.FilesystemStoreTools - Using filesystem store directory [/mnt/data/xwiki-data/store/file]
16:35:35 []: 2024-12-27 16:35:35,402 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Updating Solr home directory at [/mnt/data/xwiki-data/store/solr]
16:35:35 []: 2024-12-27 16:35:35,475 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Starting embedded Solr server...
16:35:35 []: 2024-12-27 16:35:35,476 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Using Solr home directory: [/mnt/data/xwiki-data/store/solr]
16:35:36 []: 2024-12-27 16:35:36,224 [main] WARN  o.a.s.c.CoreContainer          - Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
16:35:36 []: 2024-12-27 16:35:36,662 [main] ERROR o.x.s.s.i.EmbeddedSolr         - Failed to initialize Solr core with id [search_9]
16:35:36 []: org.apache.solr.common.SolrException: Error opening new searcher
16:35:36 []: Caused by: org.apache.solr.common.SolrException: Error opening new searcher
16:35:36 []: Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file found in LockValidatingDirectoryWrapper(NRTCachingDirectory(MMapDirectory@/mnt/data/xwiki-data/cache/solr/search_9/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@170a9ed8; maxCacheMB=48.0 maxMergeSizeMB=4.0)): files: [write.lock]
16:35:36 []: 2024-12-27 16:35:36,665 [main] ERROR .o.i.DefaultObservationManager - Failed to lookup listener with role hint [org.xwiki.notifications.notifiers.internal.UserEventDispatcherListener]
16:35:36 []: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.notifications.notifiers.internal.LegacyUserEventDispatcherListener] identified by type [interface org.xwiki.observation.EventListener] and hint [org.xwiki.notifications.notifiers.internal.UserEventDispatcherListener]
16:35:36 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.notifications.notifiers.internal.UserEventDispatcherScheduler] identified by type [class org.xwiki.notifications.notifiers.internal.UserEventDispatcherScheduler] and hint [default]
16:35:36 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.notifications.notifiers.internal.UserEventDispatcher] identified by type [class org.xwiki.notifications.notifiers.internal.UserEventDispatcher] and hint [default]
16:35:36 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.internal.DefaultEventStore] identified by type [interface org.xwiki.eventstream.EventStore] and hint [default]
16:35:36 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to get the configured event store [solr]
16:35:36 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.store.solr.internal.SolrEventStore] identified by type [interface org.xwiki.eventstream.EventStore] and hint [solr]
16:35:36 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
16:35:36 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
16:35:36 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
16:35:36 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
16:35:36 []: Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
16:35:36 []: 2024-12-27 16:35:36,676 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Updating Solr home directory at [/mnt/data/xwiki-data/store/solr]
16:35:36 []: 2024-12-27 16:35:36,739 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Starting embedded Solr server...
16:35:36 []: 2024-12-27 16:35:36,740 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Using Solr home directory: [/mnt/data/xwiki-data/store/solr]
16:35:37 []: 2024-12-27 16:35:37,357 [main] WARN  o.a.s.c.CoreContainer          - Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
16:35:37 []: 2024-12-27 16:35:37,745 [main] ERROR o.x.s.s.i.EmbeddedSolr         - Failed to initialize Solr core with id [search_9]
16:35:37 []: org.apache.solr.common.SolrException: Error opening new searcher
16:35:37 []: Caused by: org.apache.solr.common.SolrException: Error opening new searcher
16:35:37 []: Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file found in LockValidatingDirectoryWrapper(NRTCachingDirectory(MMapDirectory@/mnt/data/xwiki-data/cache/solr/search_9/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@170a9ed8; maxCacheMB=48.0 maxMergeSizeMB=4.0)): files: [write.lock]
16:35:37 []: 2024-12-27 16:35:37,748 [main] ERROR .o.i.DefaultObservationManager - Failed to lookup listener with role hint [org.xwiki.extension.index.internal.ExtensionInstallListener]
16:35:37 []: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.extension.index.internal.ExtensionInstallListener] identified by type [interface org.xwiki.observation.EventListener] and hint [org.xwiki.extension.index.internal.ExtensionInstallListener]
16:35:37 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.extension.index.internal.ExtensionIndexStore] identified by type [class org.xwiki.extension.index.internal.ExtensionIndexStore] and hint [default]
16:35:37 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
16:35:37 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
16:35:37 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
16:35:37 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
16:35:37 []: Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
16:35:37 []: 2024-12-27 16:35:37,887 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Updating Solr home directory at [/mnt/data/xwiki-data/store/solr]
16:35:38 []: 2024-12-27 16:35:38,001 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Starting embedded Solr server...
16:35:38 []: 2024-12-27 16:35:38,002 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Using Solr home directory: [/mnt/data/xwiki-data/store/solr]
16:35:38 []: 2024-12-27 16:35:38,444 [main] WARN  o.a.s.c.CoreContainer          - Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
16:35:38 []: 2024-12-27 16:35:38,936 [main] ERROR o.x.s.s.i.EmbeddedSolr         - Failed to initialize Solr core with id [search_9]
16:35:38 []: org.apache.solr.common.SolrException: Error opening new searcher
16:35:38 []: Caused by: org.apache.solr.common.SolrException: Error opening new searcher
16:35:38 []: Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file found in LockValidatingDirectoryWrapper(NRTCachingDirectory(MMapDirectory@/mnt/data/xwiki-data/cache/solr/search_9/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@170a9ed8; maxCacheMB=48.0 maxMergeSizeMB=4.0)): files: [write.lock]
16:35:38 []: 2024-12-27 16:35:38,939 [main] ERROR .o.i.DefaultObservationManager - Failed to lookup listener with role hint [org.xwiki.eventstream.store.internal.UserDeletedEventListener]
16:35:38 []: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.store.internal.UserDeletedEventListener] identified by type [interface org.xwiki.observation.EventListener] and hint [org.xwiki.eventstream.store.internal.UserDeletedEventListener]
16:35:38 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.internal.DefaultEventStore] identified by type [interface org.xwiki.eventstream.EventStore] and hint [default]
16:35:38 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to get the configured event store [solr]
16:35:38 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.store.solr.internal.SolrEventStore] identified by type [interface org.xwiki.eventstream.EventStore] and hint [solr]
16:35:38 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
16:35:38 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
16:35:38 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
16:35:38 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
16:35:38 []: Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
16:35:38 []: 2024-12-27 16:35:38,957 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Updating Solr home directory at [/mnt/data/xwiki-data/store/solr]
16:35:39 []: 2024-12-27 16:35:39,042 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Starting embedded Solr server...
16:35:39 []: 2024-12-27 16:35:39,044 [main] INFO  o.x.s.s.i.EmbeddedSolr         - Using Solr home directory: [/mnt/data/xwiki-data/store/solr]
16:35:39 []: 2024-12-27 16:35:39,334 [main] WARN  o.a.s.c.CoreContainer          - Not all security plugins configured!  authentication=disabled authorization=disabled.  Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external.  See https://s.apache.org/solrsecurity for more info
16:35:39 []: 2024-12-27 16:35:39,778 [main] ERROR o.x.s.s.i.EmbeddedSolr         - Failed to initialize Solr core with id [search_9]
16:35:39 []: org.apache.solr.common.SolrException: Error opening new searcher
16:35:39 []: Caused by: org.apache.solr.common.SolrException: Error opening new searcher
16:35:39 []: Caused by: org.apache.lucene.index.IndexNotFoundException: no segments* file found in LockValidatingDirectoryWrapper(NRTCachingDirectory(MMapDirectory@/mnt/data/xwiki-data/cache/solr/search_9/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@170a9ed8; maxCacheMB=48.0 maxMergeSizeMB=4.0)): files: [write.lock]
16:35:39 []: 2024-12-27 16:35:39,781 [main] ERROR .o.i.DefaultObservationManager - Failed to lookup listener with role hint [EventStreamStoreListener]
16:35:39 []: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.store.internal.DocumentEventListener] identified by type [interface org.xwiki.observation.EventListener] and hint [EventStreamStoreListener]
16:35:39 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.store.internal.DocumentEventRecorder] identified by type [class org.xwiki.eventstream.store.internal.DocumentEventRecorder] and hint [default]
16:35:39 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.internal.DefaultEventStore] identified by type [interface org.xwiki.eventstream.EventStore] and hint [default]
16:35:39 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to get the configured event store [solr]
16:35:39 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.eventstream.store.solr.internal.SolrEventStore] identified by type [interface org.xwiki.eventstream.EventStore] and hint [solr]
16:35:39 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.DefaultSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [default]
16:35:39 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to lookup configured Solr type [embedded]
16:35:39 []: Caused by: org.xwiki.component.manager.ComponentLookupException: Failed to lookup component [org.xwiki.search.solr.internal.EmbeddedSolr] identified by type [interface org.xwiki.search.solr.Solr] and hint [embedded]
16:35:39 []: Caused by: org.xwiki.component.phase.InitializationException: Failed to initialize the Solr embedded server with home directory set to [/mnt/data/xwiki-data/store/solr]
16:35:39 []: Caused by: org.apache.solr.client.solrj.SolrServerException: Failed to initialize the Solr core. Please check previous log messages.
16:35:40 []: 2024-12-27 16:35:40,475 [main] INFO  o.x.o.i.s.DefaultOfficeServer  - Open Office instance started.
16:35:40 []: Deployment of deployment descriptor [/etc//Catalina/localhost/xwiki.xml] has finished in [43,534] ms
16:35:40 []: Deploying web application directory [/var/lib//webapps/ROOT]
16:35:41 []: 2024-12-27 16:35:41,552 [Thread-18] ERROR o.j.l.o.VerboseProcess         -
16:35:41 []: 2024-12-27 16:35:41,552 [Thread-18] ERROR o.j.l.o.VerboseProcess         - (process:46725): dconf-CRITICAL **: 16:35:41.551: unable to create directory '/.cache/dconf': Read-only file system.  dconf will not work properly.
16:35:42 []: At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
16:35:42 []: Deployment of web application directory [/var/lib//webapps/ROOT] has finished in [1,724] ms
16:35:42 []: Starting ProtocolHandler ["http-nio-8080"]
16:35:42 []: Server startup in [45381] milliseconds
16:35:42 []: 2024-12-27 16:35:42,492 [jodconverter-offprocmng-0] WARN  tartProcessAndConnectRetryable - Office process died with exit code 81; restarting it
16:35:42 []: 2024-12-27 16:35:42,894 [Thread-23] ERROR o.j.l.o.VerboseProcess         -
16:35:42 []: 2024-12-27 16:35:42,895 [Thread-23] ERROR o.j.l.o.VerboseProcess         - (process:46753): dconf-CRITICAL **: 16:35:42.893: unable to create directory '/.cache/dconf': Read-only file system.  dconf will not work properly.

decpjohn · December 29, 2024, 3:34pm

Okay after googling pretty much every error message on that log I came to the conclusion that maybe the solr index or data got corrupt.

Maybe solr was indexing to the default permdir and somehow didnt/couldnt transfer/re-index at the final permdir location after I changed the permdir (see above posts) and got somehow got corrupt?

However I clearly dont see any error messages that would point to file permission issues, filesystem issues… Is there a way to safely destroy the entire index and reindex in the new permdir? I read on other forum posts about how bad it is to delete the [permdir]/solr folder but I noticed some Xwiki upgrades required deleting some of the solr folders/data due to different structures or something similar…

Before I move further I’d appeciate input from anybody more knowledgeable than me so I dont end up making a bigger mess…

tmortagne · December 30, 2024, 10:17am

Seems to be the root cause. No idea what the exact error mean, honestly, but the general idea is that the Lucene (Solr) index of the core search_9 is broken. The simplest is to stop XWiki and remove that index data. It should be something like <xwiki data>/cache/solr/search_9 (/var/lib/xwiki/data/cache/solr/search_9/ if you used the XWiki Debian package). When you restart, XWiki will automatically reindex the search.

decpjohn · December 30, 2024, 6:15pm

Well… Bingo!

Deleting the solr/search_9 folder did the trick and now AFAIK xwiki runs normally (albeit a bit on the slower side but will keep an eye since its probably due to reindexing)…

Thanks MANY times Thomas for your precious help!!!

tmortagne · December 31, 2024, 8:22am

Might be expected if the wiki is big (and there are a lot of pages to reindex). You can check the status of the index in the admin → search.

decpjohn · December 31, 2024, 4:04pm

I think the indexing is finished. This is not a big wiki by any means as it is only for me on my LAN…

If I may ask, I noticed while logged as admin the navigation panel seems to contain pretty much all previous pages that I renamed/moved as a standard user. While logged as standard user, the panel is clean and tidy (I only see the latest/current structure).

Is there a way to “cleanup” the panel? For example lets say I had a page called Procedures and a subpage called Mechanical… and moved (using the move/rename function) to another page called “Instructions” as an admin I will still see the “Mechanical” page under BOTH "Procedures and “Instructions”…

Structure before moving page:

Procedures
|-> Mechanical
Instructions
|

Desired structure after moving page:

Procedures
|
Instructions
|-> Mechanical

As admin:

Procedures
|-> Mechanical
Instructions
|-> Mechanical

As standard user:

Procedures
|
Instructions
|-> Mechanical