Servicenow MID Server Landing page - Support and Troubleshooting

Servicenow MID Server Landing page .ns-kb-css-body-editor-container { p { font-size: 12pt; font-family: Lato; color: var(--now-color--text-primary, #000000); } span { font-size: 12pt; font-family: Lato; color: var(--now-color--text-primary, #000000); } h2 { font-size: 24pt; font-family: Lato; color: var(--now-color--text-primary, black); } h3 { font-size: 18pt; font-family: Lato; color: var(--now-color--text-primary, black); } h4 { font-size: 14pt; font-family: Lato; color: var(--now-color--text-primary, black); } a { font-size: 12pt; font-family: Lato; color: var(--now-color--link-primary, #00718F); } a:hover { font-size: 12pt; color: var(--now-color--link-primary, #024F69); } a:target { font-size: 12pt; color: var(--now-color--link-primary, #032D42); } a:visited { font-size: 12pt; color: var(--now-color--link-primary, #00718f); } ul { font-size: 12pt; font-family: Lato; } li { font-size: 12pt; font-family: Lato; } img { display: ; max-width: ; width: ; height: ; } } .mce-toc{background-color:#f7f7f7;padding:10px;border-radius:5px;border:1px solid #dedede;width:50%;min-width:500px;} Table of Contents Overview Recent Inclusions MID Server Configuration MID Server Installation MID Server Upgrades MID Server Certificates MID Server Down & Connectivity MID Server Properties MID Server Resource Utilization MID Server with Antivirus MID Server ECC Queue & Discovery MID Server for Integrations Overview This article is a reference guide to the knowledge base articles and additional support resources that will help us to resolve the issues faster referring KB in this Article.

MID Server Recent Inclusions TLS Security Policy for the MID Server Truststore Migration for MID Server Discovery Command Audit Logs - "mid.log.command.audit.enable" Unified Keystore for MID Server MID Server Configuration Configuring MID Servers Knowledge Base Articles MID Server configured to use Edge Proxy fails to start if forward proxy is also configured MID Servers and IP Address Access Control Supported platform changes for MID Server MID Servers and Clones Role required to see the MID Server module MID Server Prerequisites - Connections to allow list for the MID Server Install Java 11 on MID servers How to change MID Server user Which features do MID Servers not support, depending on whether it is running on a Linux or Windows Host MID Server stops logging agent logs when an unsupported JDBC type data source is used. How to Update a MID Server password How to verify the signatures and integrity of signed MID Server JAR files Should MID Server wrapper.conf file be edited? Pros and cons of hosting multiple MID servers on the same single physical machine MID Server Installation Installing the MID Server Knowledge Base Articles Paris MID Server installation steps with screenshots Create a Windows service account with "Log on as Service" PolicyKit issues with Linux MID Servers using non-admin accounts Newly installed mid server is not showing up How to move an existing MID Server installation between host servers Which Java versions are supported and compatible with MID Servers (OpenJDK/Oracle JRE) Install Java 11 on MID servers MID Server download packages for installing OpenJDK on Windows and Linux hosts Quebec - MID Server Installation (With Mutual Authentication) Unable to see a new installed MID Server in services.msc or need to uninstall a MID Server MID Server Service does not get Installed without proper privileges MID Server download error "The requested URL was not found on this server" Running multiple MID server Services/Daemons on a single Linux Server is supported from Orlando onwards An error was discovered processing the WS-Security header during MID Server Installation Unable to install the ServiceNow MID Server_XXXX - The filename, directory name, or volume label syntax is incorrect. MID Server ZIP installer issues when using XML Special Characters in the Password How to make MID Server use a proxy for all traffic MID Server Installer (ZIP) log shows "access restricted" for instance details values, and fails to authenticate the user MID Server Installation does not create a record in the Instance Installing MID on Windows Server Core Known Errors With MSI Windows Installer for MID Server, the "Log on as Service" rights check can fail with users in Administrator group MID Server Upgrades MID Server upgrades Knowledge Base Articles MID Server connection failures when upgrading to Quebec MID Server Auto Upgrade hanging issues MID Server upgrade process - What actually happens when a MID Server upgrades itself? MID server upgrade fails due to: [wmi_collector.exe cannot be deleted .... cannot access the file because it is being used by another process] MID Server fails to auto upgrade and to restart with agent log error "wrapper-windows-x86-64.exe cannot be deleted" How to manually restore a MID Server after a failed upgrade MID server auto-upgrade fails while copying files from temp to agent folder on Windows even with ''Application Experience' enabled How to continue a MID Server upgrade after it has crashed in the middle of the ServiceNow Platform Distribution Upgrade service leaving the MID Server down and service not running Finding which process has locked a file during a MID Server auto-upgrade using Windows Resource Monitor (resmon.exe) Post Upgrade Mid-Servers have errors related to MID Server encryption and decrypting file information "" href="/kb?id=kb_article_view&sysparm_article=KB0814684">Mid Server issue after clone and upgrade: "Unable to subscribe to AMB channel: /mid/server/Mid Server issue after clone and upgrade: "Unable to subscribe to AMB channel: /mid/server/" Unable to upgrade the midserver for Quebec, Unable to load key store, MID server will not able to function MID Server version compatibility How to upgrade a MID Server that does not have access to the AutoUpgrade install server on the Internet MIDSERVER : SEVERE *** ERROR *** (34180)FileDBProviderImpl - Failed to clean the DB Cached files during MID startup Troubleshooting "[File] cannot be deleted" errors in Wrapper log when attempting to AutoUpgrade MID server MID Server upgrade error "Platform Distribution Upgrade service is not installed" MID Server upgrade error "java.lang.IllegalStateException: Filesystem permissions are incorrect" in agent logs How to stop the MID Server from auto upgrading Mid server name having a special character "&" causing issues when Mid server upgrades Trouble shooting and collect information when MID Server goes Down after Upgrade Controlling mid server version and mid server upgrades. MID Server Manual upgrade failing and corrupting the installation files Known Errors Issue with LDAPS Connection via MID since Quebec EA Upgrade The fix for PRB1320637 requires that the cacerts Truststore file password remains as the default "changeit", which many customers won't allow, causing certificate deletion during JRE upgrades (e.g. Quebec) and subsequent MID Server and Integration outage A MID Server upgrade that includes a new JRE version will overwrite the cacerts file Linux MID server auto-upgrade can fail even on Tanuki wrapper version 3.5.36 if MID service is not reinstalled MID Server service starts regardless of whether a failed Upgrade Service still remains, leading to deletion of the upgrade service, and potentially leaving the MID Server running in a semi-upgraded and corrupt state MID Server down after attempted upgrade, due to file locks caused by Dell SecureWorks Red Cloak anti-virus (mid.bat, java.exe, wrapper-windows-x86-64.exe) The MID Server Upgrade service doesn't properly detect if the MID Server has fully shut down, and so has issues with file locks when it starts deleting, potentially leaving the MID Server down MID Server pre-upgrade check fails with PSReadLine/PSConsoleReadLine/WinIOError error In Quebec : MID Server upgrade stops if Powershell tests in Pre-upgradecheck failed and Powerconsole remains busy and the closing the session failed MID Server Certificates Certificates MID Server certificate check policies Knowledge Base Articles MID Servers and Certificates MID Server TLS/SSL certificate check policy Quebec upgrade information How to obtain SSL certificate from the browser MID Server upgrades could reset the Java properties and certificates installed on cacerts REST Message via MID Server - Unable to decrypt parameter: rest_password, causes 401 - Invalid username/password combo MID server OSCP requirement details MID Server cannot connect to ServiceNow instance, error in agent log: org.apache.commons.httpclient.HttpException: javax.net.ssl.SSLPeerUnverifiedException: peer not authenticated LDAPS with MID server failed with Error "PKIX path building failed: java.security.cert.CertPathBuilderException" MID Server TLS policy for cloud, container, and external IPs MID Server certificate check security policies for self-hosted customers Verify all AWS certificates needed to establish a connection from the MID server to the AWS cloud server "No issuer certificate for certificate in certification path found" error observed on the MID logs MID Server certificate check security policies for self-hosted customers MID Server: No certificates identified for TrustStore migration MID Server security property for self signed certificates is not honoured Known Errors MID Server shows certificate chain errors with self-signed cert MID Server can fail to install or upgrade to Orlando due to new external connectivity requirement to ocsp.entrust.net for OCSP certification revocation verification check MID Server Down & Connectivity MID Server fails to start Resolving MID Server issues Knowledge Base Articles MID Server Down troubleshooting MID Server - Shutdown failed: Timed out waiting for signal from JVM MID Server shows DOWN after starting up or restarting due to SOAP Errors . The issue must be manually resolved."" href="/kb?id=kb_article_view&sysparm_article=KB0726915">MID Server Issue: "A MID Server with a duplicate name of sys_id was prevented from connecting. Install path C:\MID Server Issue: "A MID Server with a duplicate name of sys_id was prevented from connecting. Install path C:\. The issue must be manually resolved." MID server is down and in validating status. Timed out waiting for the OS to forcibly terminate the JVM process Using MID Server with Microsoft Forefront Threat Management Gateway (TMG) MID Server Down and Error about Disk space MID Server won't start due to Root Certificate requirements - wrapper error "The digital signature of the object did not verify" com.snc.glide.amb.AMBClient$ProxyBuilderException: java.net.URISyntaxException: Expected closing bracket for IPv6 address at index 13 WMI Collector deprecation details MID Server: troubleshooting WMI/Powershell issues - Credentials MID Server Issue PowershellIntialization MID Server PowerShell Initialization Issue with error message [Error encountered when invoking PowerShell, the result from running '"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -noninteractive -nologo -noprofile ...] Troubleshooting MID Server connectivity with the instance Error: "Could not decrypt file discovery whitelist after sync" Cannot connect, status is SSH_CONNECTION_FAILURE. Could not agree on key exchange algorithm MID Servers stuck in validating state Mid server Down - Error "Timed out waiting for wrapperServiceMain" seen in wrapper log Mid server startup failed with error 1053: The Service did not Respond to the Start or Control Request How to change the TEMP folder used for MID Server Required list of IP address for ocsp.entrust.net for firewall team to whitelist the oscp.entrust.net endpoint for mid server communication Unable to find two services for two mid servers New MID Server service on linux fails to start if another MID server is already installed on the same host "" href="/kb?id=kb_article_view&sysparm_article=KB0814684">Mid Server issue after clone and upgrade: "Unable to subscribe to AMB channel: /mid/server/Mid Server issue after clone and upgrade: "Unable to subscribe to AMB channel: /mid/server/" Mid Server restarts frequently Orlando MID Error: "An unexpected error occurred: Permission denied Move-Item : Access to the path is denied." MID Server Credential test failing Linux MID Server startup error failed to resolve the version of Java Mid server having special characters in name will cause issues ensure proper formatting for the MID Server MID server error "Error 2 'System cannot find the file specified'" MID error: Field(s) present in the query do not have permission to be read com.glide.processors.soap.SOAPProcessingException: Field(s) present in the query do not have permission to be read Mid Server Connectivity/Validation Issues in Paris UP time Report on Service Now Instance and Mid Server HTTP 500 Response and 'Unable to parse SOAP document' Causes MID Server Issues from Past Failed SOAP Parsing MID Server: "Validate" UI action doesn't do anything Mid Server records on instance responding VERY Slowly to UP and DOWN state of Mid Server Service, VALIDATION not completing [MID with Proxy] MID Server service might be started but its still shown as DOWN in instance MID Server error: An unexpected error occurred: The term 'XXX' is not recognized as the name of a cmdlet, function, script file, or operable program Windows Could not start MID Server Service Failed transfer plan context to new MID because all MIDs capable of running plan are down MID Server Down on Scheduled Export Set Jobs mid_server.down events are generated even if the mid server is not actually down Mid server running but displaying the error "MID Server not operational (status: Down), possibly due to recent clone." Known Errors File permissions enforcement removes permissions of the windows service's log on as user, when computer or domain name has lowercase letters, leaving MID Server down Mid Server DOWN due to false "expected service name" error, (1) if because of powershell issue the service name cannot be fetched or (2) if the 'case' of the Service Name not exactly matching between wrapper-override.conf and the running service/registry MID Server throws fatal error EXCEPTION_ACCESS_VIOLATION and goes Down when using Java 8 Update 261 (JRE 1.8.0_261) MID Server status in instance changes to DOWN after BR "Discovery - Update device started count" attempts to run multiple times. MID Server Properties MID Server properties MID Server parameters Knowledge Base Articles Controlling mid server version and mid server upgrades Enable SSH Debug on a MID server MID Server Resource Utilization MID Server reference information Knowledge Base Articles Request body exceeded max allowed content length MID Server high CPU consumption Resolving "Unable to kill PowerShell" errors in Windows MID Servers MID Server Performance Reports MID Server CPU running at 100% since upgrade to Orlando and High Memory Usage on Mid Servers during Discovery High CPU Usage on Host with MID Server(s) Discovery MID Servers at 100% CPU - Good or Bad, Why and then what? Mid server service restarts frequently due to "mdmp" files accumulating the MID installation folder How to collect the Thread dump for all MID servers via a script? MID Server wrapper logs contain INFO message "Wrapper Process has not received any CPU time. Extending timeouts." Stuck PowerShell processes on the MID server host Mid Server Import Issue How to remotely monitor per-process CPU and Memory usage of a MID Server host Huge ssh.log file on MID Server Intercepting MID server traffic to an instance Known Errors MID server can fail to start, throwing an Out-of-Memory error, if there are a large number of XML files in the ECC Sender folder The default/recommended MID Server CPU alert/mid server issue threshold is unrealistic for a MID Server doing Discovery Concurrency performance: JVM locks on OCSPCheckedCertificateCache are not released leading to import schedules taking exponentially longer (WARNING *** Freed stuck JVM lock: OCSPCheckedCertificateCache) MID Server with Antivirus Knowledge Base Articles How to add Exclusion set for the MID Server in Cisco AMP to prevent MID Server upgrade fail Allow Powershell scripts to pass through antivirus Some Anti-viruses are blocking MID Server Upgrade Known Errors Upgrade fails leaving MID Server DOWN, due to antivirus/security software flagging InjectorService.exe as Malware/Trojan MID Server down after attempted upgrade, due to file locks caused by Dell SecureWorks Red Cloak anti-virus (mid.bat, java.exe, wrapper-windows-x86-64.exe) MID Server upgrade fails leaving MID Server Down, due to Cisco AMP antivirus preventing the upgrade service deleting the Wrapper executable MID Server Upgrade fails if the temp directory of the JVM is changed to a path including spaces (to try to avoid antivirus/security blocking temp folder during upgrade) MID Server ECC Queue & Discovery MID Server ECC Queue Knowledge Base Articles Windows discovery using WMI fails with - Error evaling C:\Users\dnsadmin\AppData\Local\Temp\GenerateWMIScriptJS_WMI_FetchData6214298325369083622.js: Expected ';' Troubleshooting ECC Queue performance by inspecting the ECC Queue input records How the ECC Queue works - from output ready, to input processed Why are my MID Server-related Jobs stuck and ECC Queue inputs still in Ready State? In Paris release, Windows - Classify probe fails if credential username is in "user@domain" format instead of "domain\user", error is: New-CimSession : Access is denied SSH authentication failing post Quebec upgrade How are the Agent Client Collector record fields populated, and why might the CI field be empty? The MID Server WinRMAPI PowerShell Module update to the PSModulePath system variable is failing SSH Privileged Commands Specific MID server throws credential related issue if picked up for Service Mapping from MID Cluster How to link an ECC Queue record back to a specific Feature or Job Discovery Log Error on HTTP Classify Sensor "Sensor error when processing HTTP - Classify: -----------------------------Stack:com.snc.mid.util.midselector.MidServersConfig.getMidServerByDisplayName" MID Server is not processing JDBCProbe requests / ECC Records. Unable to Find a Proper MID Server when Discovering a Host with Quick Discovery How MID Server File Synchronisation works, to help when Troubleshooting MID Server doesn't process python code java.nio.BufferOverflowException with syslog probe transactions on midserver MID Server Max Threads, Worker Groups , Priority and Queues >" in discovery logs" href="/kb?id=kb_article_view&sysparm_article=KB0719810">How to disable messages "No mid found to trigger credential-less discovery for " in discovery logs 'ActionTest' action in Flow Designer is in 'in progress' state for a very long time (days) intermittently. SEVERE *** ERROR *** Unknown credential type downloaded; MID server may not have access to credentials table Known Errors Windows discovery classifier ends up with "The term 'executeWindowsClassify' is not recognized as the name of a cmdlet" [Paris upgrade]: WMI: Classify can fail, if "target_powershell_access" is false MID Server for Integrations Knowledge Base Articles Script include that calls JDBCProbe fails with java.lang.NullPointerException When trying to connect MID Server to SCCM data sources, getting error as "Did not get a response from the MID server" Why do my integrations via MID Servers sometimes take up to 40 seconds longer to run, or timeout? MID Server Selection for Service Graph Connector for SolarWinds JDBC Data Source execution fails with "Did not get a response from the MID server" Data Source Test Load 20 Records Fails with Did Not Get a Response From the MID Server error Flow Designer MID Server Action Step MID Server Cluster for ITOM Event Management Connector Instances Cyberark integration fails with unauthorized errors Why do my integrations via MID Servers sometimes take up to 40 seconds longer to run, or timeout? IntegrationHub: Unable to resolve IP Address for the host name: xyz.domain.com at com.snc.mid.util.midselector.IPRangeMidFilter:242 CyberArk credential storage can not authenticate when the CyberArk credential identifier is MID Server startup fails after configuring CyberARk parameter mid.secure_config.provider Link to Source Control over MID server: Operation encountered an unexpected error due to the 'bundle' file extension missing from glide.attachment.extensions when configured. Test SAP Connections and Versions failing with an "Couldn't find a valid mid server" Runtime NULL exception thrown for testing external store credentials. MID server not able to connect when configured with a user with LDAP Authentication How to link application to source control via MID server Export set "Scheduled Data Exports" intermittent 'Completed with errors' Known Errors LDAP "Test Connection" and "Browse" features can timeout, and LDAP Monitor may show Connection Status as Not Connected, due to running at Standard(2) MID Server priority - Did not get a response from the MID server after waiting for 55 seconds Powershell MID Server Script Files used by Orchestration Activity Packs are not signed, which is a requirement for some customers MID server running Oracle JRE version 8 release 231 can't start some applications - Discovery Powershell/WMI probes fail, Event Management SCOM connector won't start