Project

General

Profile

Troubleshooting » History » Version 6

Version 5 (Luke Murphey, 10/27/2016 03:40 AM) → Version 6/11 (Luke Murphey, 02/22/2017 06:04 AM)

h1. Troubleshooting

Below are some pointers to help in debugging the application:

h2. Search for modular input errors

Run a search for the following and see if the logs indicate a problem with the modular input:

<pre>
index=_internal sourcetype=web_availability_modular_input
</pre>

h2. Search for tracebacks

Run a search for the following and see if the logs indicate a crash with the modular input:

<pre>
index=_internal traceback
</pre>

h2. Search for REST handler errors

Run a search for the following and see if the logs indicate a problem with the REST handler:

<pre>
index=_internal source=*website_monitoring_rest_handler.log
</pre>

h2. Input fails and generates a "ConnectionError"

This can happen when the following is

# The IP address is invalid (if referring to the host by IP)
# The domain name cannot be resolved
# The port number provided is invalid (if a port is specified)
# Network connectivity is lost or a firewall blocks the connection

h2. Troubleshooting modular inputs that don't appear in the Splunk Manager

Look in the messages link in the top right of the page to see if you have a message like this:

<pre>
Unable to initialize modular input "web_ping" defined inside the app "website_monitoring": Introspecting scheme=web_input: script running failed (exited with code 1).
</pre>

You can search the internal log for related errors that indicate the modular input could not start:

<pre>
index=_internal "ModularInputs - Unable to initialize modular input"
</pre>

The best way to identify the source of the error if the modular input cannot be loaded by Splunk is to try to load it via Splunk's python interpreter directly.

Here is an example. Consider the modular input is in the following path: /opt/splunk/etc/apps/website_monitoring/bin/web_ping.py

To test this, go to the path /opt/splunk/etc/apps/website_monitoring/bin/ using the CLI:

<pre>
cd /opt/splunk/etc/apps/website_monitoring/bin/
</pre>

Next, run Splunk's python against the file:

<pre>
/opt/splunk/bin/splunk cmd python web_ping.py
</pre>

This should show an error, such as:

<pre>
Traceback (most recent call last):
File "web_input.py", line 1, in <module>
somethingnotdefined
NameError: name 'somethingnotdefined' is not defined
</pre>

h2. Determining the cause of errors relating to "splunkd connection error"

This happens when the input is running but Splunkd fails to respond when the input attempts to determine if a proxy server was configured. This appears to happen to Splunk installs that are running fine. In most cases that I can verify, it happens when Splunk has just been started. These can likely be safely ignored unless other issues have been observed that are related or if you see a large number of them.

h2. Authentication is failing against sites that use Windows Authentication (a.k.a. NTLM authentication)

Search the Website Monitoring logs for information that indicates which authentication type is being used. The app will attempt to discover the authentication type automatically. If this fails, then authentication will not succeed.

<pre>

| search index=_internal sourcetype="web_availability_modular_input" auth_type
</pre>