Troubleshooting » History » Version 4
Luke Murphey, 06/30/2016 06:44 PM
1 | 1 | Luke Murphey | h1. Troubleshooting |
---|---|---|---|
2 | 1 | Luke Murphey | |
3 | 1 | Luke Murphey | Below are some pointers to help in debugging the application: |
4 | 1 | Luke Murphey | |
5 | 1 | Luke Murphey | h2. Search for modular input errors |
6 | 1 | Luke Murphey | |
7 | 1 | Luke Murphey | Run a search for the following and see if the logs indicate a problem with the modular input: |
8 | 1 | Luke Murphey | |
9 | 1 | Luke Murphey | <pre> |
10 | 1 | Luke Murphey | index=_internal sourcetype=web_availability_modular_input |
11 | 1 | Luke Murphey | </pre> |
12 | 1 | Luke Murphey | |
13 | 4 | Luke Murphey | |
14 | 4 | Luke Murphey | h2. Search for tracebacks |
15 | 4 | Luke Murphey | |
16 | 4 | Luke Murphey | Run a search for the following and see if the logs indicate a crash with the modular input: |
17 | 4 | Luke Murphey | |
18 | 4 | Luke Murphey | <pre> |
19 | 4 | Luke Murphey | index=_internal traceback |
20 | 4 | Luke Murphey | </pre> |
21 | 4 | Luke Murphey | |
22 | 4 | Luke Murphey | |
23 | 1 | Luke Murphey | h2. Search for REST handler errors |
24 | 1 | Luke Murphey | |
25 | 1 | Luke Murphey | Run a search for the following and see if the logs indicate a problem with the REST handler: |
26 | 1 | Luke Murphey | |
27 | 1 | Luke Murphey | <pre> |
28 | 1 | Luke Murphey | index=_internal source=*website_monitoring_rest_handler.log |
29 | 1 | Luke Murphey | </pre> |
30 | 2 | Luke Murphey | |
31 | 2 | Luke Murphey | h2. Input fails and generates a "ConnectionError" |
32 | 2 | Luke Murphey | |
33 | 2 | Luke Murphey | This can happen when the following is |
34 | 2 | Luke Murphey | |
35 | 2 | Luke Murphey | # The IP address is invalid (if referring to the host by IP) |
36 | 2 | Luke Murphey | # The domain name cannot be resolved |
37 | 2 | Luke Murphey | # The port number provided is invalid (if a port is specified) |
38 | 2 | Luke Murphey | # Network connectivity is lost or a firewall blocks the connection |
39 | 3 | Luke Murphey | |
40 | 3 | Luke Murphey | h2. Troubleshooting modular inputs that don't appear in the Splunk Manager |
41 | 3 | Luke Murphey | |
42 | 3 | Luke Murphey | Look in the messages link in the top right of the page to see if you have a message like this: |
43 | 3 | Luke Murphey | |
44 | 3 | Luke Murphey | <pre> |
45 | 3 | Luke Murphey | Unable to initialize modular input "web_ping" defined inside the app "website_monitoring": Introspecting scheme=web_input: script running failed (exited with code 1). |
46 | 3 | Luke Murphey | </pre> |
47 | 3 | Luke Murphey | |
48 | 3 | Luke Murphey | You can search the internal log for related errors that indicate the modular input could not start: |
49 | 3 | Luke Murphey | |
50 | 3 | Luke Murphey | <pre> |
51 | 3 | Luke Murphey | index=_internal "ModularInputs - Unable to initialize modular input" |
52 | 3 | Luke Murphey | </pre> |
53 | 3 | Luke Murphey | |
54 | 3 | Luke Murphey | The best way to identify the source of the error if the modular input cannot be loaded by Splunk is to try to load it via Splunk's python interpreter directly. |
55 | 3 | Luke Murphey | |
56 | 3 | Luke Murphey | Here is an example. Consider the modular input is in the following path: /opt/splunk/etc/apps/website_monitoring/bin/web_ping.py |
57 | 3 | Luke Murphey | |
58 | 3 | Luke Murphey | To test this, go to the path /opt/splunk/etc/apps/website_monitoring/bin/ using the CLI: |
59 | 3 | Luke Murphey | |
60 | 3 | Luke Murphey | <pre> |
61 | 3 | Luke Murphey | cd /opt/splunk/etc/apps/website_monitoring/bin/ |
62 | 3 | Luke Murphey | </pre> |
63 | 3 | Luke Murphey | |
64 | 3 | Luke Murphey | Next, run Splunk's python against the file: |
65 | 3 | Luke Murphey | |
66 | 3 | Luke Murphey | <pre> |
67 | 3 | Luke Murphey | /opt/splunk/bin/splunk cmd python web_ping.py |
68 | 3 | Luke Murphey | </pre> |
69 | 3 | Luke Murphey | |
70 | 3 | Luke Murphey | This should show an error, such as: |
71 | 3 | Luke Murphey | |
72 | 3 | Luke Murphey | <pre> |
73 | 3 | Luke Murphey | Traceback (most recent call last): |
74 | 3 | Luke Murphey | File "web_input.py", line 1, in <module> |
75 | 3 | Luke Murphey | somethingnotdefined |
76 | 3 | Luke Murphey | NameError: name 'somethingnotdefined' is not defined |
77 | 3 | Luke Murphey | </pre> |