Bug #1524
Inputs hang each other up (especially ones that timeout)
Start date:
10/19/2016
Due date:
% Done:
100%
Description
To save memory, the input currently uses single instance mode (a single input running all of the inputs).
To fix this, I could:- Change input away from single instance mode
- This is difficult to do because then I would have to use Splunk's interval which doesn't support time specifiers (like 5m).
- Would need to a process to convert these to Splunk's interval and the current interval; UI would likely need to accept and convert to/from Splunk's interval
- Switch to a multi-threading model
Subtasks
History
#1 Updated by Luke Murphey about 8 years ago
- Subject changed from Inputs hang each other up to Inputs hang each other up (especially ones that timeout)
#3 Updated by Luke Murphey about 8 years ago
- https://answers.splunk.com/answers/464902/website-monitoring-app-not-working-as-per-the-sche.html
- https://answers.splunk.com/answers/462699/website-monitoring-is-there-a-limit-on-the-number.html
- https://answers.splunk.com/answers/386292/polling-frequency-seems-to-default-to-10m.html
- https://answers.splunk.com/answers/308170/website-monitoring-why-does-monitoring-seem-slow-a.html
#4 Updated by Luke Murphey about 8 years ago
- Target version set to 2.0
#5 Updated by Luke Murphey about 8 years ago
Things that need to be changed to support multi-threading:
logger():needs to not allow multiple thread access (is thread safe per http://stackoverflow.com/questions/2973900/is-pythons-logging-module-thread-safe)- output_result(): needs to control multiple thread access to output_event()
- run(): needs to instantiate multiple threads
- shutdown(): needs to cleanup threads
#7 Updated by Luke Murphey about 8 years ago
Uncontesting access to locks doesn't appear to have much of a performance issue : http://stackoverflow.com/questions/11966471/python-cost-of-locking-vs-performance-does-multithreading-make-sense
#8 Updated by Luke Murphey about 8 years ago
- Status changed from New to In Progress
- Assignee set to Luke Murphey
#9 Updated by Luke Murphey about 8 years ago
- Status changed from In Progress to Closed