Project

General

Profile

Bug #1639

Search command, inputs.conf and controller are out of sync

Added by Luke Murphey over 7 years ago. Updated over 7 years ago.

Status:
Closed
Priority:
Normal
Assignee:
Category:
-
Target version:
Start date:
12/02/2016
Due date:
% Done:

100%


Description

inputs.conf search bnf web_scrape.py web controller
url url url url
interval (excluded) (excluded) (excluded)
title (excluded) (excluded) (excluded)
selector selector selector selector
username username username username
password password password password
name_attributes name_attributes name_attributes
user_agent user_agent
use_element_name use_element_name use_element_name use_element_name
page_limit page_limit page_limit page_limit
url_filter url_filter url_filter url_filter
depth_limit depth_limit depth_limit depth_limit
raw_content include_raw_content include_raw_content raw_content -> include_raw_content
text_separator text_separator text_separator text_separator
browser browser browser browser
timeout timeout timeout timeout
output_as_mv output_as_mv output_matches_as_mv output_as_mv -> output_matches_as_mv
output_matches_as_separate_fields
include_empty_matches include_empty_matches
match_prefix match_prefix
proxy*
Based on this analysis, the following changes are needed:
  • Add user-agent to the search BNF
  • Correct output_matches_as_mv in search command
  • Change search command to take raw_content instead of include_raw_content
  • Add name_attributes to search command

Associated revisions

Revision 299 (diff)
Added by lmurphey over 7 years ago

Fixing issue where the fields for search command were sometimes wrong

Closes #1639

History

#1 Updated by Luke Murphey over 7 years ago

  • Description updated (diff)

#2 Updated by Anonymous over 7 years ago

  • Status changed from New to Closed
  • % Done changed from 0 to 100

Applied in changeset splunk-web-input|r437.

Also available in: Atom PDF