Project

General

Profile

Test Plan » History » Version 37

Luke Murphey, 10/15/2017 04:29 AM

1 1 Luke Murphey
h1. Test Plan
2 1 Luke Murphey
3 35 Luke Murphey
Items that considered tests of high importance are highlighted in *bold*. Those prefixed with *[Automated]* have been "automated":https://github.com/LukeMurphey/splunk-lookup-test.
4 35 Luke Murphey
5 7 Luke Murphey
h2. General
6 7 Luke Murphey
7 7 Luke Murphey
# The app must work with custom root endpoints
8 7 Luke Murphey
# The app has a description
9 7 Luke Murphey
# The app has an icon
10 7 Luke Murphey
# The app is visible
11 22 Luke Murphey
# The app works on all applicable versions of Splunk (6.1+)
12 19 Luke Murphey
## 6.1 and earlier does not support replication of CSV files
13 22 Luke Murphey
## 6.0 and earlier does not support the check-boxes on the editor form (thus is not supported)
14 7 Luke Murphey
# The print and edit controls are not displayed on the lister and editor
15 8 Luke Murphey
# The app works with IE, Safari, FireFox, and Chrome
16 7 Luke Murphey
17 7 Luke Murphey
h2. File Lister
18 7 Luke Murphey
19 7 Luke Murphey
# Lookup files appear including both user-based and app-based files and the list is complete (isn't missing files)
20 7 Luke Murphey
# A warning is shown if the user does not have permission to view the lookup files
21 7 Luke Murphey
# Both KV store and CSV lookup files are included
22 20 Luke Murphey
## KV store lookup options are not listed on hosts that are pre-6.2
23 7 Luke Murphey
# The list has functional pagination
24 7 Luke Murphey
# Files can be exported
25 18 Luke Murphey
## User-specific lookups can be exported
26 18 Luke Murphey
## Global lookups can be exported
27 18 Luke Murphey
## Lookups in the app directory but re-assigned ownership to a user can be exported (lookups that are in the app directory but are re-assigned to an owner that isn't nobody via meta-data)
28 18 Luke Murphey
## Both KV store and CSV lookups can be exported
29 7 Luke Murphey
# Filters work
30 29 Luke Murphey
# *[Automated]* Edit permissions page works
31 28 Luke Murphey
## Link successfully opens
32 1 Luke Murphey
## Permissions page redirects back to the lister
33 29 Luke Murphey
# *[Automated]* Search link opens
34 7 Luke Murphey
35 7 Luke Murphey
36 7 Luke Murphey
h2. File Editor
37 8 Luke Murphey
38 7 Luke Murphey
# Users can create new lookups
39 21 Luke Murphey
## Disabled apps are not listed in the apps list
40 7 Luke Murphey
## The editor warns users if the name or namespace is not provided (when creating a new lookup)
41 10 Luke Murphey
## A warning is shown if the lookup file or collection already exists
42 36 Luke Murphey
## *[Automated]* A warning is shown if no fields are defined for a KV store lookup file
43 37 Luke Murphey
## *[Automated]* A warning is shown if the KV store field names are not unique
44 36 Luke Murphey
## *[Automated]* A warning is shown if the KV store fields include a lineage that conflicts with other fields (e.g. cannot have "a" and "a.b")
45 7 Luke Murphey
## Importing a lookup file into a new lookup file should fill out the name with the file name if it was not yet completed
46 7 Luke Murphey
## Lookup files are saved with the correct name and in the correct app
47 7 Luke Murphey
## When a lookup is created, the URL is modified such that it matches a URL that link to editing the lookup
48 17 Luke Murphey
### All arguments are present: type, owner, name, namespace
49 7 Luke Murphey
# Importation functions
50 7 Luke Murphey
## Files can be imported by dragging a file onto the editor or on the import dialog (for CSV lookups only)
51 7 Luke Murphey
## KV store shouldn't load a file by dragging into the editor (since it isn't supported yet)
52 13 Luke Murphey
## User lookups are created in the users directory; these lookups are listed in the list UI for that user
53 1 Luke Murphey
# Users can edit lookups
54 26 Luke Murphey
## *CSV files are replicated (by making the necessary calls to force replication)*
55 29 Luke Murphey
## *[Automated]* The files can be modified in the editor (both KV store and CSV)
56 27 Luke Murphey
### New empty rows can be edited (in both KV store and CSV lookups)
57 26 Luke Murphey
## *Lookups entries can be loaded from other users (KV store only)*
58 23 Luke Murphey
### Entries are saved in the user selected
59 23 Luke Murphey
### Entries from a given user are displayed
60 1 Luke Murphey
### The URL is modified when switching user contexts
61 24 Luke Murphey
### Rows are deleted under the loaded user
62 15 Luke Murphey
## Adding a new row works and doesn't show "null"
63 29 Luke Murphey
## *[Automated]* The user is provided messaging regarding saving edits (that it is in-progress and/or completed)
64 34 Luke Murphey
## *[Automated]* KV store with a hierarchy can be edited
65 34 Luke Murphey
## *[Automated]* *KV store that enforces types can be edited (and a warning is shown if an incorrect types)*
66 34 Luke Murphey
### *[Automated]* Incorrect values for fields when a lookup has defined types can be edited
67 26 Luke Murphey
## *Making multiple KV store lookups with the same name is not allowed*
68 7 Luke Murphey
## A warning is shown if the user does not have permission to view the lookup files
69 7 Luke Murphey
## A warning is shown if the lookup file does not exist
70 32 Luke Murphey
## *[Automated]* A warning is shown if the lookup file is too large to modify
71 26 Luke Murphey
## Users cannot remove the header
72 7 Luke Murphey
## Lookup files that are owned by a user but are actually in the apps directory are saved in the correct location
73 9 Luke Murphey
## The lookup backup list is refreshed when saving (CSV only)
74 33 Luke Murphey
## *[Automated]* *The editor recognizes the field types (if available) for KV lookups and shows that the value is incorrect (e.g. entering "foo" in a field that expects an number is shown as invalid)*
75 1 Luke Murphey
## Header is fixed so that it always appears at the top of the editor
76 9 Luke Murphey
## If a lookup has no rows, then the editor will display at least one empty row
77 25 Luke Murphey
## A warning is displayed if attempting to remove the first row (CSV lookups only)
78 7 Luke Murphey
# Users can view and load backups of files (CSV only)
79 7 Luke Murphey
## Backups are automatically made when a lookup is saved
80 7 Luke Murphey
## Loading a backup causes it to be loaded into the editor
81 7 Luke Murphey
## A message is shown when a lookup is loaded
82 12 Luke Murphey
## Backups for user lookups work
83 1 Luke Murphey
# XSS prevention
84 17 Luke Murphey
## An imported CSV with scripting doesn't get executed
85 31 Luke Murphey
## *[Automated]* A CSV or KV store lookup with scripting doesn't get executed