Splunk Apps

• HtmlTestRunner: https://github.com/oldani/HtmlTestRunner/releases: 1.1.1
• Jinja: https://github.com/pallets/jinja/releases: 2.9.6
• MarkupSafe: https://pypi.python.org/pypi/MarkupSafe: 1.0.0

• https://docs.gocd.org/current/configuration/managing_artifacts_and_reports.html
• https://docs.gocd.org/current/configuration/dev_upload_test_report.html

HtmlTestRunner doesn't allow you to set a static file name.

• Setting outsuffix so that the file doesn't have the time markers
  • This causes the file to not even have an ending
  • The file name will still change depending on the test name which means GoCD cannot pull it in
• Renaming the file when done
  • This doesn't work since the test runner calls exit()
• The system creates multiple HTML files (one for each class)
  • See https://github.com/oldani/HtmlTestRunner/issues/6

See also http://tungwaiyip.info/software/HTMLTestRunner.html

• Isn't capable of running the entire test suite without declaring the entire test suite
• Apparently doesn't run all tests from a suite via a list from loader.loadTestsFromTestCase()
• Doesn't allow running individual tests via CLI options

• splunk-app-unit-tests-6.2-plus
  • [Done] webhooks-input
  • [Done] web-input
  • [Done] ftp-receiver
  • [Done] syndication-input
  • [Done] network-tools
• splunk-app-unit-tests-6.3-plus
  • [Done] website-monitoring
• splunk-app-unit-tests-6.0-plus
  • [Done] file-info
• splunk-app-unit-tests-6.4-plus
  • [Done] lookup-editor

Here is another one: https://github.com/lucrib/HTMLTestRunner2

I don't think it is logging skipped tests.

For future reference, here is how I am upgrading the tests:

Add the following imports:

import errno
import HTMLTestRunner

Make sure to put the HTMLTestRunner class next to unit.py.

Then add the test code:

if __name__ == '__main__':
    report_path = os.path.join('..', os.environ.get('TEST_OUTPUT', 'tmp/test_report.html'))

    # Make the test directory
    try:
        os.makedirs(os.path.dirname(report_path))
    except OSError as exception:
        if exception.errno != errno.EEXIST:
            raise

    with open(report_path, 'w') as report_file:
        test_runner = HTMLTestRunner.HTMLTestRunner(
            stream=report_file
        )
        unittest.main(testRunner=test_runner)