Commit Graph

22 Commits (42d192af792f5890a6d707caee5cb3c910a5eb9b)

Author SHA1 Message Date
Mike Gerwitz 42d192af79 progtest: Exit with non-zero status on test failure
Not a very useful test runner if it doesn't ever fail, now is it?

* Makefile.am (check): Invoke new test/runner-test.  Depend on modindex.
* bin/runner.js: Exit with non-zero status on assertion failure.
* test/_stub: Add stub program with good and bad test cases to test
    exit code.
* test/runner-test: Add system test.
2018-04-10 15:56:38 -04:00
Mike Gerwitz afc1a2038a progtest: Suppress terminating classifications during const run
Terminating classifications will occur any time there is actual data
validation, since we're passing no data at all.

* progtest/src/env.js (common): Pass argument to program#rater to suppress
  terminating classifications.
2018-03-06 14:16:32 -05:00
Mike Gerwitz 0d169ea9eb progtest: Return empty array of test cases if none provided
* progtest/src/reader/YamlTestReader.js (loadCases): Handle absence of any
  test cases.
* progtest/test/reader/YamlTestReaderTest.js: New respective test.
2018-03-06 11:41:21 -05:00
Mike Gerwitz 0cb43d5e8a progtest: Do not run tests async on console
Performance hit is too great; automated tests need to be _fast_!

* src/AsyncTestRunner.js: New TestRunner subtype.
* src/TestRunner.js (_runAsync): Rename to virtual protected
  `runAllTests'; this method is overridden by aforementioned subtype.
* src/env.js: Use it.
2018-03-05 16:24:53 -05:00
Mike Gerwitz 6cefab5344 progtest: Output trailing newline after summary line
* src/reporter/ConsoleTestReporter.js (createSummaryLine): Output trailing
  newline.
* test/reporter/ConsoleTestReporterTest.js: Modify respective test.
2018-03-05 15:59:34 -05:00
Mike Gerwitz 06435f9f17 progtest: Add runner script
* .gitignore: Ignore new generated files (Autoconf, Automake, output).
* Makefile: Rename to `Makefile.am', dynamically expand
  `--harmony-destructuring'.
* autogen.sh: New script.
* bin/runner.in: New runner script.
* bin/runner.js: Resolve program path relative to CWD.
* configure.ac: New configure script.
2018-03-05 15:57:38 -05:00
Mike Gerwitz 2f7ad95a2c TestRunner: Recognize error as failure 2018-02-23 15:45:54 -05:00
Mike Gerwitz 7475b5b928 progtest/README.md: Basic test case format documentation 2018-02-23 14:30:02 -05:00
Mike Gerwitz 1a51259a76 HtmlConsoleOutput: Add HTML-styled console output 2018-02-23 14:20:10 -05:00
Mike Gerwitz 5aa29216f4 Makefile: run modindex first 2018-02-23 13:45:38 -05:00
Mike Gerwitz 6487282f55 progtest: add dist target 2018-02-23 12:28:03 -05:00
Mike Gerwitz b490d07371 Makefile.am: Prevent doc from being built by default 2018-02-23 12:24:14 -05:00
Mike Gerwitz d1aa5f5704 progtest/Makefile: Build tame-progtest.js as default target 2018-02-23 10:40:00 -05:00
Mike Gerwitz 76795d1c89 progtest/package.json (devDependencies): Add mocha and chai 2018-02-23 10:34:38 -05:00
Mike Gerwitz fcc5c087fd progtest/package.json: Correct browserify version 2018-02-23 10:31:51 -05:00
Mike Gerwitz 9e421daf67 progtest: bug: constants are not initialized until rating
Ugh, this is nasty.
2018-02-19 15:21:14 -05:00
Mike Gerwitz b214945963 progtest: .gitignore: ignore compiled output 2018-02-19 15:21:14 -05:00
Mike Gerwitz 4e3a86866a progtest: Display reader errors in browser 2018-02-19 15:21:14 -05:00
Mike Gerwitz 0b433e86f4 progtest: Async run each test serially
If that makes sense.

The problem is that the browser needs to repaint after each test is
run.  See code comments.
2018-02-19 15:21:14 -05:00
Mike Gerwitz f788edd675 Initial embedding of YAML test case runner 2018-02-19 15:21:14 -05:00
Mike Gerwitz 253f845803 progtest: Generate index.js files 2018-02-19 15:21:14 -05:00
Mike Gerwitz 47f0f4039b progtest: Initial working console runner 2018-02-19 15:21:14 -05:00