Records the findings of a review of the whole test suite: three duplicate tests confirmed by comparing coverage profiles, two inaccuracies in TESTS.md, a hand-rolled itoa in seed_test.go, and four tests thin enough to need a decision. Also lists the pairs that share a coverage profile but assert different properties, and the functions whose zero coverage is deliberate, so a later pass does not re-report them. Temporary: delete once the items are done or moved to ROADMAP. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
7.7 KiB
Test-suite review — action plan
Working document for the findings of the 2026-08-04 review of the test suite. It is not part of the permanent doc set: delete it once every item below is either done or moved to ROADMAP.md.
The rules the findings were judged against live in STANDARDS.md; the suite itself is described in TESTS.md.
Baseline the review started from
- 172 tests, 4693 lines of test code.
- 84.4% statement coverage across
domain,storage,runner,scheduler, andappmeasured together with-coverpkg(per-package figures understate it, because e.g.domain.NewRuntimeis exercised from theapptests). - TESTS.md documents 171 of the 172 tests.
Overall finding: the suite is not padded. Every test but one carries a real assertion, and most record the property they pin. The items below are the exceptions.
Method note: redundancy was not judged by reading. Each suspected pair was run
in isolation with -coverprofile and the profiles compared. "Identical
coverage" below means the two profiles were byte-identical after sorting.
Identical coverage alone is not grounds for deletion — several kept tests hit
the same statements while asserting genuinely different properties. Deletion
requires identical coverage and assertions that are a subset.
1. Delete the measured duplicates
Each of these has a byte-identical coverage profile with an existing test whose assertions are a superset. Roughly 30 lines total.
TestCleanupLogsKeepsFilesWithinAgeLimit(cleanup_test.go:53) — delete.TestCleanupLogsRemovesFilesPastMaxAgealready asserts that the file inside the age limit survives.TestRunDueEmptyOverlapInheritsGlobal(run_test.go:457) — delete. It builds the same service asTestRunDueQueueRerunsAfterFinish(parallel mode, globalqueue, a job with an emptyOverlapPolicy) and asserts strictly less. Before deleting, move its one unique line — the setup guardsvc.jobs[0].OverlapPolicy != ""— intoTestRunDueQueueRerunsAfterFinish, so that test still states out loud that it is exercising the inherited policy rather than an explicit one.TestSameWindowsPathHandlesSpaces(autostart_windows_test.go:20) — delete. It is the same case asTestSameWindowsPathIgnoresCaseAndQuotes(quoted path, mixed case);sameWindowsPathdoes not split on spaces, so the space in the fixture reaches no new code. If the spaces case is worth naming, fold the path into the surviving test's fixture instead.
After the deletions, re-run the affected packages and confirm coverage is unchanged:
go test -coverpkg=./src/domain,./src/storage,./src/runner,./src/scheduler,./src/app ./src/domain ./src/storage ./src/runner ./src/scheduler ./src/app
2. Fix the documentation drift
- TESTS.md claims
TestLoadOrCreateConfigCreatesDefaultsOnFirstRunverifies that a missing config file is created "with sane defaults and a sample job". The test never touches jobs, andstorage.defaultJobssits at 0% coverage. Decide which half is wrong: either drop the claim from the table, or add the assertion that the seededjobs.jsoncontains the sample jobs. Adding the assertion is the better outcome —defaultJobsis the only accidental coverage gap the review found. - TESTS.md does not list
TestCancelRowOverlapAddsBackOneInnerPadding(layout_test.go:35). Add it to thesrc/ui/layout_test.gotable.
3. Replace the hand-rolled helper in test code
- seed_test.go:34 defines
itoa: 18 lines of digit-by-digit conversion with a fresh allocation per digit, in a file that already importsstrconv. Replace the calls withstrconv.FormatIntand delete the helper. Untested logic inside a test file is exactly what produces a test result nobody can trust.
4. Thin tests — decide, then act
None of these is wrong; each is close enough to worthless that it should be either justified or removed. Grouped because they want one decision, not four.
TestEmitWithNoObserversIsNoop(events_test.go:36) — the only test in the suite with no assertion at all. Ranging over a nil slice cannot panic in Go, so it pins nothing. Delete.TestStoreReturnsWiredStore(service_test.go:51) — asserts that a one-line getter returns its own field. Delete.TestMainViewBuilds(mainwindow_test.go:72) — a smoke test;TestMainViewFitsTheDefaultWindowSizebuilds the same view. Its only unique coverage isw.SetContent(content)andrecordStartup(0, true). Either fold those two calls into the sizing test and delete this one, or keep it and say in its comment thatrecordStartupis what it is for.TestFilteredJobIndexesAll/ByNamedFolder/NoFolder/EmptySlice(jobs_view_test.go:59-101) — four tests over one small pure function. Collapse into one table-driven test in the style ofTestFilterValuedirectly above them; theEmptySlicecase becomes one row rather than a function.
5. Runtime cost of the runner tests (optional)
TestRunJobLogFileAllHeaders, TestRunJobRecordFields, and
TestRunJobWritesLogFile (runner_test.go) have
identical coverage profiles but assert three genuinely different things — log
headers, RunRecord field values, and the log file's name and directory. They
are not duplicates and should not be deleted on that basis.
The cost is that each spawns a real subprocess; the runner package takes 5.3 s.
If suite wall time becomes a concern, merge them into one RunJob call with
three assertion blocks. Until then, leave them alone.
Explicitly not changing
Recorded here so a later pass does not re-report them:
TestSetGlobalPausePersistsToConfigFilehas the same coverage asTestSetGlobalPauseUpdatesRuntimesAndEmitsbut asserts a different property — that the flag reachesgosentry.json, which is what makes the pause survive a restart.TestRunDueQueueDrainsMultipleOverlapshas the same coverage asTestRunDueQueueRerunsAfterFinish, but drains three queued occurrences rather than one. It is the test that would catch a drain loop that fires once.TestCreateStartupShortcutHandlesCyrillicPathand...HandlesSpacescover the same statements, but non-ASCII paths and paths with spaces are different real-world failure modes for the WScript.Shell COM call.- The 0% functions in the non-UI packages are deliberate: the real
Clock(a fake is injected everywhere),OpenStore/ResolvePaths/Service.Start/Service.Openand the autostart and desktop-icon wrappers (process entry points and OS integration), andShouldNotifyOnFailure(a getter under the mutex).storage.defaultJobsis the exception — see item 2.
Suggested order
- Item 2 (docs) — smallest, and the
defaultJobsassertion is the only one that adds coverage. - Item 3 (
itoa) — independent of everything else. - Item 1 (deletions) — one commit, with the coverage re-run as evidence.
- Item 4 (thin tests) — needs a judgment call per test.
- Item 5 — only if suite wall time becomes a problem.
Items 1 and 4 change the test inventory, so TESTS.md has to be updated in the same commit. No CHANGELOG.md entry is needed: none of this changes shipped behavior.