Bug 474 - Augment test infrastructure to show priorities of passing/failing tests
Summary: Augment test infrastructure to show priorities of passing/failing tests
Status: DEFERRED
Alias: None
Product: Libre-SOC's first SoC
Classification: Unclassified
Component: Source Code (show other bugs)
Version: unspecified
Hardware: PC Linux
: Lowest enhancement
Assignee: Luke Kenneth Casson Leighton
URL:
Depends on:
Blocks:
 
Reported: 2020-08-27 01:55 BST by Cole Poirier
Modified: 2020-09-01 23:55 BST (History)
2 users (show)

See Also:
NLnet milestone: ---
total budget (EUR) for completion of task and all subtasks: 0
budget (EUR) for this task, excluding subtasks' budget: 0
parent task for budget allocation:
child tasks for budget allocation:
The table of payments (in EUR) for this task; TOML format:

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Cole Poirier 2020-08-27 01:55:05 BST 
Jacob and I just had a call because I wanted to ask him some questions about Kazan, and we talked about Libre-SOC's testing infrastructure.

Jacob said a change he would like to make to our testing infrastructure is to annotate the importance or priorities of the passing/failing tests.

I brought up that I thought we could also benefit (if to a much lesser extent) with an easier to parse test failure reporting format taken from https://wardpy.com/ or https://github.com/CleanCut/green or Jacob mentioned either taking code from VSCode's python unittest plugin, or looking into nmigen's interface for their CI code coverage.

I know I wouldn't be the right person to attempt these modifications, and I know we have the very tight upcoming October tape-out deadline, so I'm raising this bug as unconfirmed for you, Luke, to decide what to do with it.