xpra icon
Bug tracker and wiki

Opened 5 years ago

Closed 5 years ago

Last modified 5 years ago

#795 closed defect (fixed)

Refactor perf test to facilitate auto-regression

Reported by: Nick Centanni Owned by: Nick Centanni
Priority: major Milestone:
Component: android Version: trunk
Keywords: Cc:

Description

We have a requirement to run automated variations of test_measure_perf.py as part of regression testing, so I'm proposing moving the options from the main file into a swappable config file, so that many iterations of the tests can be run against varying settings.

Attachments (2)

test_measure_perf.patch (30.0 KB) - added by Nick Centanni 5 years ago.
Patch to modify test_measure_perf.py to support a separate config class.
perf_config_default.py (7.8 KB) - added by Nick Centanni 5 years ago.
Default test_measure_perf config file, which can be replaced on the command line with alternates.

Download all attachments as: .zip

Change History (4)

Changed 5 years ago by Nick Centanni

Attachment: test_measure_perf.patch added

Patch to modify test_measure_perf.py to support a separate config class.

Changed 5 years ago by Nick Centanni

Attachment: perf_config_default.py added

Default test_measure_perf config file, which can be replaced on the command line with alternates.

comment:1 Changed 5 years ago by Antoine Martin

Owner: changed from Antoine Martin to Nick Centanni

Looks good, I haven't actually tried it yet but it makes sense to separate code and data.
Please commit it to trunk and close this ticket with the revision info.

comment:2 Changed 5 years ago by Nick Centanni

Resolution: fixed
Status: newclosed

Checked in the first version of this code/data separation, in revisions r8559, r8560, r8561, r8562, r8563, r8572, r8573.

I added a print_options function in the config class for dumping the contents of all of the options residing in the config.

I added a new option STARTING_TEST to specify the index of the first test to run.

I added a second command line argument csv_filename, if specified, the csv data will be written to that file in addition to being printed to screen.

Last edited 5 years ago by Nick Centanni (previous) (diff)
Note: See TracTickets for help on using tickets.