diff options
Diffstat (limited to 'tests/runtests.1')
-rw-r--r-- | tests/runtests.1 | 57 |
1 files changed, 38 insertions, 19 deletions
diff --git a/tests/runtests.1 b/tests/runtests.1 index fab635233..26cd3afb9 100644 --- a/tests/runtests.1 +++ b/tests/runtests.1 @@ -5,7 +5,7 @@ .\" * | (__| |_| | _ <| |___ .\" * \___|\___/|_| \_\_____| .\" * -.\" * Copyright (C) 1998 - 2019, Daniel Stenberg, <daniel@haxx.se>, et al. +.\" * Copyright (C) 1998 - 2020, Daniel Stenberg, <daniel@haxx.se>, et al. .\" * .\" * This software is licensed as described in the file COPYING, which .\" * you should have received as part of this distribution. The terms @@ -20,28 +20,37 @@ .\" * .\" ************************************************************************** .\" -.TH runtests.pl 1 "2 Feb 2010" "Curl 7.20.0" "runtests" +.TH runtests.pl 1 "2 Feb 2010" "Curl 7.69.0" "runtests" .SH NAME runtests.pl \- run one or more test cases .SH SYNOPSIS -.B runtests.pl [options] [test number] [!test number] [key word] [!key word] +.B runtests.pl [options] [tests] .SH DESCRIPTION \fIruntests.pl\fP runs one, several or all the existing test cases in curl's test suite. It is often called from the root Makefile of the curl package with \&'make test'. -.SH "TEST NUMBER" -If no test case number is given, all existing tests that the script can find -will be considered for running. You can specify single test cases to run, -space-separated, like "1 3 5 7 11", and you can specify a range like "45 to -67". You can also specify only the tests you don't want to run by listing -the numbers with a leading exclamation point, like "!66". -.P -It is also possible to specify tests to skip based on a key word describing -the test. These are specified with a leading exclamation point and the -key word or phrase, like "!HTTP NTLM auth". Likewise, tests to run can -be specified simply by specifying the unadorned key words, like "FTPS". -Remember that the exclamation marks and spaces will need to be quoted somehow -when entered at many command shells. +.SH "TESTS" +Specify which test(s) to run by specifying test numbers or keywords. + +If no test number or keyword is given, all existing tests that the script can +find will be considered for running. You can specify single test cases to run +by specifying test numbers space-separated, like "1 3 5 7 11", and you can +specify a range of tests like "45 to 67". + +Specify tests to not run with a leading exclamation point, like "!66", which +runs all available tests except number 66. + +Prefix a test number with a tilde (~) to still run it, but ignore the results. + +It is also possible to specify tests based on a keyword describing the test(s) +to run, like "FTPS". The keywords are strings used in the indiviual tests. + +You can also specify keywords with a leading exclamation point and the keyword +or phrase, like "!HTTP NTLM auth" to run all tests \fBexcept\fP those using +this keyword. Remember that the exclamation marks and spaces will need to be +quoted somehow when entered at many command shells. + +Prefix a keyword with a tilde (~) to still run it, but ignore the results. .SH OPTIONS .IP "-a" Continue running the rest of the test cases even if one test fails. By @@ -78,6 +87,9 @@ people checking the failures and the reasons for them might not have physical access to the machine and logs. .IP "-R" Run the tests in a scrambled, or randomized, order instead of sequentially. + +The random seed initially set for this is fixed per month and can be set with +\fI--seed\fP. .IP "-r" Display run time statistics. (Requires Perl Time::HiRes module) .IP "-rf" @@ -91,11 +103,18 @@ If \fB-R\fP is also used, the scrambling is done after the repeats have extended the test sequence. .IP "-s" Shorter output. Speaks less than default. -.IP "--shallow=[num](,seed)" +.IP "--seed=[num]" +When using \fI--shallow\fP or \fI-R\rP that random certain aspects of the +behavior, this option can set the initial seed. If not set, the random seed +will be set based on the currently set local year and month and the first line +of the "curl -V" output. +.IP "--shallow=[num]" Used together with \fB-t\fP. This limits the number of tests to fail in torture mode to no more than 'num' per test case. If this reduces the amount, -the given 'seed' will be used to randomly discard entries to fail until the -amount is 'num'. +the script will randomly discard entries to fail until the amount is 'num'. + +The random seed initially set for this is fixed per month and can be set with +\fI--seed\fP. .IP "-t[num]" Selects a \fBtorture\fP test for the given tests. This makes runtests.pl first run the tests once and count the number of memory allocations made. It then |