Leave One Out Mode evaluates performance using the leave-one-out variant of cross validation.
It is implemented by org.bdval.LeaveOneOutMode.java.
Mode Parameters
The following options are available in this mode
| Flag | Arguments | Required | Description |
|---|---|---|---|
--cv-repeats |
cv-repeats | no | Number of cross validation repeats. default=1 (does one round of cross-validation). Values larger than one cause the cross validation to be repeated and results averaged over the rounds. (default: 1) |
(-f|--folds) |
folds | yes | Number of cross validation folds. |
--submission-file |
submission-file | no | The MAQC-II submission file to create. Please note that this file lacks some columns required for MAQCII submission. These columns must be created manually in excel. (default: -) |
--other-measures |
other-measures | no | A list of performance measures to evaluate and report in the maqcii file. These measures will be appended at the end of the columns, after the official maqcii submission columns. (default: ) |
--label |
label | no | A string that the type of model construction process used to generate the models. |
--binary |
binary | no | Indicates that binary decision values (-1/+1) should be used to evaluate the binary flavor of evaluation measures in addition to the traditional evaluation measures. (default: false) |
Leave a Comment