module documentation
Regression evaluation.
Class |
|
Base class for regression evaluation methods. |
Class |
|
Base class for configuring RegressionEvaluation instances. |
Class |
|
Class that stores the results of a regression evaluation. |
Class |
|
Simple regression evaluation. |
Class |
|
Base class for configuring SimpleEvaluation instances. |
Function | evaluate |
Evaluates the regression predictions in the given collection with respect to the specified ground truth values. |
Variable | logger |
Undocumented |
Function | _parse |
Undocumented |
Function | _parse |
Undocumented |
Function | _safe |
Undocumented |
def evaluate_regressions(samples, pred_field, gt_field='ground_truth', eval_key=None, missing=None, method=None, custom_metrics=None, progress=None, **kwargs):
(source)
¶
Evaluates the regression predictions in the given collection with respect to the specified ground truth values.
You can customize the evaluation method by passing additional parameters for the method's config class as kwargs.
The natively provided method values and their associated configs are:
- "simple":
SimpleEvaluationConfig
If an eval_key is specified, then this method will record some statistics on each sample:
- When evaluating sample-level fields, an eval_key field will be populated on each sample recording the error of that sample's prediction.
- When evaluating frame-level fields, an eval_key field will be populated on each frame recording the error of that frame's prediction. In addition, an eval_key field will be populated on each sample that records the average error of the frame predictions of the sample.
Parameters | |
samples | a fiftyone.core.collections.SampleCollection |
pred | the name of the field containing the predicted
fiftyone.core.labels.Regression instances |
gt | the name of the field containing the
ground truth fiftyone.core.labels.Regression instances |
evalNone | a string key to use to refer to this evaluation |
missing:None | a missing value. Any None-valued regressions are given this value for results purposes |
method:None | a string specifying the evaluation method to use. The supported values are fo.evaluation_config.regression_backends.keys() and the default is fo.evaluation_config.default_regression_backend |
customNone | an optional list of custom metrics to compute or dict mapping metric names to kwargs dicts |
progress:None | whether to render a progress bar (True/False), use the default value fiftyone.config.show_progress_bars (None), or a progress callback function to invoke instead |
**kwargs | optional keyword arguments for the constructor of the
RegressionEvaluationConfig being used |
Returns | |
a RegressionResults |