fiftyone.utils.eval.base

module documentation
(source)

Base evaluation methods.

Copyright 2017-2025, Voxel51, Inc.
voxel51.com

Class BaseClassificationResults Base class for evaluation results that expose classification metrics like P/R/F1 and confusion matrices.
Class BaseEvaluationMethod Base class for evaluation methods.
Class BaseEvaluationMethodConfig Base class for configuring evaluation methods.
Class BaseEvaluationResults Base class for evaluation results.
Function get_subset_view Returns the view into the given collection specified by the subset definition.
Variable foo Undocumented
Variable foue Undocumented
Variable logger Undocumented
Function _compute_accuracy Undocumented
Function _compute_confusion_matrix Undocumented
Function _compute_support Undocumented
Function _parse_labels Undocumented
Function _print_dict_as_table Undocumented
def get_subset_view(sample_collection, gt_field, subset_def): (source)

Returns the view into the given collection specified by the subset definition.

Example subset definitions:

# Subset defined by a saved view
subset_def = {
    "type": "view",
    "view": "night_view",
}

# Subset defined by a sample field value
subset_def = {
    "type": "sample",
    "field": "timeofday",
    "value": "night",
}

# Subset defined by a sample field expression
subset_def = {
    "type": "field",
    "expr": F("uniqueness") > 0.75,
}

# Subset defined by a label attribute value
subset_def = {
    "type": "attribute",
    "field": "type",
    "value": "sedan",
}

# Subset defined by a label expression
bbox_area = F("bounding_box")[2] * F("bounding_box")[3]
subset_def = {
    "type": "attribute",
    "expr": (0.05 <= bbox_area) & (bbox_area <= 0.5),
}

# Compound subset defined by a sample field value + sample expression
subset_def = [
    {
        "type": "field",
        "field": "timeofday",
        "value": "night",
    },
    {
        "type": "field",
        "expr": F("uniqueness") > 0.75,
    },
]

# Compound subset defined by a sample field value + label expression
bbox_area = F("bounding_box")[2] * F("bounding_box")[3]
subset_def = [
    {
        "type": "field",
        "field": "timeofday",
        "value": "night",
    },
    {
        "type": "attribute",
        "expr": (0.05 <= bbox_area) & (bbox_area <= 0.5),
    },
]

# Compound subset defined by a saved view + label attribute value
subset_def = [
    {
        "type": "view",
        "view": "night_view",
    },
    {
        "type": "attribute",
        "field": "type",
        "value": "sedan",
    }
]
Parameters
sample_collectiona fiftyone.core.collections.SampleCollection
gt_fieldthe ground truth field
subset_defa dict or list of dicts defining the subset. See above for syntax and examples
Returns
a fiftyone.core.view.DatasetView
foo = (source)

Undocumented

foue = (source)

Undocumented

logger = (source)

Undocumented

def _compute_accuracy(ytrue, ypred, labels=None, weights=None): (source)

Undocumented

def _compute_confusion_matrix(ytrue, ypred, labels, weights=None, ytrue_ids=None, ypred_ids=None, tabulate_ids=False): (source)

Undocumented

def _compute_support(ytrue, labels=None, weights=None): (source)

Undocumented

def _parse_labels(ytrue, ypred, classes, missing): (source)

Undocumented

def _print_dict_as_table(d, digits): (source)

Undocumented