Skip to content

Exported model performance is too low for detection task #2548

@yunchu

Description

@yunchu

following TCs were reported as failed due to too low accuracy

  • tests/e2e/cli/detection/test_detection.py::TestToolsOTXDetection::test_otx_eval_openvino[True-Custom_Object_Detection_Gen3_SSD]
    • AssertionError: trained_performance[k]=0.5714285714285714, exported_performance[k]=0.44444444444444436
  • tests/e2e/cli/detection/test_detection.py::TestToolsOTXDetection::test_otx_eval_openvino[True-Object_Detection_YOLOX_L]
    • AssertionError: trained_performance[k]=0.6666666666666665, exported_performance[k]=0.3999999999999999
  • tests/e2e/cli/detection/test_detection.py::TestToolsOTXDetection::test_otx_eval_openvino[False-Custom_Object_Detection_Gen3_SSD]
    • AssertionError: trained_performance[k]=0.5714285714285714, exported_performance[k]=0.44444444444444436
  • tests/e2e/cli/detection/test_detection.py::TestToolsOTXDetection::test_otx_eval_openvino[False-Object_Detection_YOLOX_L]
    • AssertionError: trained_performance[k]=0.6666666666666665, exported_performance[k]=0.3999999999999999

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions