Skip to content

[OTX] Introduce mmdeploy to export cls/seg/det models#1466

Merged
goodsong81 merged 16 commits intoopen-edge-platform:feature/otx-new-mmcv/basefrom
cih9088:feature/otx-new-mmcv/mmdeploy
Jan 2, 2023
Merged

[OTX] Introduce mmdeploy to export cls/seg/det models#1466
goodsong81 merged 16 commits intoopen-edge-platform:feature/otx-new-mmcv/basefrom
cih9088:feature/otx-new-mmcv/mmdeploy

Conversation

@cih9088
Copy link
Copy Markdown
Contributor

@cih9088 cih9088 commented Dec 26, 2022

Related MPA PR

Changes

  • Update openvino version
  • introduced mmdeploy
  • refactored to be mmdeploy friendly
  • removed colour format change in openvino classification model

@cih9088 cih9088 requested a review from a team as a code owner December 26, 2022 09:05
@github-actions github-actions bot added ALGO Any changes in OTX Algo Tasks implementation TEST Any changes in tests labels Dec 26, 2022
Copy link
Copy Markdown

@goodsong81 goodsong81 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What a work! Thank you for your effort.
Happy to see the NNCF/OV tests are re-enabled :)
Left a few question & comments.
Happy new year!

@goodsong81 goodsong81 merged commit 3730344 into open-edge-platform:feature/otx-new-mmcv/base Jan 2, 2023
cih9088 added a commit to cih9088/training_extensions that referenced this pull request Jan 2, 2023
…form#1466)

* feat: export using mmdeploy

* fix: adapt mmdeploy exported model

* test: enable openvino export

* fix: patch depending on fn type

* feat: mmdeploy for classification model

* test: enable export and openvino performance test

* fix: change temporary requirements

* refactor: use builder

* fix: do not propagate logger

* fix: remove image channel format conversion

* fix: handle unlabeled data

* fix: run eval before optimizing nncf network

* feat: change confidence threshold after nncf optimization

* fix: remove redundant attribute

* fix: official released openvino version

* fix: remove redundants
cih9088 added a commit to cih9088/training_extensions that referenced this pull request Jan 2, 2023
…form#1466)

* feat: export using mmdeploy

* fix: adapt mmdeploy exported model

* test: enable openvino export

* fix: patch depending on fn type

* feat: mmdeploy for classification model

* test: enable export and openvino performance test

* fix: change temporary requirements

* refactor: use builder

* fix: do not propagate logger

* fix: remove image channel format conversion

* fix: handle unlabeled data

* fix: run eval before optimizing nncf network

* feat: change confidence threshold after nncf optimization

* fix: remove redundant attribute

* fix: official released openvino version

* fix: remove redundants
cih9088 added a commit to cih9088/training_extensions that referenced this pull request Jan 5, 2023
…form#1466)

* feat: export using mmdeploy

* fix: adapt mmdeploy exported model

* test: enable openvino export

* fix: patch depending on fn type

* feat: mmdeploy for classification model

* test: enable export and openvino performance test

* fix: change temporary requirements

* refactor: use builder

* fix: do not propagate logger

* fix: remove image channel format conversion

* fix: handle unlabeled data

* fix: run eval before optimizing nncf network

* feat: change confidence threshold after nncf optimization

* fix: remove redundant attribute

* fix: official released openvino version

* fix: remove redundants
cih9088 added a commit to cih9088/training_extensions that referenced this pull request Jan 6, 2023
…form#1466)

* feat: export using mmdeploy

* fix: adapt mmdeploy exported model

* test: enable openvino export

* fix: patch depending on fn type

* feat: mmdeploy for classification model

* test: enable export and openvino performance test

* fix: change temporary requirements

* refactor: use builder

* fix: do not propagate logger

* fix: remove image channel format conversion

* fix: handle unlabeled data

* fix: run eval before optimizing nncf network

* feat: change confidence threshold after nncf optimization

* fix: remove redundant attribute

* fix: official released openvino version

* fix: remove redundants
cih9088 added a commit to cih9088/training_extensions that referenced this pull request Jan 6, 2023
…form#1466)

* feat: export using mmdeploy

* fix: adapt mmdeploy exported model

* test: enable openvino export

* fix: patch depending on fn type

* feat: mmdeploy for classification model

* test: enable export and openvino performance test

* fix: change temporary requirements

* refactor: use builder

* fix: do not propagate logger

* fix: remove image channel format conversion

* fix: handle unlabeled data

* fix: run eval before optimizing nncf network

* feat: change confidence threshold after nncf optimization

* fix: remove redundant attribute

* fix: official released openvino version

* fix: remove redundants
cih9088 added a commit to cih9088/training_extensions that referenced this pull request Jan 9, 2023
…form#1466)

* feat: export using mmdeploy

* fix: adapt mmdeploy exported model

* test: enable openvino export

* fix: patch depending on fn type

* feat: mmdeploy for classification model

* test: enable export and openvino performance test

* fix: change temporary requirements

* refactor: use builder

* fix: do not propagate logger

* fix: remove image channel format conversion

* fix: handle unlabeled data

* fix: run eval before optimizing nncf network

* feat: change confidence threshold after nncf optimization

* fix: remove redundant attribute

* fix: official released openvino version

* fix: remove redundants
goodsong81 pushed a commit that referenced this pull request Jan 16, 2023
* Update MPA submodule to origin/otx

* [OTX-MMCV] Public mmdetection (#1382)

Enable model training and NNCF in mmdet (#1355)

* Enable detection training on latest mmcv/det
- ATSS / SSD / YOLOX
- NNCF support for ATSS

* fix: import errors

* feat: add monkey patch to mmdet modules
- most of patches would be just wrapping for not tracing in nncf context

* feat: add trainable yolox
- add trainable yolox
- recursively search dataset cfg for nested dataset classes

* fix: change device to cpu when nncf tracing

* feat: add trainable ssd

* refactor: rearange nncf adapter

* feat: add trainable mask rcnn models

* refactor: move out common utils

* fix: ssd head bug

* feat: add lr scheduler for accuracy aware runner

* refactor: nncf module and monkey patch

* fix: proper clustering anchors for ssd

* fix: unable to trace the first module in NNCFNetwork

* fix: bring back ssd head structure

* feat: add train_step method to NNCFNetwork

* fix: mismatches

* fix: update pipeline for wrapper

* fix: add missing file

* Fix merge error

* Enable model training and NNCF in mmseg (#1400)

* refactor: remove redundant

* feat: enable mmseg training

* feat: add nncf related stuff

* fix: change lr config

* fix: align nncf target metric

* refactor: use mpa for training and inference

* test: enable tests

* fix: minor bug

* refactor: patcher

* fix: build consistent nncf graph

* fix: minor bug

* fix: remove unused backup

* fix: dealt with datacontainer

* [OTX-MMCLS] Enable NNCF (#1435)

* fix: use patcher

* feat: update mmcls version

* feat: enable NNCF for mmcls

* refactor: add build NNCF model functions

* fix: minor bug

* fix: typo

* fix: make sure importing nncf when enabled only

* fix: inherit from base super class of otx

* [OTX] Introduce mmdeploy to export cls/seg/det models (#1466)

* feat: export using mmdeploy

* fix: adapt mmdeploy exported model

* test: enable openvino export

* fix: patch depending on fn type

* feat: mmdeploy for classification model

* test: enable export and openvino performance test

* fix: change temporary requirements

* refactor: use builder

* fix: do not propagate logger

* fix: remove image channel format conversion

* fix: handle unlabeled data

* fix: run eval before optimizing nncf network

* feat: change confidence threshold after nncf optimization

* fix: remove redundant attribute

* fix: official released openvino version

* fix: remove redundants

* feat: public mm series libraries

* feat: otx refactoring and bug fix

* Revert "[OTX] Bugfix: multi GPU raise error when num_workers isn't set as 0. (#1475)"

This reverts commit c076902.

* feat: enable multi-nodes distributed training

* fix: redundant parts

* Revert "[OTX] Evaluate a model before training starts (#1472)"

This reverts commit f728295.

* feat: enable evaluation before and after training

* style: fix failed cases

* fix: disable sam optimizer for nncf task

* fix: add frezelayer hook for segmentation

* fix: deepcopy instead of shallowcopy

* fix: enable temporary disabled features

* fix: handle nncf state simply

* fix: remove submodule

* feat: proper test runner handler

* fix: add forcetrainmodehook

* fix: make sure model is evaluated before run

* fix: more merge conflicts

* fix: buffer line by line in userspace

* fix: patch torch, etc. only when nncf task is executed

* fix: restrict kornia version

* fix: restrict version

* fix: align data pipeline for supcon

* fix: unclutter things

* fix: ignore annoying leftover data.yaml

Co-authored-by: Songki Choi <songki.choi@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ALGO Any changes in OTX Algo Tasks implementation TEST Any changes in tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants