Skip to content

Commit

Permalink
instant-id: added deleting of full precision pipeline before quantiza…
Browse files Browse the repository at this point in the history
…tion (#2539)

**Changes**:
- In order to reduce peak memory footprint, full precision OV pipeline
is now deleted right after calibration dataset is collected. This way it
does not take up additional memory during quantization.
- Comparing inference speed of original and optimized pipelines is now
optional (disabled by default) for the same reason.

After applying the changes and updating to openvino-nightly, the peak
memory is observed to drop from 120 GB to 60 GB.

Related ticket: 146016
  • Loading branch information
nikita-savelyevv authored Nov 20, 2024
1 parent f57d98e commit 8d79475
Showing 1 changed file with 147 additions and 79 deletions.
Loading

0 comments on commit 8d79475

Please sign in to comment.