Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
instant-id: added deleting of full precision pipeline before quantiza…
…tion (#2539) **Changes**: - In order to reduce peak memory footprint, full precision OV pipeline is now deleted right after calibration dataset is collected. This way it does not take up additional memory during quantization. - Comparing inference speed of original and optimized pipelines is now optional (disabled by default) for the same reason. After applying the changes and updating to openvino-nightly, the peak memory is observed to drop from 120 GB to 60 GB. Related ticket: 146016
- Loading branch information