Q1: What if I want to use other network backbones, such as ResNet [1], instead of only those provided ones (e.g., Xception)?
A: The users could modify the provided core/feature_extractor.py to support more network backbones.
Q2: What if I want to train the model on other datasets?
A: The users could modify the provided dataset/build_{cityscapes,voc2012}_data.py and dataset/segmentation_dataset.py to build their own dataset.
Q3: Where can I download the PASCAL VOC augmented training set?
A: The PASCAL VOC augmented training set is provided by Bharath Hariharan et al. [2] Please refer to their website for details and consider citing their paper if using the dataset.
Q4: Why the implementation does not include DenseCRF [3]?
A: We have not tried this. The interested users could take a look at Philipp Krähenbühl's website and paper for details.
Q5: What if I want to train the model and fine-tune the batch normalization parameters?
A: If given the limited resource at hand, we would suggest you simply fine-tune
from our provided checkpoint whose batch-norm parameters have been trained (i.e.,
train with a smaller learning rate, set fine_tune_batch_norm = false
, and
employ longer training iterations since the learning rate is small). If
you really would like to train by yourself, we would suggest
-
Set
output_stride = 16
or maybe even32
(remember to change the flagatrous_rates
accordingly, e.g.,atrous_rates = [3, 6, 9]
foroutput_stride = 32
). -
Use as many GPUs as possible (change the flag
num_clones
in train.py) and settrain_batch_size
as large as possible. -
Adjust the
train_crop_size
in train.py. Maybe set it to be smaller, e.g., 513x513 (or even 321x321), so that you could use a larger batch size. -
Use a smaller network backbone, such as MobileNet-v2.
Q6: How can I train the model asynchronously?
A: In the train.py, the users could set num_replicas
(number of machines for training) and num_ps_tasks
(we usually set num_ps_tasks
= num_replicas
/ 2). See slim.deployment.model_deploy for more details.
Q7: I could not reproduce the performance even with the provided checkpoints.
A: Please try running
# Run the simple test with Xception_65 as network backbone.
sh local_test.sh
or
# Run the simple test with MobileNet-v2 as network backbone.
sh local_test_mobilenetv2.sh
First, make sure you could reproduce the results with our provided setting. After that, you could start to make a new change one at a time to help debug.
-
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun
[link], In CVPR, 2016. -
Semantic Contours from Inverse Detectors
Bharath Hariharan, Pablo Arbelaez, Lubomir Bourdev, Subhransu Maji, Jitendra Malik
[link], In ICCV, 2011. -
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Philipp Krähenbühl, Vladlen Koltun
[link], In NIPS, 2011.