You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Confusion matrix as true positive (TP), false positive (FP), true negative (TN) and false negative (FN) is a powerful accuracy metric that we have for classification.
We also have it segmentation tasks based on pixel counts. However, this is not meaningful for radiologist or data scientist since they care about number of tumors missed not number of pixel missed.
Describe the solution you'd like
It would be great if we have an accuracy metric that would do: for each label calculate connected component and compare it with the ground truth. If there is more than x % overlap then it is calculated as TP. if there is no ground truth then it is FP. Then we should check on the ground truth that doesn't have any inference should be counted as FN
We can ignore TN as it is about the background.
Describe alternatives you've considered
Manually have radiologist count the tumors and write values in excel files. This doesn't scale at all
Additional context
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Confusion matrix as true positive (TP), false positive (FP), true negative (TN) and false negative (FN) is a powerful accuracy metric that we have for classification.
We also have it segmentation tasks based on pixel counts. However, this is not meaningful for radiologist or data scientist since they care about number of tumors missed not number of pixel missed.
Describe the solution you'd like
It would be great if we have an accuracy metric that would do: for each label calculate connected component and compare it with the ground truth. If there is more than x % overlap then it is calculated as TP. if there is no ground truth then it is FP. Then we should check on the ground truth that doesn't have any inference should be counted as FN
We can ignore TN as it is about the background.
Describe alternatives you've considered
Manually have radiologist count the tumors and write values in excel files. This doesn't scale at all
Additional context
The text was updated successfully, but these errors were encountered: