So, when you get to the MachineLearning world, it is important to understand that confidence is the likeliness to be right … and here, it is inception V3.
S
So, in fact, you have to understand that confidence is just an expression of the statistical likeliness that this is what it think it is. More often than you would expect, the confidence is below 40%, and while it find something close to what it is, it is not always super insightful for your software.
The art of using machine learning is to be able to adapt the user expectation of the accuracy of the best of art of the moment, in the field you are trying to apply it.