Using AI Review to Set Motion Capture Sensitivity
I'm finding AI review extremely helpful for setting sensitivity levels to filter out false positives. In my case I'm looking for vehicles in our driveway and trying to filter out our robot mower. The AI review shows the mower as 88% vehicle at the highest. Does this mean that if I set vehicle sensitivity to 10% it will only trigger on 90% and greater vehicle hits?
Thanks
Comments
-
BTW, it would be useful to be able to sort the AI review photos by hit percentage for either human, vehicle, or animal. That would make searching for the highest percentage for a certain object easier.
-
Great to hear that you're finding the new AI Review window useful! We'll certainly consider adding some further filters/sorting in future updates.
The AI sensitivity sliders don't correspond to exact model prediction threshold values. This is because our model evolves over time as we continually train and improve it, and successive models have different characteristics (e.g. depending on how it's trained, one model may output 80% if it's really sure about an object, while another model may output 99%). Each time we train a new model, we will adjust how the sensitivity setting corresponds to how exactly the model output is interpreted, with the goal being to give roughly equivalent behaviour from the user's point of view.
The current model is clearly not great at distinguishing the mower from a genuine vehicle - this is because of the visual similarities and the fact that we don't have many robot mowers in our dataset. We'll work to improve this (and you submitting the incorrect images to us from the AI Review window will help with this). For now there won't be a setting that will work well - if you reduce the sensitivity to 10%, you'll miss many real vehicles.
-
Thanks for clarifying. I’ll go ahead and submit the incorrect images now and again after each update.
