-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enable image recognition for photos added to the plant and moth surveys #292
Comments
I assume that this would be a user-configurable choice anyway. Personally I would like something more than what I understand has been done for eSurveyor. AFAIK, in that case the image recognition results are presented alongside record cleaner type information. So, e.g., a high probability from the classifier might be presented alongside information that states that the species is unknown from the hectad or whatever. I would prefer to go further than this, as I think we will still get situations where people just choose the highest values from the classifier probabilities, irrespective of other information. My suggestion is to also use pseudo-frequency information on the taxon in question from the database itself (e.g. as here and combine this with the probability coming from the classifier). For example, if we had a species that the classifier claimed 0.95 confidence for, but it was only known from 0.001 of relevant records, then we would present the geometric mean of these as the adjusted confidence (i.e. |
@sacrevert the main focus of this issue is that we offer image recognition in some parts of the app but not others. The questions about what information we give to users are important but separate. For this issue I just want to add consistency for users of the app. On that basis, would you be happy for image recognition as it currently stands to be available within the plant survey? |
@kitenetter there are two ways to do this. a) Integrate the PlantNet classifier into the Plant survey, and add the NIA to the Moths survey. b) #239, I continue using the proxy module and add it to these two new surveys. @JimBacon modifies the proxy module, which currently only uses the NIA results, to detect some suggestions being plants to give it another pass with the PlantNet classifier. Option b) requires Jim's input, but is the easiest from my perspective and also improves the plant-related results to the other two surveys (single record and list of records) which rely on the NIA service for plant suggestions. |
For info, the most recent version of the proxy module, https://github.com/Indicia-Team/drupal-8-modules-indicia-ai, does give access to PlantNet. It doesn't, iirc, do the double pass of using NIA to identify a plant and then Plantnet to refine the result. |
Sounds like the proxy module is a good solution (fwiw, the double-pass strategy sounds inefficient anyway, as presumably there will be many photos of insects on plants, and passing these to Plantnet sounds like a waste of energy unless NIA is very good at guessing whether or not the plant is the subject). |
And if this is explicitly for a plant survey it makes sense to go directly to PlantNet. |
Image recognition is currently offered for individual records and for the Species List Survey. We'd like to extend this to the Moth Survey and the Plant Survey (unless @sacrevert says otherwise).
I assume that #239 will apply to the Plant Survey.
The text was updated successfully, but these errors were encountered: