This ticket relies on doing #1224 first.
Many customers are using Mentra Live to take pictures of text. This works fine when the Mentra Live is on WiFi but isn't fine when the Mentra Live is only connected to the phone via BLE. This is because we need to compress the image heavily to send it over BLE, which makes the text unreadable.
We need a way for the developer to specify "text mode" for the case where images fall back to BLE transfer.
When in text mode, we should not blindly compress the image. Instead, when the Mentra Live detects it needs to send the image via BLE, it should first run a small text detection model to determine the coordinates of text within the image, and then crop the image to just the text. From there, we can run the normal compression system but only if the resulting image is still too high of a file size.
This ticket relies on doing #1224 first.
Many customers are using Mentra Live to take pictures of text. This works fine when the Mentra Live is on WiFi but isn't fine when the Mentra Live is only connected to the phone via BLE. This is because we need to compress the image heavily to send it over BLE, which makes the text unreadable.
We need a way for the developer to specify "text mode" for the case where images fall back to BLE transfer.
When in text mode, we should not blindly compress the image. Instead, when the Mentra Live detects it needs to send the image via BLE, it should first run a small text detection model to determine the coordinates of text within the image, and then crop the image to just the text. From there, we can run the normal compression system but only if the resulting image is still too high of a file size.