When troubleshooting an AI related issue for clients using Overjet or Pearl’s Apteryx overlay, the AI Usage tab in Sites can be very helpful in determining where the issue lies. This dashboard is access by navigating to the customer’s site in https://sites-pdds.Apteryx.net, then selecting “View AI Usage.”
View AI Usage tab not appearing
If the “View AI Usage” button does not appear in their Sites page, this indicates the site has not yet sent any AI result requests to the AI vendor. This button missing is generally a good indicator that AI is not configured correctly yet, or the office has not yet begun utilizing AI.
AI Usage Dash Overview
Example of an active AI Usage Dash:
AI Usage Summary Section:
AI Vendor: Indicates the vendor providing the AI results
Last Request Sent Datetime: Displays the most recently sent request
Last Response Received Datetime: Displays the most recent response back from the AI vendor
Number of Requests Issues (Last 24h): Displays number of requests sent to the AI vendor in the last 24 hours
Number of Responses Received (Last 24h): Displays number of responses we’ve received from the AI vendor in the last 24 hours
Avg Response Time: (sec): Displays an average of time between sent requests and received responses over the last 24 hours
AI Requests Section:
Vendor Name: Indicates the vendor providing the AI results
Request ID: Internal ID number of the request sent from Apteryx to the AI Vendor (not a visible ID number within Apteryx)
Patient Primary ID: ID number of the patient the AI request belongs to
Image ID: ID number associated with the image contained in the sent request (not the patient’s ID number). Same number as found when clicking an image in Apteryx and navigating to Info > Image ID.
Request Datetime: Time the request from Apteryx was sent to the AI vendor
-
Status: Displays the status of the request that was sent to the AI vendor:
New - Apteryx DICOM Server has received the image, but we have not sent a Request to the AI Vendor
Pending - Request accepted by AI Vendor
Error - The AI Vendor rejected our Request
Processed - Results Received from AI Vendor
Expired - We spent more than 20 minutes "Pending" so we gave up waiting for a response
Response Datetime: Time we received a response (results) from the AI vendor
Response Time (sec): Displays amount of time elapsed in seconds between sending a request, and receiving a response
For details regarding the logical workflow of how AI Vendor integrations work, please refer to the Extra Info section at the bottom of this page as well as the AI Feature article.
Filter by Patient Primary ID
This function allows you to filter the AI Usage Dash by a specific patient ID. This can be useful if needing to determine the status of an AI request for a specific patient.
Tech tips
A request that shows “processed” indicates the analysis request was processed and returned to the user’s Apteryx site, indicating AI readings should be readable to the user. “Processed” requests are completed requests.
If a user is reporting AI results are not appearing on their images after requesting analysis, this dash can be referenced to determine the issue. For example, if a large number of their requests are stuck on “pending” this indicates the request was sent to and accepted by the vendor, but we have not received a response back from them, indicating an issue that may be on the vendors side as we are successfully sending requests, but not receiving responses back.
If a user is reporting a delay in AI results appearing after requesting analysis, check the Usage dash for long response times. If long response times are shown on most/all requests, this would indicate we’re sending the request to the vendor successfully, but there is a delay in us receiving a response from them.
Extra Info
The process of requesting/receiving data to/from the AI vendor is an async process- we don't actually send the image to them. We send a tiny JSON request to the vendor, who accepts it and then separately downloads the image from us.
What we send in the original request is:
RequestID
A URL that they can use to download the image
A URL that they can use to download the patientInfo
A URL that they can use to send us back the completed result