Developer Name: ChartLogic, a Division of Medsphere Systems Corporation
Plan Report ID Number: [20211015cha]
Product Name(s):
Version Number(s):
Product List (CHPL) ID(s):
ONC-ACB Certification ID:
Developer Real World Testing Plan Page URL:
Developer Real World Testing Results Report Page URL:
No changes
Not applicable
To demonstrate the features used in the interoperability measures, we obtained data from system logs that we could review and perform data analysis against. We were able to review success and failure rates of certain interoperability functions to ensure the feature was functioning and to be able to work with our clients to increase adoption where suitable.
In cases where we gathered the data and the data indicated that no utilization was actually being performed in the real world, we reverted to an internal test environment to conduct testing against the feature along with the standards to ensure the feature was functioning as designed and certified.
For each of the methods that we used, whether collecting real world data or reverting to an internal test environment, the results shared in this report reflect the real world success rate of utilization of interoperability features or confirmation that the feature is working as intended.
No, none of my products include these voluntary standards.
Standard (and version) | This product utilizes all standards associated with the 2015 certification method |
Ambulatory care settings were used to obtain the results for this report.
Electronic exchange of information for Care Coordination and Patient Engagement
Measurement /Metric | Associated Criterion(a) | Relied Upon Software (if applicable) | Outcomes |
Measure 1.1 Provider exchange (Transmission methods and thresholds ) | 170.315(b)(1) Transitions of Care, 170.315(b)(2) Clinical Information Reconciliation and Incorporation, 170.315e(1) View, download, and transmit to 3rd party, Data Export and 170.315(h)(1) Direct Project, | Surescripts Clinical Direct Messaging | Data from system logs were used to retrieve data representative of the transmission methods used for exchange of health information. Overall, there were 128 transmissions logged, all of which were transmitted encrypted. This results in 100% of utilization was using the encrypted method. Of those128 transmissions, 82 were successful, resulting in a 64% success rate on first attempt. |
Measure 1.2 Patient exchange (Download and Transmit) | 170.315(b)(1) Transitions of Care, 170.315(b)(2) Clinical Information Reconciliation and Incorporation, 170.315e(1) View, download, and transmit to 3rd party, Data Export and 170.315 (h)(1) Direct Project, | Surescripts Clinical Direct Messaging | System logs were used to retrieve data representative of the functions of downloaded and transmitted. Overall, there were 125 transmission attempts, with 80 attempts being successful. This results with a 36% error rate mostly attributed to invalid recipient addresses. |
Measure 2 Data Export | 170.315(b)(6) Data Export | Internet Browser; Chrome, Firefox, Safari, or Edge | System logs were used to retrieve data representative of when the export function was utilized either for individual exports or performed in batch. Overall, there were 64,696 exports completed with 64,694 exports completing successfully, resulting in a 99.9% success rate. |
Measurement /Metric | Associated Criterion(a) | Relied Upon Software (if applicable) | Outcomes |
Measure 3 Transmission of messages to outside entities | 170.315(f)(1) Transmission to immunization registries, 170.315(f)(2) Transmission to public health agencies – Syndromic surveillance | Notepad ++ | System logs were used to retrieve data representative of the HL7 messages transmitted. Overall, there were 21 messages sent with 19 of those messages being successful, resulting in a 91% success rate. This does align with our anticipated error rates of less than 10% due to network related issues. |
Measure 4.2 Health care surveys | 170.315(f)(7) Transmission to public health agencies – health care surveys | Not applicable | Upon reviewing system logs it was found that no clients were using the function of health care surveys. To adhere to our plan, we reverted to an internal test environment to ensure the function was still working as designed. Overall, this resulted with a 100% success rate. |
Measurement /Metric | Associated Criterion(a) | Relied Upon Software (if applicable) | Outcomes |
Measure 4 API Requests | 170.315(g)(7) Application Access – Patient Selection, 170.315(g)(8) Application Access – Data Category Request, 170.315(g)(9) Application Access-All Data Request | Not Applicable | Upon reviewing system logs it was found that no clients were using these functions. To adhere to our plan, we reverted to an internal test environment to recreate the requests for patient selection, data category and all data. Using the test environment, all requests were performed and successful resulting in a 100% success rate. |
Key Milestone | Care Setting | Date/Timeframe |
Deployment of code allowing ability to capture additional information in system logs. | Ambulatory | February 2022 |
Collection and review of data | Ambulatory | Quarterly |
Compiled all data in aggregate analysis | Ambulatory | December 2022/January 2023 |
Create and submit aggregate results report | Ambulatory | January/February 2023 |
This Real World Testing Results Report is complete with all required elements, including measures that address all certification criteria and care settings. All information in this report is up to date and fully addresses the health IT developer’s Real World Testing requirements.
Authorized Representative Name: | Nicki Anderson, Director, Compliance |
Authorized Representative Email: | nicki.anderson@medsphere.com |
Authorized Representative Phone: | 760.979.6531 |
Authorized Representative Signature: | Nicki Anderson |
Date: | January 30, 2023 |
Plan Report ID Number: [RWTP-0000232]
Product Name(s): ChartLogic Patient Portal
Version Number(s): 9
Certified Health IT Product List (CHPL) Product Number(s): 15.04.04.1223.Char.09.00.1.170814
Developer Real World Testing Plan Page URL: https://www.medsphere.com/certifications/RealWorldTesting/ChartLogic/
Developer Real World Testing Results Report Page URL: https://www.medsphere.com/certifications/RealWorldTesting/ChartLogic/
No changes occurred to the original plan.
Not Applicable
Using functions of the ChartLogic Patient Portal, we planned to test the functionality of 170.315 (e)(1) View, Download, and Transmit. This criterion involves the patient facing view of the portal, our testing included reviewing data in system logs to determine the methods of transmission and transmission rates utilized by patients.
No, none of my products include these voluntary standards.
Standard (and version) | This product utilizes all standards associated with the 2015 certification method |
Only Ambulatory care settings were used to complete the testing in obtaining these results.
Measurement /Metric | Associated Criterion(a) | Relied Upon Software (if applicable) | Outcomes |
Care Coordination Thresholds and Mechanisms | 170.315(e)(1) View, Download and Transmit | Surescripts Clinical Direct Messaging | System logs were used to retrieve data representative of the mechanisms that were used for transmission by the patient. These mechanisms include either encrypted or unencrypted message types. Overall, the data showed that there were 125 attempts of transmission and all 125 were transmitted using the encrypted method. Of the 125 attempts, 80 of those were successful resulting in a 36% error rate which most notably was indicative of invalid recipient addresses. |
Key Milestone | Care Setting | Date/Timeframe |
Deployment of code to allow for capture of additional information in system logs | Ambulatory | February 2022 |
Collection of data | Ambulatory | Quarterly |
Final collection, review of data | Ambulatory | December 2022 |
Generation of aggregate report and submission | Ambulatory | January/February 2023 |
This Real World Testing Results Report is complete with all required elements, including measures that address all certification criteria and care settings. All information in this report is up to date and fully addresses the health IT developer’s Real World Testing requirements.
Authorized Representative Name: | Nicki Anderson, Director, Compliance |
Authorized Representative Email: | nicki.anderson@medsphere.com |
Authorized Representative Phone: | 760.979.6531 |
Authorized Representative Signature: | Nicki Anderson |
Date: | January 27, 2023 |