2022 Real World Testing Results: ChartLogic

ChartLogic EHR

GENERAL INFORMATION

Developer Name: ChartLogic, a Division of Medsphere Systems Corporation

Plan Report ID Number: [20211015cha]

Product Name(s):  

  • ChartLogic EHR
  • ChartLogic EHR Classic

Version Number(s):

  • ChartLogic EHR v.1
  • ChartLogic EHR Classic v.9

Product List (CHPL) ID(s):

  • ChartLogic EHR v.1
  • ChartLogic EHR Classic v.9      

ONC-ACB Certification ID:

  • ChartLogic EHR – 15.05.05.1223.CEHR.02.01.1.230103 (current)
  • ChartLogic EHR – 15.05.05.1223.CEHR.01.00.1.200131 (previous)
  • ChartLogic EHR Classic – 15.05.05.1223.CHRT.02.01.1.221222 (current)
  • ChartLogic EHR Classic – 15.05.05.1223.CHRT.01.00.1.180510 (previous)

Developer Real World Testing Plan Page URL:

Developer Real World Testing Results Report Page URL:

CHANGES TO ORIGINAL PLAN

No changes

WITHDRAWN PRODUCTS

Not applicable

SUMMARY OF TESTING METHODS AND KEY FINDINGS

To demonstrate the features used in the interoperability measures, we obtained data from system logs that we could review and perform data analysis against. We were able to review success and failure rates of certain interoperability functions to ensure the feature was functioning and to be able to work with our clients to increase adoption where suitable.


In cases where we gathered the data and the data indicated that no utilization was actually being performed in the real world, we reverted to an internal test environment to conduct testing against the feature along with the standards to ensure the feature was functioning as designed and certified.


For each of the methods that we used, whether collecting real world data or reverting to an internal test environment, the results shared in this report reflect the real world success rate of utilization of interoperability features or confirmation that the feature is working as intended.

STANDARDS UPDATES (INCLUDING STANDARDS VERSION ADVANCEMENT PROCESS (SVAP) AND UNITED STATES CORE DATA FOR INTEROPERABILITY (USCDI))

No, none of my products include these voluntary standards.

Standard (and version)This product utilizes all standards associated with the 2015 certification method

Care Settings

Ambulatory care settings were used to obtain the results for this report.

Metrics and Outcomes

Electronic exchange of information for Care Coordination and Patient Engagement

Measurement /MetricAssociated Criterion(a)Relied Upon Software (if applicable)Outcomes
Measure 1.1 Provider exchange (Transmission methods and thresholds )170.315(b)(1) Transitions of Care, 170.315(b)(2) Clinical Information Reconciliation and Incorporation, 170.315e(1) View, download, and transmit to 3rd party, Data Export and 170.315(h)(1) Direct Project,Surescripts Clinical Direct MessagingData from system logs were used to retrieve data representative of the transmission methods used for exchange of health information. Overall, there were 128 transmissions logged, all of which were transmitted encrypted. This results in 100% of utilization was using the encrypted method. Of those128 transmissions, 82 were successful, resulting in a 64% success rate on first attempt.
Measure 1.2 Patient exchange (Download and Transmit)170.315(b)(1) Transitions of Care, 170.315(b)(2) Clinical Information Reconciliation and Incorporation, 170.315e(1) View, download, and transmit to 3rd party, Data Export and 170.315 (h)(1) Direct Project,Surescripts Clinical Direct MessagingSystem logs were used to retrieve data representative of the functions of downloaded and transmitted. Overall, there were 125 transmission attempts, with 80 attempts being successful. This results with a 36% error rate mostly attributed to invalid recipient addresses.
Measure 2 Data Export170.315(b)(6) Data ExportInternet Browser; Chrome, Firefox, Safari, or EdgeSystem logs were used to retrieve data representative of when the export function was utilized either for individual exports or performed in batch. Overall, there were 64,696 exports completed with 64,694 exports completing successfully, resulting in a 99.9% success rate.

Transmission of HL7 messages

Measurement /MetricAssociated Criterion(a)Relied Upon Software (if applicable)Outcomes
Measure 3 Transmission of messages to outside entities170.315(f)(1) Transmission to immunization registries,
170.315(f)(2) Transmission to public health agencies – Syndromic surveillance
Notepad ++System logs were used to retrieve data representative of the HL7 messages transmitted. Overall, there were 21 messages sent with 19 of those messages being successful, resulting in a 91% success rate. This does align with our anticipated error rates of less than 10% due to network related issues.
Measure 4.2 Health care surveys170.315(f)(7) Transmission to public health agencies – health care surveysNot applicableUpon reviewing system logs it was found that no clients were using the function of health care surveys. To adhere to our plan, we reverted to an internal test environment to ensure the function was still working as designed. Overall, this resulted with a 100% success rate.

API Requests

Measurement /MetricAssociated Criterion(a)Relied Upon Software (if applicable)Outcomes
Measure 4 API Requests170.315(g)(7) Application Access – Patient Selection,
170.315(g)(8) Application Access – Data Category Request,
170.315(g)(9) Application Access-All Data Request
Not ApplicableUpon reviewing system logs it was found that no clients were using these functions. To adhere to our plan, we reverted to an internal test environment to recreate the requests for patient selection, data category and all data. Using the test environment, all requests were performed and successful resulting in a 100% success rate.

KEY MILESTONES

Key MilestoneCare SettingDate/Timeframe
Deployment of code allowing ability to capture additional information in system logs.AmbulatoryFebruary 2022
Collection and review of dataAmbulatoryQuarterly
Compiled all data in aggregate analysisAmbulatoryDecember 2022/January 2023
Create and submit aggregate results reportAmbulatoryJanuary/February 2023

Acknowledgement Signature

This Real World Testing Results Report is complete with all required elements, including measures that address all certification criteria and care settings. All information in this report is up to date and fully addresses the health IT developer’s Real World Testing requirements.

Authorized Representative Name:Nicki Anderson, Director, Compliance
Authorized Representative Email:nicki.anderson@medsphere.com
Authorized Representative Phone:760.979.6531
Authorized Representative Signature:Nicki Anderson
Date:January 30, 2023

ChartLogic Patient Portal

General Information

Plan Report ID Number: [RWTP-0000232]

Product Name(s): ChartLogic Patient Portal

Version Number(s): 9

Certified Health IT Product List (CHPL) Product Number(s): 15.04.04.1223.Char.09.00.1.170814

Developer Real World Testing Plan Page URL: https://www.medsphere.com/certifications/RealWorldTesting/ChartLogic/

Developer Real World Testing Results Report Page URL: https://www.medsphere.com/certifications/RealWorldTesting/ChartLogic/

CHANGES TO ORIGINAL PLAN

No changes occurred to the original plan.

WITHDRAWN PRODUCTS

Not Applicable

SUMMARY OF TESTING METHODS AND KEY FINDINGS

Using functions of the ChartLogic Patient Portal, we planned to test the functionality of 170.315 (e)(1) View, Download, and Transmit. This criterion involves the patient facing view of the portal, our testing included reviewing data in system logs to determine the methods of transmission and transmission rates utilized by patients.

STANDARDS UPDATES (INCLUDING STANDARDS VERSION ADVANCEMENT PROCESS (SVAP) AND UNITED STATES CORE DATA FOR INTEROPERABILITY (USCDI))

No, none of my products include these voluntary standards.

Standard (and version)This product utilizes all standards associated with the 2015 certification method

Care Settings

Only Ambulatory care settings were used to complete the testing in obtaining these results.

Measurement /MetricAssociated Criterion(a)Relied Upon Software (if applicable)Outcomes
Care Coordination Thresholds and Mechanisms170.315(e)(1) View, Download and TransmitSurescripts Clinical Direct MessagingSystem logs were used to retrieve data representative of the mechanisms that were used for transmission by the patient. These mechanisms include either encrypted or unencrypted message types. Overall, the data showed that there were 125 attempts of transmission and all 125 were transmitted using the encrypted method.
Of the 125 attempts, 80 of those were successful resulting in a 36% error rate which most notably was indicative of invalid recipient addresses.
Key MilestoneCare SettingDate/Timeframe
Deployment of code to allow for capture of additional information in system logsAmbulatoryFebruary 2022
Collection of dataAmbulatoryQuarterly
Final collection, review of dataAmbulatoryDecember 2022
Generation of aggregate report and submissionAmbulatoryJanuary/February 2023

Acknowledgement Signature

This Real World Testing Results Report is complete with all required elements, including measures that address all certification criteria and care settings. All information in this report is up to date and fully addresses the health IT developer’s Real World Testing requirements.

Authorized Representative Name:Nicki Anderson, Director, Compliance
Authorized Representative Email:nicki.anderson@medsphere.com
Authorized Representative Phone:760.979.6531
Authorized Representative Signature:Nicki Anderson
Date:January 27, 2023