The new research, published in the Online Journal of Public Health Informatics, highlights key challenges around health data in England that are hindering research on the impact of remote consultations on health outcomes and makes recommendations to address this.

Evaluating the shift to remote consultations

The Covid-19 pandemic accelerated the adoption of remote consultations across all areas of healthcare in England, with a variety of video, telephone and online platforms being used for patient consultations, instead of face-to-face meetings. In many areas of healthcare, remote consultations are now offered routinely. With any major change like this, it is important to understand the impact on health services and care, and the experience for patients. 

The three London ARCs – ARC South London, ARC North Thames and ARC Northwest London, developed a service evaluation designed to do this. It aimed to address a range of evidence gaps to inform the adoption of remote consultation in care settings and identify gaps in data. 

The new viewpoint article draws on the researchers’ experience conducting this service evaluation, including their extensive experience in health data linkage, and review of the research evidence conducted as part of the evaluation. 

The NHS 10 Year Plan envisages a digitally enabled NHS. We highlight some of the significant barriers that need to be overcome to implement remote monitoring that works for clinicians and for patients. Failure to address these issues may lead to poor decision making due to poor-quality data. We therefore suggest ways forward

Professor Rosalind Raine, Professor of Applied Health Research at University College London and Director, NIHR ARC North Thames

Inconsistent data and system integration 

The researchers highlight challenges in the quality and linkage of electronic health record (EHR) infrastructures in NHS England, including inconsistencies in data documentation, interoperability issues and limitations in data linkage between primary and secondary care. Much patient information from remote consultations is recorded as unstructured ‘free text’ rather than structured data, making analysis for research and clinical audit more difficult.

Missing or inconsistently recorded information can result from time pressures, varying clinician recording practices, and differences between healthcare settings. While new data analysis techniques allow researchers to extract valuable insights from free text data, this remains limited by cross-system inconsistencies across electronic health record infrastructures and NHS trusts

Dr Mariana Pinto da Costa, senior author, and ARC South London researcher

In England, the multiple software platforms used for remote consultations across NHS trusts often lack integration with existing electronic health record systems, preventing effective data exchange between primary care, secondary care and community health services. 

Lack of standardised definitions

Different healthcare providers use varying definitions of ‘remote consultation’ - some include only telephone and video calls, while others incorporate emails or online patient portal contacts. This inconsistency makes it difficult to compare data across different services and settings.

Effective data linkage is essential to track patient journeys across primary and secondary care and assess the impact of remote consultations on their outcomes. The establishment of a new network of Secure Data Environments should improve access to NHS data through shared and secure working practices, including sharing methods and coding

Professor Robert Stewart, Professor of Psychiatric Epidemiology & Clinical Informatics, King’s College London and applied informatics lead at NIHR ARC South London

Consequences for evaluating remote consultations 

These data quality issues have significant consequences for healthcare evaluation and planning. Similar studies can yield conflicting results due to variations in data and recording practices. While the results are valid in each context, their variability limits the generalisability of research findings and hinders evidence-based decision making.

Particularly problematic are the impacts on understanding the experiences of vulnerable populations. Patients with dementia, recent migrants, those with language barriers and individuals in socially disadvantaged areas are often underrepresented in remote consultation research due to gaps in data collection. Without comprehensive data on these vulnerable populations, healthcare services risk implementing policies that fail to address their needs.

Inconsistent data also prevents long-term evaluations of remote consultations.

Recommendations to improve data quality 

The researchers provide important recommendations to enhance data quality for future evaluations, which are relevant to healthcare systems in England and internationally. They include:

  • Simplify data recording systems by automating platforms and software to avoid adding extra burden to clinicians when recording data
  • Standardise variables and service definitions across platforms to improve analytical processes and reliability of outputs
  • Collect qualitative evidence to understand barriers and facilitators affecting both patients and clinicians in the use and uptake of remote consultations
  • Conduct comparative mixed methods studies examining how different population groups with varying levels of social advantage across different areas engage with remote consultations over time
  • Establish long-term and cost-effectiveness evaluations to explore real-world impact and develop guidance for the future positioning of remote consultations.

Our research highlights the urgent need of improving data quality to better understand the variations in implementation, uptake and impact of the introduction of remote consultations as they became embedded following the COVID-19 pandemic. Addressing issues related to data standardisation, completeness and linkage will enable more reliable evaluations and support evidence-based decision-making

Thomas Beaney, Clinical Researcher, The George Institute for Global Health, Imperial College London and NIHR ARC Northwest London