5.2 - Reliability & Validity of Diagnosis
The purpose and importance of diagnosis
Diagnosis in psychology involves identifying a mental health disorder based on a person's symptoms and behaviours. This process uses classification systems, such as the DSM (Diagnostic and Statistical Manual of Mental Disorders), which list specific criteria for different disorders. By providing a label for a set of symptoms, diagnosis helps professionals understand what to expect and plan appropriate treatments.
Diagnosis also ensures consistency among professionals. For example, systems like DSM aim to be objective by focusing on agreed sets of symptoms and behaviours, reducing personal biases. This means clinicians from different backgrounds can use the same system to reach similar conclusions, making communication more effective.
Key benefits of diagnosis
- Informs treatment - A diagnosis like paranoid schizophrenia guides psychologists on expected symptoms and suitable interventions.
- Promotes comparability - Professionals can share information reliably, as the system is based on standardised criteria rather than individual opinions.
- Aids individuals - It can provide access to support and treatments that might otherwise be unavailable.
Reliability of diagnostic systems
Reliability refers to the consistency of a diagnosis, meaning different clinicians should agree on the same diagnosis for the same individual when using the same classification system. Without reliability, a system cannot be trusted for communication or treatment planning. This consistency is tested by checking if multiple professionals reach the same conclusion from the same information.
Challenges to reliability
- Inter-rater differences - Clinicians may interpret symptoms differently, leading to inconsistent diagnoses.
- Cultural variations - Diagnoses can vary between countries due to different cultural understandings of mental health.
- Patient variability - Individuals might report symptoms differently to various professionals, affecting outcomes.
Research on reliability issues
Beck et al. (1962):
- Method - Two psychiatrists independently diagnosed 153 patients.
- Results - They agreed only 54% of the time, which was close to chance level.
- Conclusions - This suggests high unreliability in diagnosis, as agreement was not much better than random guessing.
Zigler and Phillips (1961):
- Method - Analysed agreement rates among diagnosticians across multiple cases.
- Results - Agreement ranged from 54% to 84%.
- Conclusions - While some consistency existed, the wide range indicates reliability problems in practice.
US-UK diagnostic project - Cooper et al. (1972):
- Method - American and British psychiatrists viewed the same videotaped patient interviews and provided diagnoses.
- Results - New York psychiatrists diagnosed schizophrenia twice as often as London psychiatrists, who favoured depression twice as often.
- Conclusions - Cultural biases and different classification systems lead to unreliable diagnoses across regions.
Lipton and Simon (1985):
- Method - Re-diagnosed 131 randomly selected psychiatric hospital patients and compared with original diagnoses.
- Results - Of 89 originally diagnosed with schizophrenia, only 16 retained this diagnosis on re-evaluation.
- Conclusions - This demonstrates significant unreliability, as re-diagnoses often differed markedly from originals.
Improving reliability
Recent efforts include standardised interview schedules, which provide structured questions to ensure consistent information gathering. However, challenges remain because patients may vary the details or emphasis of symptoms they report. For instance, someone might highlight lack of motivation to a GP but focus on sleep issues to a psychiatrist, leading to different diagnoses.
Validity of diagnostic systems
Validity measures whether a diagnosis accurately reflects the disorder it claims to identify. A valid diagnosis should correctly capture the nature of the condition, predict outcomes, and guide effective treatments. Unlike physical illnesses, where objective tests like scans are possible, psychological disorders rely on observed behaviours and self-reports, making validity harder to establish.
Types of validity in diagnosis
- Symptom consistency - People with the same diagnosis should show similar symptoms; if not, validity is low.
- Treatment response - Individuals with the same diagnosis should respond similarly to treatments; varied responses suggest low validity.
- Predictive validity - The diagnosis should forecast the course of the disorder and suitable interventions.
Research on validity issues
Banister et al. (1964):
- Method - Analysed 1,000 cases to check relationships between diagnoses and prescribed treatments.
- Results - No clear connection was found between diagnosis and treatment choices.
- Conclusions - This indicates low predictive validity, as diagnoses did not reliably guide or predict treatment paths.
Challenges to achieving validity
Validity is tougher for psychological disorders than physical ones because there are no direct observable signs, like a broken bone on an X-ray. Instead, diagnoses depend on subjective interpretations, which can lead to inaccuracies. If symptoms do not match across diagnosed individuals or treatments fail to work consistently, the entire system's usefulness is questioned.
Issues with diagnostic labelling and stigmatisation
While diagnosis can provide access to treatment, it also carries risks, particularly through labelling. Labelling theory suggests that assigning a diagnostic category can influence how others perceive and treat the individual, sometimes leading to negative outcomes.
Effects of labelling
- Stigmatisation - Labels like 'schizophrenia' can lead to discrimination, as they carry negative connotations and are often misused as insults (e.g., calling someone a 'schizo').
- Loss of individuality - People may be seen as the label rather than as unique individuals, e.g., becoming 'a schizophrenic' instead of 'a person with schizophrenia'.
- Self-fulfilling prophecy - Once labelled, individuals might be expected to behave in certain ways, and they may internalise this, leading to behaviours that fulfil the prophecy.
Broader implications
Labels are 'sticky' and hard to remove, affecting employment, relationships, and self-perception. Critics argue that focusing on the label can overshadow the person's full humanity, potentially worsening their condition or social isolation. This highlights the need for careful, compassionate use of diagnostic systems.