Cultural adaptation and validation of the scleroderma health assessment questionnaire into Arabic language

Abstract

Background

Systemic sclerosis is an autoimmune multisystem disorder which affects the patients’ physical and psychological functioning. Scleroderma health assessment questionnaire used to measure physical disability in systemic sclerosis patients. It consists of Health Assessment Questionnaire Disability Index plus five visual analogue scores related to systemic sclerosis symptoms. There is no Arabic questionnaire specifically measuring physical disability in Arabic systemic sclerosis patients; therefore, this study aimed to translate the scleroderma health assessment questionnaire, culturally adapt it, and test its reliability and validity.

Method

The scleroderma health assessment questionnaire was translated into Arabic according to translation and cross-cultural adaptation guidelines. Convergent validity is measured by correlation of scleroderma health assessment questionnaire scores for 56 patients with short-form health survey scores, while discriminate validity is tested by stratifying clinical manifestations of patients and disease subtypes. Reliability measured by the intraclass correlation coefficient by interviewing patients twice 14 days apart.

Results

There was a strong correlation between the short-form health survey scores: physical component score and Health Assessment Questionnaire Disability Index and scleroderma health assessment questionnaire global scores (r =  − 0.659**, − 0.727**), while a moderate correlation between the short-form health survey scores physical component score, and scleroderma health assessment questionnaire, visual analogue scores, and all scleroderma health assessment questionnaire visual analogue score subtypes except for Raynaud’s and digital ulcer, was found (r =  − 0.495**, − 0.458*, − 0.495**, − 0.403*). The mental component score of the short-form health survey scores was moderately correlated with Health Assessment Questionnaire Disability Index and scleroderma health assessment questionnaire global scores (r =  − 0.507**, − 0.51**), while it was mildly correlated with scleroderma health assessment questionnaire visual analogue score and only its subtype overall severity score (r =  − 0.398*, − 0.375*). Also, statistically significant association is between diffuse disease type and digestive visual analogue score (p = 0.001). The Arabic edition of scleroderma health assessment questionnaire has a Cronbach’s alpha of 0.845.

Conclusion

The translated Arabic version is a valid and reliable questionnaire to assess Egyptian systemic sclerosis patients’ functional disability.

Introduction

Systemic sclerosis (SSc) is an autoimmune disease of unknown etiology with multiorgan affection and heterogeneous clinical picture [1].

SSc causes an increased mortality and morbidity, depressive symptoms, and disability [2].

Fries et al. [3] developed the Health Assessment Questionnaire Disability Index (HAQ-DI) which is used for assessing functional disability in rheumatic diseases, but it is not sufficient for measuring the specific organ affection in SSc. Also, Elattar et al. [4] translated the mouth handicap in systemic sclerosis questionnaire into Arabic, but it measures only one aspect of the disease-specific functional disability. Steen and Medsger [5] developed five additional scales to the HAQ-DI to create the scleroderma health assessment questionnaire (SHAQ); they combine the HAQ-DI with five visual analogue scales (VAS) related with SSc symptoms (SHAQ VAS), so it measures all aspects of systemic sclerosis functional disability.

S-HAQ has proved to be valid and reliable [5]; also, it was translated and culturally adapted into multiple languages, e.g., French [6], Italian [7], and Japanese [8], but not translated into Arabic yet, so this study aimed to translate and adapt this SHAQ version in Arabic Egyptian culture and test its validity and reliability.

Method

Patients

We included fifty-six patients diagnosed with SSc fulfilling the American College of Rheumatology/European League Against Rheumatism (ACR/EULAR) classification criteria in this study [9]. We excluded patients with significant cognitive impairment as exclusion criteria. This work was accepted in the research protocol number (ZU-IRB no.10118) by the local Institutional Review Board (……..University, ……). Consent was taken from each patient.

Clinical assessment

Full history and clinical examination were done. We assessed the degree of skin tightness by the modified Rodnan’s score [10]. Patients were classified into either diffuse or limited cutaneous SSC according to LeRoy’s classification [11].

Gastrointestinal affection is manifested by dysphagia, gastroesophageal reflux disease, malabsorption, and anal incontinence. Lung involvement was assessed by ground-glass opacities and honey combing on high-resolution computed tomography and restrictive pattern in pulmonary function test, while cardiac affection is manifested by the presence of pericarditis, valve lesion, and/or myocardial dysfunction by echocardiography. Pulmonary artery hypertension was diagnosed by systolic pressure of pulmonary artery more than 45 mmHg measured on echocardiography. Musculoskeletal affection was manifested by arthralgia. Vascular affection presented by Raynaud’s, digital pitting scars, ulceration, and/or gangrene and also telangiectasia and calcinosis were detected by examination.

Definitions of the questionnaires

• ➢ SHAQ: It consists of the standard HAQ-DI questionnaire with its eight domains (dressing and grooming, arising, eating, walking, hygiene, reach, grip, and activities) with total 20 item plus five questions “In the past week, how much have your—Raynaud’s phenomenon, digital ulcers, gastrointestinal symptoms, lung symptoms, and overall scleroderma symptoms—interfered with your activity?”

• ➢ HAQ-DI: The response for each question is either without any difficulty (0), with some difficulty (1), with much difficulty (2), and unable to do (3). The score of each domain is the highest score for any question in that domain unless aids or devices are required; the score then is raised to 2. The total HAQ-DI score is calculated by taking the average of the 8 domains scores which range from 0 to 3; higher score means more disability [12].

• ➢ SHAQ VAS: The patient marked on a VAS with a length of 15 cm. At one end of the line is “does not interfere” 0, and the other end is “very severe limitations” [13]. The final VAS score is calculated by multiplying the value by 0.2. The score ranges between 0 and 3 (minimum and maximum) limitation. Each VAS score value is reported separately [14]. The SHAQ-global score was calculated by this equation [8 HAQ-DI domains + 5 SSc VAS)/13] [14].

• ➢ Short-form health survey score questionnaire 36 (SF-36): We used the validated Arabic version. It is a self-applied questionnaire used to measure health-related quality of life, consists of two main components physical and mental component scores (PCS, MCS, respectively), and under them, there are eight main scales with 36 questions: general health, physical functioning, physical role, pain, vitality, social functioning, emotional problems, and mental health. Score of each scale ranges from 0 to 100. The higher scores indicate better health-related quality of life [15].

Translation-adaptation

According to guidelines of cultural adaptation of self-administrated questionnaires, we translated the SHAQ [13]. Firstly, we translate the original version of SHAQ from English into Arabic using two translators; one was blind about the use of the questionnaire, and the other was informed. Then, we compare the two translated versions to conclude a common translation. We translated back the questionnaire into English by another two blind translators; their native language is English. Then, we discuss all the translations to correct any conflicts. Afterwards, we compare the original questionnaire with the back translations, and a final Arabic version was formed. It was clear and understandable. We perform a cognitive evaluation of the translated Arabic version; through 28 patients, we ask them if the meaning of each question is reaching them or not. We rephrased the conflicting questions to coincide with our culture while preserving the same meaning.

We asked the patients to fill in the Arabic-translated SHAQ and SF-36 questionnaires while they are in their follow-up visit. They complete it in almost 20 min. After 2 weeks, all patients refilled the SHAQ questionnaire again.

Validation of the psychometric properties of the Arabic SHAQ

Each patient filled in the HAQ-DI and the five SHAQ VAS questions and in addition to the SF-36v2 questionnaire. The patients were supervised by a trainee who supplied a good explanation about the questionnaires.

Convergent validity

We assessed the convergent validity by finding the correlation between the HAQ-DI and SHAQ VAS scores with SF-36v2 health-related quality-of-life domains. If there is statistically significant correlation between them, then a good convergent validity of the questionnaire is present.

Discriminant validity

We compare the values of HAQ-DI, SHAQ VAS, and SF-36v2 physical item scores between patients with and without SSc-related organ affection and both disease subtypes (diffuse and limited). If there is statistically significant association between them, then a good discriminant validity of the questionnaire is present.

Test–retest reliability of SHAQ

We assessed it by asking the patients to fulfill SHAQ at baseline and 2 weeks later by the same physician. We use intraclass correlation coefficient (ICC) to assess the agreement between repeated interviews, with ICC equal to or more than 0.7 indicating a high degree of agreement [6]; we assessed the internal consistency of the SHAQ by the Cronbach’s alpha coefficient.

Statistical analysis

All data were collected and analyzed using the Statistical Package for Social Sciences (SPSS) version 25. Quantitative data were presented by mean ± SD, while qualitative data were presented by number and percentage. Qualitative variables were compared using chi-square and Fisher’s exact test; while quantitative nonparametric data were compared using “Mann–Whitney test.” The Spearman’s rank correlation coefficient was used to test the correlation between parametric data. Correlations less than or equal to 0.29 were considered to be low, between 0.30 and 0.49 as moderate, and greater than or equal to 0.50 as high. All tests were two-sided differences and were considered statistically significant when P-values were < 0.05.

Results

Fifty-six patients completed the SHAQ and SF-36 v2. The mean patient’s age was 41.4 ± 11.57 years, and 85.7% of them were females, with mean disease duration 5.5 ± 5.4 years. A total of 46.4% of studied patients had limited type of diseases; only one patient had family history of SSc. All SSc patients had Raynaud’s phenomenon and skin thickness. The highest percent of them had puffiness (89.3%), and gastrointestinal manifestation (85.7%) with dysphagia was the highest manifestation (67.85%), pitting scars, calcinosis, arthritis, cardiac manifestation, respiratory manifestation in the form of cough, and exertional dyspnea with percentage of 82.1%, 17.9%, 78.6%, 67.9%, and 60.7%, respectively, and the least manifestation was friction rub (3.6%) among studied patients. The median range of the number of organ involvement is 4; the mean of modified Rodnan score is 18.43 ± 6.5.

The mean of social functioning of studied patients was 42.4 followed by mental health which was 37, and then physical functioning was 34.28. All patients had limitation with regard to physical and emotional health. The mean of the HAQ-DI score, SHAQ VAS score, and SHAQ global score was 1.56 ± 0.69, 0.99 ± 04:00, and 1.34 ± 0.54, respectively, among studied patients (Fig. 1A, B).

Fig. 1

A Mean of functional disability via SHAQ. B Mean of VAS types of studied patients

Convergent validity

There was statistically significant negative correlation between HAQ-DI score and all health-related quality-of-life domains SF-36 (p < 0.05) except mental health domain (p = 0.627). Also, there was statistically significant negative correlation between SHAQ-VAS score and all health-related quality-of-life domains SF-36 (p < 0.05) except mental health domain (p = 0.563). Moreover, global SHAQ showed statistically significant negative correlation and all health-related quality-of-life domains SF-36 (p < 0.05) except mental health domain (p = 0.433) (Table 1).

Table 1 Assessment of convergent validity by correlation between the HAQ-DI, SHAQ VAS, and SHAQ global scores with health-related quality-of-life domains SF-36 (n = 56)

There was statistically significant negative correlation between overall severity VAS score and digestive VAS score and all health-related quality-of-life domains SF-36 (p < 0.05) except mental health domain (p = 0.14, 0.89). Moreover, pulmonary VAS showed statistically significant negative correlation and all health-related quality of life domains SF-36 (p < 0.05) except general health (p = 0.35), vitality (p = 0.051), mental health (p = 0.91), and social functioning (p = 0.17); Raynaud’s VAS was statistically significant negative correlation only with physical component summary score (p = 0.006) and physical functioning (p = 0.008) (Table 2).

Table 2 Assessment of convergent validity by correlation between the SHAQ VAS scores with health-related quality-of-life domains SF-36 (n = 56)

Finally, there was statistically significant positive correlation between SHAQ global with HAQ-DI scores of studied patients.

Discriminant validity

There was statistically significant positive correlation between number of organs affected of studied patients and all HAQ-DI domains except activities (p = 0.385). Also, there is statistically significant positive correlation between number of organs affected and pain VAS and digestive VAS (p = 0.0001). Moreover, there was statistically significant positive correlation between number organs affected and total score of HAQ-DI, SHAQ VAS, and SHAQ global (p = 0.0001) (Table 3).

Table 3 Assessment of discriminant validity by correlation between number of organs involved with HAQ-DI, SHAQ VAS and SHAQ global scores (n = 56)

There was statistically significant relation between disease type and digestive VAS (p = 0.001), which was high among diffuse disease type (Table 4).

Table 4 Comparison between diffuse type and limited type regarding the functional disability via SHAQ for studied patients (n = 56)

Reliability

The inter-rater reliability of digestive VAS, pulmonary VAS, Raynaud’s VAS, digital ulcer VAS, and SHAQ VAS was good reliable measures, while pain VAS, HAQ-DI, and SHAQ global was excellent measurements to assess patients. Cronbach’s alpha that used to measure the internal consistency (reliability of used tool) was 0.875 for HAQ-DI and 0.845 for HAQ global, while HAQ VAS was 0.676 (Table 5).

Table 5 Assessment of intra-rater and inter-rater reliability of HAQ-DI, SHAQ VAS, and SHAQ global

Discussion

SSc is manifested by multiorgan affection which causes physical disability and limiting their social, work, and daily living activities. One of the aims of medical care is to decrease disability and to improve the functional ability [16].

SHAQ used to measure physical disability in systemic sclerosis patients and has proved to be valid and reliable [5].

The objective of our study was to translate SHAQ into Arabic language and then perform an adaptation and validation of this Arabic version.

There was a strong correlation between the SF-36v2 PCS and HAQ-DI, and SHAQ global scores, while a moderate correlation between the SF-36v2 PCS and SHAQ VAS score, and all SHAQ VAS subtypes except for Raynaud’s and digital ulcer were found. The PCS of SF-36v2 was moderately correlated with SHAQ DI and SHAQ global scores, while it was mildly correlated with SHAQ VAS score and only its subtype overall severity score.

Similarly, Karadag et al. [14] found a moderate correlation when compared Turkish SHAQ to the SF-36v2. There was a moderate convergent validity between the SF-36v2 PCS and SHAQ global, Raynaud’s phenomenon, digital ulcer, and pulmonary VAS scores.

Also, Rocha et al. [17] found that the Brazilian SHAQ had a high convergent validity with the SF-36 physical items, particularly the overall disease severity VAS. Moreover, moderate convergent validity between the SF-36 MCS and both digestive VAS and overall disease severity VAS was also demonstrated.

In agreement with us, Georges et al. [18] found that the HAQ-DI and the French SHAQ scores showed higher convergent validity with SF-36 physical-related scores than with mental-related domains.

Also, Xinyi et al. [19] found that the English SHAQ demonstrated moderate to strong correlation when compared to the SF-36 v2. SHAQ also had a strong correlation with SF-36v2 PCS compared to MCS. The SHAQ VASs also had moderate to strong convergent validity with SF-36v2 PCS.

The discriminant validity in our study was not a strong difference between dcSSc and lcSSc except for the digestive VAS which was significantly higher in patients with the diffuse subtype compared to the patients with limited subtype, but with number of organs affected, we found significant positive correlation between number of organs affected of studied patients and HAQ-DI, SHAQ VAS, overall severity VAS and digestive VAS, and SHAQ global scores.

In agreement with us, Rocha et al. [17] and Georges et al. [18] have not found a differences between lcSSc and dcSSc by SHAQ.

Karadag et al. [14] also have not found a strong difference between dcSSc and lcSSc, except that the digital ulcer VAS was significantly higher in patients with the diffuse subtype compared to the patients with limited subtype.

Karadag et al. [14] showed satisfactory correlations between HAQ-DI, SHAQ-global, digital ulcer VAS, and pulmonary VAS and higher number of organs affected, while Rocha et al. [17] showed that there was statistically positive significant high correlation between number of organs involved with HAQ-DI, digestive VAS, and over all disease severity VAS and pulmonary VAS.

Moreover, we examined the test–retest reliability of the HAQ-DI and SHAQ global and demonstrated excellent reproducibility and found that they were excellent measurements to assess the patients, while SHAQ VAS is a good measurement to assess the patients.

Our results coincided with Karadag et al. [14] who examined the test–retest reliability of the HAQ-DI, and all of the SHAQ scores had demonstrated good reproducibility.

Limitations

Lastly, the present study has some limitations that require consideration including relatively small sample size and monocentric design.

Conclusion

We culturally adapted a valid and reliable Arabic version of self-administered scleroderma health assessment questionnaire (SHAQ) to be used for measuring functional disability in Arabic-speaking Egyptian SSc patient’s studies.