Original Article

Can pre-treatment inflammatory biomarker levels predict the response of tocilizumab therapy in COVID-19 patients?

10.4274/gulhane.galenos.2023.04834

  • Mehmet Nur Kaya
  • Duygu Tecer
  • Muhammet Çınar
  • Fahrettin Bıçakcı
  • Emre Tekgöz
  • Seda Çolak
  • Sedat Yılmaz

Received Date: 17.11.2022 Accepted Date: 14.04.2023 Gulhane Med J 2023;65(4):145-151

Aims:

The results of randomized clinical trials evaluating the effects of tocilizumab in patients with patients are inconsistent. We aimed to investigate the reliability of pre-treatment levels of prognostic nutritional index (PNI), C-reactive protein (CRP)/albumin ratio (CAR), systemic immune-inflammatory index (SII), interleukin-6 (IL-6), and lactate dehydrogenase (LDH) as treatment response biomarkers in hospitalized coronavirus disease-2019 (COVID-19) patients who were administered tocilizumab.

Methods:

Adult patients hospitalized for COVID-19 confirmed by severe acute respiratory syndrome-coronavirus-2 polymerase chain reaction and administered tocilizumab because of rapid clinical worsening despite receiving standard care were retrospectively included. Patients who received steroids, anakinra, or IVIG before tocilizumab and had missing data were excluded. Treatment effectiveness was evaluated with the improvement in the clinical status on an eight-category ordinal scale at 28 days of tocilizumab administration.

Results:

One hundred and thirty-three COVID-19 patients with a mean age of 62.64±13.66 years and consisting of 93 (69.9%) males were included. At 28 days of tocilizumab administration, 99 (74.4%) patients improved. Improved patients after tocilizumab treatment had significantly lower IL-6, LDH, SII, CAR, and higher PNI. To predict the effectiveness of tocilizumab, IL-6 had the highest area under the curve (AUC) value (AUC=0.782), followed by LDH (AUC=0.761), PNI (AUC=0.696), SII (AUC=0.671), CAR (AUC=0.682), and CRP (AUC=0.643). The cut-off level was 143.12 pg/mL for IL-6 (sensitivity=84.85%, specificity=64.71%), 460U/L for LDH (sensitivity=71.72%, specificity=73.75%), 31.35 for PNI (sensitivity=79.80%, specificity=55.88%), 3895.92 for SII (sensitivity=90.91%, specificity=47.06%), and 61.15 for CAR (sensitivity=67.68%, specificity=61.76%).

Conclusions:

In COVID-19 patients with clinically worsening disease, the administration of tocilizumab in the early stage of the hyperinflammatory state may improve the prognosis. Pre-treatment inflammatory biomarker levels may predict tocilizumab response.

Keywords: COVID-19, tocilizumab, prognostic nutritional index, C-reactive protein/albumin ratio, systemic immune-inflammatory index

Introduction

Severe acute respiratory syndrome-coronavirus-2 (SARS-CoV-2) infection may cause various clinical manifestations ranging from asymptomatic to multisystem life-threatening manifestations (1). Although most patients experience only mild to moderate symptoms, a subgroup of patients may progress to severe and critical disease, including Acute respiratory distress syndrome (ARDS), multi-organ failure, and death. Although the pathogenesis of coronavirus disease-2019 (COVID-19) is considered to result from a complex interplay of multiple pathophysiological mechanisms, such as direct viral effect, renin–angiotensin–aldosterone system imbalance, dysregulated immune response, and coagulopathy, an overproduction of pro-inflammatory cytokines, described as cytokine storm, is considered as a major reason for disease progression and death (2,3).

The pleiotropic cytokine interleukin-6 (IL-6) plays a pivotal role in the pathogenesis of COVID-19, and circulating levels of IL-6 are closely associated with clinical outcomes (4,5). Therefore, tocilizumab, an inhibitor of IL-6 receptors, was considered an attractive therapeutic option. However, the results of randomized clinical trials that evaluated the effects of tocilizumab in patients with COVID-19 are inconsistent because of the differences in trial design, initial disease severity used for the inclusion or exclusion, timing of tocilizumab administration, use of co-interventions, and outcome measurements (6).

The prognostic nutritional index (PNI), C-reactive protein (CRP)/albumin ratio (CAR), and systemic immune-inflammatory index (SII), which are novel parameters for measuring the degree of inflammation, have been reported as valuable biomarkers for discriminating disease severity and predicting mortality in COVID-19 (7-15).

As tocilizumab treatment may be beneficial in some SARS-CoV-2-infected patient populations, the ideal patient group and optimal timing for tocilizumab administration are still unknown. Thus, determining the patient populations likely to benefit from tocilizumab is important. In this study, we evaluated the reliability of pre-treatment levels of PNI, CAR, SII, IL-6, and lactate dehydrogenase (LDH) as treatment response biomarkers in hospitalized COVID-19 patients who were administered tocilizumab.


Methods

Study design and participants

This retrospective study was conducted at the University of Health Sciences Türkiye, Gülhane Training and Research Hospital, Ankara, Türkiye. The study protocol was first registered in the data of the Türkiye Republic Ministry of Health Scientific Research Committee and then approved by the Committee on the Human Research Ethics of the University of Health Sciences Türkiye, Gülhane Faculty of Medicine (date: 26.05.2021, number: 2021/35). The study was conducted in accordance with the Declaration of Helsinki. Between May 1 and September 1, 2020, consecutive SARS-CoV-2-infected patients who consulted the rheumatology department because of rapid clinical worsening were evaluated for inclusion. Electronic medical records of the patients were used to collect data.

The inclusion criteria were as follows: (1) age ≥18 years, (2) positive nasopharyngeal swab reverse-transcriptase-PCR for SARS-CoV-2 RNA, and (3) chest computed tomography (CT) findings suggestive of COVID-19. The exclusion criteria were as follows: (1) patients who received steroids, anakinra, or IVIG before tocilizumab administration and (2) patients with missing baseline data.

A total of 133 patients who received tocilizumab were included in the study. Demographic, clinical, laboratory, and treatment data were obtained from the patient’s medical records. The clinical status before tocilizumab administration was assessed according to the eight-category ordinal scale (16).

Category 1: Non-hospitalized patients with no activity restrictions.

Category 2: Hospitalized patients with limited activities and/or home oxygen requirements.

Category 3: Hospitalized patients not requiring supplemental oxygen and no longer requiring ongoing medical care (used if hospitalization was extended for infection control or other nonmedical reasons).

Category 4: Hospitalized patients who do not require supplemental oxygen but need ongoing medical care related to COVID-19 or other medical conditions.

Category 5: Hospitalized patients because of the need for supplemental oxygen.

Category 6: Hospitalized patients because of the need for noninvasive ventilation or use of high-flow oxygen devices.

Category 7: Patients receiving invasive mechanical ventilation or extracorporeal membrane oxygenation.

Category 8: Death.

Treatment protocol

The treatment protocol of the Turkish Ministry of Health for COVID-19 was recorded in the patient files. The protocol of the period included hydroxychloroquine (±azitromycin) for 5-10 days and venous thromboembolism prophylaxis in the absence of a major contraindication. When clinical evidence of progressive COVID-19 was observed despite this standard care (defined as oxygen saturation <92% on room air or receiving oxygen therapy, and CRP ≥75 mg/L), available sets of recommendations included the use of single-dose tocilizumab 8 mg/kg (maximum dose: 800 mg) after exclusion of bacterial and fungal co-infection. A second dose was recommended when no improvement was observed after the first dose within 24 hours.

Outcome

The end-points were improvement in the clinical status on an eight-category ordinal scale at 28 days of tocilizumab administration. The patients were divided into two groups: those who improved after tocilizumab therapy and those who did not. Serum alanine transaminase, aspartate transaminase, LDH, urea, creatinine, CRP, albumin, ferritin, fibrinogen, IL-6 levels, and complete blood count were available for all patients. Laboratory results in the last 24 hours before tocilizumab administration were used to calculate PNI, SII, and CAR. PNI was calculated as serum albumin levels (g/L) + 5 total lymphocyte count (109/L) (17). SII was determined using the following formula: platelet count neutrophil count/lymphocyte count (18). CAR was obtained by dividing the CRP levels by albumin level (19).

Statistical Analysis

All data were analyzed using the Statistical Package for Social Sciences (SPSS) (SPSS Inc., Chicago, IL, USA) 16.0 program for Windows. Histograms, probability plots, and the Kolmogorov-Smirnov test were used to check the normal distribution. Normally distributed variables were expressed as mean±standard deviation, skewed variables as median (interquartile range) (25th and 75th percentiles), and categorical variables as number and percentage. The performance of IL-6, CAR, PNI, SII, and LDH in predicting the response to tocilizumab was analyzed using receiver operating characteristic curve analysis. The Youden index was used to determine the best cut-off values for these biomarkers. When a significant cut-off value was observed, the sensitivity, specificity, positive predictive value, and negative predictive value were calculated. A test with an area under the curve (AUC) of ≥0.85 was considered accurate. P<0.05 was considered statistically significant.


Results

The study included 132 patients who received tocilizumab treatment because of clinical progression and cytokine storm despite standard care. The clinical characteristics and laboratory findings of the study groups are shown in Table 1. Overall, the patients were predominantly male (69.9%) with a mean age of 62.64±13.66 (range, 22-90 years) years. Eighty-eight (66.2%) patients had at least one comorbid disease, and the most common comorbidity was hypertension (35.3%), followed by diabetes mellitus (31.6%). The frequency of concomitant antibiotic therapy and steroids was similar between the groups.

Patients who improved after tocilizumab therapy (n=99, 74.4%, were significantly younger and had significantly lower IL-6, LDH, SII, CAR, and higher PNI than patients who did not improve (Table 1).

To predict the response to tocilizumab treatment, IL-6 had the highest AUC value [AUC=0.782, 95% confidence interval (CI): 0.694-0.870], followed by LDH (AUC=0.761, 95% CI: 0.661-0.861), PNI (AUC=0.696, 95% CI: 0.584-807), SII (AUC=0.671, 95% CI: 0.551-0.790), CAR (AUC=0.682, 95% CI: 0.578-0.786), and CRP (AUC=0.643, 95% CI: 0.535-0.751) (Figure 1). A cut-off level of 143.12 pg/mL for IL-6 had 84.85% sensitivity and 64.71% specificity, 460 U/L for LDH had 71.72% sensitivity and 73.75% specificity, 31.35 for PNI had 79.80% sensitivity and 55.88% specificity, 3895.92 for SII had 90.91% sensitivity and 47.06% specificity, and 61.15 for CAR had 67.68% sensitivity and 61.76% specificity. The performance of these markers in predicting the effectiveness of tocilizumab therapy is shown in Table 2.


Discussion

To the best of our knowledge, this is the first study to assess the predictive value of PNI, CAR, and SII in determining the response to tocilizumab treatment in patients with COVID-19. Among 133 patients with COVID-19, approximately three-quarters of patients improved after tocilizumab therapy and those had significantly lower IL-6, LDH, SII, CAR, and significantly higher PNI compared with those who failed to receive tocilizumab therapy. To predict the effectiveness of tocilizumab in COVID-19 patients, serum IL-6 level had the highest AUC value, followed by LDH, PNI, CAR, SII, and CRP.

In severe COVID-19, cytokine storm syndrome, an overproduction of proinflammatory cytokines and overactivation of immune cells, can lead to life-threatening medical syndromes including disseminated intravascular coagulation, ARDS, multiorgan failure, and even death if treatment is inadequate (20). Therefore, the timing of diagnosis and treatment are very important strategies for COVID-19 management. Among the cytokines, IL-6 has received particular attention for its relation to COVID-19. The association between IL-6 levels and disease severity has been reported in several studies. Therefore, IL-6 blockade was postulated as an effective therapeutic strategy to reduce inflammation in the cytokine storm associated with COVID-19, and attention was focused on tocilizumab, a recombinant monoclonal antibody against the IL-6 receptor. Although early observational studies have indicated improved outcomes in COVID-19 patients who received tocilizumab, subsequent randomized clinical trials assessing tocilizumab efficacy reported conflicting results (21-24). However, these trials differed considerably in patient number, study design, disease severity contents of the applied standard of care therapy, and concomitant steroid dosage. Consequently, the benefit of tocilizumab treatment in some patient groups cannot be denied. In this context, we aimed to perform the current study because it was timely and important to define the patients who will benefit from tocilizumab or not, and determine the optimal timing of tocilizumab therapy to prevent drug-related side effects and increase in costs due to unnecessary drug use.

Regarding the reliability of IL-6 as a treatment response biomarker in patients with COVID-19, Flisiak et al. (25) reported that tocilizumab administration reduced mortality and accelerated clinical recovery in patients with pre-treatment IL-6 levels higher than 100 pg/mL who required supplemental oxygen. On the other hand, Li et al. (26) reported that pre-treatment IL-6 levels equal to or higher than 100 pg/mL were associated with poor prognoses after tocilizumab therapy. Similar to the study by Li et al. (26), in our study, serum IL-6 levels were significantly lower in patients who improved after tocilizumab treatment. In addition, we concluded that among patients who had pre-treatment IL-6 levels lower than 143.12 pg/mL, the probability of clinical improvement after tocilizumab therapy increased from 74.44% to 87.23%. If a patient has a pre-treatment IL-6 level higher than 143.12 pg/mL, the probability of mortality increases from 25.56% to 59% (i.e., pretest odds=0.34; posttest odds=1.45; posttest probability=0.59).

PNI has been suggested as a biomarker for assessing the nutritional and immunological status of patients with chronic disease (27). It is calculated using commonly used parameters, including serum lymphocyte count and albumin level (17). Reduced serum lymphocyte count and hypoalbuminemia are predictors of severe disease and poor outcomes in COVID-19 patients (28,29). In addition, lower PNI may serve as a predictor of prognosis in COVID-19 patients (30). Among patients who had pre-treatment PNI levels higher than 31.35, the probability of clinical improvement after tocilizumab therapy was 84.27% (i.e., pretest odds=2.85; posttest odds=5.36; posttest probability=0.84). For the first time in the available literature, we now provide cutoffs of PNI level for predicting response to tocilizumab treatment.

SII can be easily calculated from hemogram parameters (18). Fois et al. (14) reported that SII was an independent predictor of hospital mortality in COVID-19 patients. In their study, patients with higher SII values had lower PaO2/FiO2 ratios and higher chest CT severity scores, but there were no differences regarding the comorbidities. They suggested that the SII level would be specifically affected by lung injury occurring in COVID-19 patients, rather than an overall deterioration in their clinical status due to comorbidities (14). Similarly, Muhammad et al. (13) revealed that SII had high sensitivity and specificity in predicting the clinical course of COVID-19 patients. In line with those recently published studies, in our study, patients who did not improve after tocilizumab therapy had significantly higher SII levels than those who improved. If a patient had a pre-treatment SII level <3895.92, the probability of clinical improvement was raised to 83.06% (i.e., pretest odds=2.85; posttest odds=4.90; posttest probability=0.83). For the first time in the available literature, we now provide cutoffs of SII level for predicting response to tocilizumab treatment.

CAR, which reflects both the inflammatory state and nutritional status, can be obtained with easily accessible parameters, including CRP and albumin (19). It has been reported that the CAR level could be used as a prognostic indicator of disease severity and has predictive value for in-hospital mortality in COVID-19 patients (15,31). In our study, patients who improved after tocilizumab therapy had significantly lower CAR than patients who did not improve. Also, a pre-treatment CAR level <61.15 raised the probability of treatment being effective to 83.46% (i.e., pretest odds=2.85; posttest odds=5.05; posttest probability=0.83). For the first time in the available literature, we now provide cutoffs of CAR levels for predicting response to tocilizumab treatment.

LDH is an enzyme in nearly all cells throughout the body. Elevated LDH levels were associated with an increased risk of severe disease and mortality in COVID-19 patients (32,33). Decreased oxygenation, multiple organ injury, and a hypercoagulable state can contribute to the elevation of LDH in COVID-19 patients (32). In our study, COVID-19 patients who improved after tocilizumab administration had lower LDH levels than those who did not. The probability of clinical improvement was increased to 88.54% in patients with pretreatment LDH levels lower than 460 U/L (i.e., pretest odds=2.85; posttest odds=7.72; posttest probability=0.88). Similar to our study, Li et al. (26) reported that patients who died after tocilizumab therapy had significantly higher LDH levels at baseline than those with clinically improved levels. In addition, they showed that, while there was no significant improvement in the post-treatment LDH value of patients who died, LDH levels were significantly decreased in the improved group. However, the performance of LDH in predicting treatment response was not evaluated in that study. For the first time in the available literature, we now provide cutoffs of LDH levels for predicting response to tocilizumab treatment.

Study Limitations

The retrospective design of this study and the lack of a control group are the major limitations. In addition, the data were obtained from a single center through the hospital’s electronic database; therefore, patient selection bias could not be completely eliminated. Because the utility of pre-treatment biomarker levels in predicting tocilizumab response was evaluated, post-treatment changes in these biomarker levels were not evaluated.

Because there is an ongoing debate about the role of tocilizumab in treating patients with COVID-19, the drug may have a substantial benefit in certain populations. It is well known that most patients experience only mild to moderate symptoms during COVID-19, and these patients do not require anti-cytokine therapy. However, mortality occurs in a subset of patients who progress to severe and critically ill and may require anti-cytokine therapy, but the efforts for suppression of inflammation do not necessarily reduce mortality in all cases, especially when the inflammation cascade is excessive and therapy is delayed. Moreover, early use of anti-cytokine therapy may lead to both increased costs and risks, including iatrogenic immunosuppression. From this viewpoint, one can claim that there can be a “window of opportunity” for treating COVID-19. To specify this time interval and the patients who will benefit from anti-cytokine therapy, several biomarkers, including those in our results, can be a reference for future research.


Conclusion

In conclusion, the current study showed that hospitalized COVID-19 patients with lower IL-6, LDH, SII, CAR, and higher PNI levels improved after tocilizumab therapy. Although questions about whether the optimal timing of tocilizumab therapy for COVID-19 therapy can be guided by biomarkers remain unanswered, we proposed some parameters that can be easily obtained or calculated. Further prospective studies in different ethnicities are required to confirm our findings.

Ethics

Ethics Committee Approval: The study protocol was first registered in the data of the Turkish Republic Ministry of Health Scientific Research Committee and then approved by the Committee on the Human Research Ethics of the University of Health Sciences Türkiye, Gülhane Faculty of Medicine (date: 26.05.2021, number: 2021/35).

Informed Consent: This was a retrospective cohort study.

Authorship Contributions

Surgical and Medical Practices: M.N.K., Concept: D.T., Design: D.T., M.Ç., F.B., Data Collection or Processing: M.N.K., F.B., Analysis or Interpretation: D.T., E.T., S.Y., Literature Search: D.T., Writing: D.T., M.Ç., S.Ç.

Conflict of Interest: No conflict of interest was declared by the authors.

Financial Disclosure: The authors declared that this study received no financial support.


Images

  1. Wiersinga WJ, Rhodes A, Cheng AC, Peacock SJ, Prescott HC. Pathophysiology, Transmission, Diagnosis, and Treatment of Coronavirus Disease 2019 (COVID-19): A Review. JAMA. 2020;324:782-793.
  2. van Eijk LE, Binkhorst M, Bourgonje AR, et al. COVID-19: immunopathology, pathophysiological mechanisms, and treatment options. J Pathol. 2021;254:307-331.
  3. Jose RJ, Manuel A. COVID-19 cytokine storm: the interplay between inflammation and coagulation. Lancet Respir Med. 2020;8:46-47.
  4. Potere N, Batticciotto A, Vecchie A, et al. The role of IL-6 and IL-6 blockade in COVID-19. Expert Rev Clin Immunol. 2021;17:601-618.
  5. Ramezani M, Nemati H, Najafi F, Sayad B, Sadeghi M. A systematic review and meta-analysis on blood levels of cytokines/chemokines in COVID-19 cases. Gulhane Medical Journal. 2022;64:208-216.
  6. Angriman F, Ferreyro BL, Burry L, et al. Interleukin-6 receptor blockade in patients with COVID-19: placing clinical trials into context. Lancet Respir Med. 2021;9:655-664.
  7. Wang ZH, Lin YW, Wei XB, et al. Predictive Value of Prognostic Nutritional Index on COVID-19 Severity. Front Nutr. 2021;7:582736.
  8. Hu X, Deng H, Wang Y, Chen L, Gu X, Wang X. Predictive value of the prognostic nutritional index for the severity of coronavirus disease 2019. Nutrition. 2021;84:111123.
  9. Xue G, Gan X, Wu Z, et al. Novel serological biomarkers for inflammation in predicting disease severity in patients with COVID-19. Int Immunopharmacol. 2020;89:107065.
  10. Wang R, He M, Yin W, et al. The Prognostic Nutritional Index is associated with mortality of COVID-19 patients in Wuhan, China. J Clin Lab Anal. 2020;34:e23566.
  11. Song F, Ma H, Wang S, et al. Nutritional screening based on objective indices at admission predicts in-hospital mortality in patients with COVID-19. Nutr J. 2021;20:46.
  12. Doganci S, Ince ME, Ors N, et al. A new COVID-19 prediction scoring model for in-hospital mortality: experiences from Turkey, single center retrospective cohort analysis. Eur Rev Med Pharmacol Sci. 2020;24:10247-10257.
  13. Muhammad S, Fischer I, Naderi S, et al. Systemic Inflammatory Index Is a Novel Predictor of Intubation Requirement and Mortality after SARS-CoV-2 Infection. Pathogens. 2021;10:58.
  14. Fois AG, Paliogiannis P, Scano V, et al. The Systemic Inflammation Index on Admission Predicts In-Hospital Mortality in COVID-19 Patients. Molecules. 2020;25:5725.
  15. Guney BC, Tastan YO, Dogantekin B, et al. Predictive Value of CAR for In-Hospital Mortality in Patients with COVID-19 Pneumonia: A Retrospective Cohort Study. Arch Med Res. 2021;52:554-560.
  16. Beigel JH, Tomashek KM, Dodd LE, et al. Remdesivir for the Treatment of Covid-19 - Final Report. N Engl J Med. 2020;383:1813-1826.
  17. Onodera T, Goseki N, Kosaki G. [Prognostic nutritional index in gastrointestinal surgery of malnourished cancer patients]. Nihon Geka Gakkai Zasshi. 1984;85:1001-1005
  18. Hu B, Yang XR, Xu Y, et al. Systemic immune-inflammation index predicts prognosis of patients after curative resection for hepatocellular carcinoma. Clin Cancer Res. 2014;20:6212-6222.
  19. Fairclough E, Cairns E, Hamilton J, Kelly C. Evaluation of a modified early warning system for acute medical admissions and comparison with C-reactive protein/albumin ratio as a predictor of patient outcome. Clin Med (Lond). 2009;9:30-33.
  20. Yang L, Xie X, Tu Z, Fu J, Xu D, Zhou Y. The signal pathways and treatment of cytokine storm in COVID-19. Signal Transduct Target Ther. 2021;6:255.
  21. Xu X, Han M, Li T, et al. Effective treatment of severe COVID-19 patients with tocilizumab. Proc Natl Acad Sci U S A. 2020;117:10970-10975.
  22. Guaraldi G, Meschiari M, Cozzi-Lepri A, et al. Tocilizumab in patients with severe COVID-19: a retrospective cohort study. Lancet Rheumatol. 2020;2:474-484.
  23. RECOVERY Collaborative Group. Tocilizumab in patients admitted to hospital with COVID-19 (RECOVERY): a randomised, controlled, open-label, platform trial. Lancet. 2021;397:1637-1645.
  24. Rosas IO, Brau N, Waters M, et al. Tocilizumab in Hospitalized Patients with Severe Covid-19 Pneumonia. N Engl J Med. 2021;384:1503-1516.
  25. Flisiak R, Jaroszewicz J, Rogalska M, et al. Tocilizumab Improves the Prognosis of COVID-19 in Patients with High IL-6. J Clin Med. 2021;10:1583.
  26. Li P, Lu Z, Li Q, et al. Administration Timing and Efficacy of Tocilizumab in Patients With COVID-19 and Elevated IL-6. Front Mol Biosci. 2021;8:651662.
  27. Yan L, Nakamura T, Casadei-Gardini A, Bruixola G, Huang YL, Hu ZD. Long-term and short-term prognostic value of the prognostic nutritional index in cancer: a narrative review. Ann Transl Med. 2021;9:1630.
  28. Malik P, Patel U, Mehta D, et al. Biomarkers and outcomes of COVID-19 hospitalisations: systematic review and meta-analysis. BMJ Evid Based Med. 2021;26:107-108.
  29. Chen C, Zhang Y, Zhao X, Tao M, Yan W, Fu Y. Hypoalbuminemia - An Indicator of the Severity and Prognosis of COVID-19 Patients: A Multicentre Retrospective Analysis. Infect Drug Resist. 2021;14:3699-3710.
  30. Rashedi S, Keykhaei M, Pazoki M, et al. Clinical significance of prognostic nutrition index in hospitalized patients with COVID-19: Results from single-center experience with systematic review and meta-analysis. Nutr Clin Pract. 2021;36:970-983.
  31. Kalabin A, Mani VR, Valdivieso SC, Donaldson B. Does C reactive protein/Albumin ratio have prognostic value in patients with COVID-19. J Infect Dev Ctries. 2021;15:1086-1093.
  32. Henry BM, Aggarwal G, Wong J, et al. Lactate dehydrogenase levels predict coronavirus disease 2019 (COVID-19) severity and mortality: A pooled analysis. Am J Emerg Med. 2020;38:1722-1726.
  33. Kermali M, Khalsa RK, Pillai K, Ismail Z, Harky A. The role of biomarkers in diagnosis of COVID-19 - A systematic review. Life Sci. 2020;254:117788.