Logistična regresija: LASSO izbor spremenljivk

1 Priprava podatkov

Target: DSWI01 | Predictors: 108 | Samples: 5319

Tudi tu delamo na celotni zbirki.

2 LASSO izbor spremenljivk

Najboljši C: 0.0599

Izbrane spremenljivke (po izvirnih imenih):

  1. ACEInhibitors
  2. AcuteKidneyFailure
  3. Age
  4. BIMA
  5. BMI
  6. BoneWaxOsteneG
  7. CC5085
  8. Cardioversion
  9. CockcraftGaultIndexPreop
  10. Diabetes
  11. DiabetesOnInsuline
  12. EUROscore
  13. EUROscore10
  14. EjectionFractionEF
  15. HospitalizationBeforeSurgeryMo
  16. IABPPreoperatively
  17. InfarctionPerioperativelyYN
  18. KongestiveHeartFailure
  19. LeukocytesSecondPostoperativeD
  20. LiverDiseaseYN
  21. MoreThan2UnitsOfErythrocytes
  22. NumberOfGrafts
  23. NumberOfReintubations
  24. PericardDrainage
  25. PericardialEffusion
  26. PerifernoArterijskoObolenje
  27. PleuralEffusion
  28. PneumothoraxJN
  29. PreviousCardiacOperation
  30. PsychoSyndrome
  31. Rebleeding
  32. Reintubation
  33. RethoracotomyYN
  34. TherapyRelevantPsychoSyndrome
  35. TiesselFibrinGlueMl
  36. TotalDrainage
  37. Tracheotomy
  38. Transfusion

Izbrane spremenljivke in koeficienti:

Feature Coefficient
BMI 0.4462
Transfusion 0.2673
BIMA 0.2344
PleuralEffusion 0.2113
AcuteKidneyFailure 0.1588
PerifernoArterijskoObolenje 0.1516
IABPPreoperatively -0.1460
RethoracotomyYN 0.1423
DiabetesOnInsuline 0.1419
HospitalizationBeforeSurgeryMo 0.1343
TherapyRelevantPsychoSyndrome 0.0974
CockcraftGaultIndexPreop -0.0946
PsychoSyndrome 0.0811
LiverDiseaseYN -0.0649
Cardioversion 0.0625
PreviousCardiacOperation -0.0450
ACEInhibitors 0.0447
Diabetes 0.0442
NumberOfReintubations 0.0432
LeukocytesSecondPostoperativeD 0.0419
KongestiveHeartFailure 0.0399
TiesselFibrinGlueMl 0.0375
EUROscore10 -0.0366
TotalDrainage 0.0350
PneumothoraxJN -0.0250
PericardDrainage 0.0246
MoreThan2UnitsOfErythrocytes 0.0234
EjectionFractionEF -0.0197
Reintubation 0.0194
Rebleeding -0.0181
CC5085 0.0171
BoneWaxOsteneG -0.0112
EUROscore -0.0100
Age 0.0073
InfarctionPerioperativelyYN -0.0037
Tracheotomy 0.0031
NumberOfGrafts 0.0012
PericardialEffusion -0.0005

3 Multipla logistična regresija (po LASSO izboru)

Predictor Level OR CI95 p
ACEInhibitors ACEInhibitors=1.0 1.291 0.931–1.791 0.126
AcuteKidneyFailure AcuteKidneyFailure=1.0 1.710 1.141–2.563 0.009
BIMA BIMA=1.0 5.057 2.876–8.892 < 0.001
BoneWaxOsteneG BoneWaxOsteneG=1.0 0.732 0.460–1.162 0.186
CC5085 CC5085=1.0 1.185 0.848–1.655 0.320
Cardioversion Cardioversion=1.0 1.534 0.847–2.779 0.158
Diabetes Diabetes=1.0 1.199 0.813–1.769 0.359
DiabetesOnInsuline DiabetesOnInsuline=1.0 1.635 1.039–2.574 0.034
HospitalizationBeforeSurgeryMo HospitalizationBeforeSurgeryMo=1.0 1.726 1.214–2.453 0.002
IABPPreoperatively IABPPreoperatively=1.0 0.097 0.013–0.742 0.025
InfarctionPerioperativelyYN InfarctionPerioperativelyYN=1.0 0.335 0.044–2.559 0.292
KongestiveHeartFailure KongestiveHeartFailure=1.0 1.196 0.675–2.118 0.541
LiverDiseaseYN LiverDiseaseYN=1.0 0.000 0.000–inf 1.000
MoreThan2UnitsOfErythrocytes MoreThan2UnitsOfErythrocytes=1.0 1.183 0.762–1.835 0.454
PericardDrainage PericardDrainage=1.0 1.248 0.892–1.747 0.196
PerifernoArterijskoObolenje PerifernoArterijskoObolenje=1.0 2.086 1.408–3.090 < 0.001
PleuralEffusion PleuralEffusion=1.0 2.069 1.428–2.998 < 0.001
PneumothoraxJN PneumothoraxJN=1.0 0.420 0.128–1.384 0.154
PreviousCardiacOperation PreviousCardiacOperation=1.0 0.000 0.000–inf 1.000
PsychoSyndrome PsychoSyndrome=1.0 1.423 0.412–4.919 0.577
Rebleeding Rebleeding=1.0 0.431 0.183–1.019 0.055
Reintubation Reintubation=1.0 1.167 0.470–2.901 0.740
RethoracotomyYN RethoracotomyYN=1.0 3.326 1.803–6.137 < 0.001
TherapyRelevantPsychoSyndrome TherapyRelevantPsychoSyndrome=1.0 1.581 0.436–5.730 0.486
TiesselFibrinGlueMl TiesselFibrinGlueMl=1.0 1.642 0.873–3.089 0.124
Tracheotomy Tracheotomy=1.0 0.923 0.489–1.741 0.804
Transfusion Transfusion=1.0 1.982 1.348–2.913 < 0.001
Age Age 1.018 0.995–1.042 0.132
BMI BMI 1.154 1.112–1.197 < 0.001
CockcraftGaultIndexPreop CockcraftGaultIndexPreop 0.992 0.986–0.999 0.030
EUROscore EUROscore 0.966 0.929–1.004 0.080
EUROscore10 EUROscore10 0.755 0.387–1.470 0.408
EjectionFractionEF EjectionFractionEF 0.986 0.964–1.010 0.247
LeukocytesSecondPostoperativeD LeukocytesSecondPostoperativeD 1.013 0.994–1.033 0.181
NumberOfGrafts NumberOfGrafts 1.125 0.905–1.399 0.289
NumberOfReintubations NumberOfReintubations 1.451 0.720–2.923 0.298
PericardialEffusion PericardialEffusion 0.993 0.983–1.004 0.226
TotalDrainage TotalDrainage 1.000 1.000–1.000 0.126

3.1 Vrednotenje modela

3.1.1 ROC analiza

3.1.2 Vrednotenje napovednih vrednosti

Youden index: 0.515 (threshold 0.039)

Pred 0 Pred 1
True 0 3940 1193
True 1 47 139 

Medical-oriented classification measures:

Sensitivity    : 0.7473
Specificity    : 0.7676
Pos Pred Value : 0.1044
Neg Pred Value : 0.9882
Accuracy       : 0.7669

Classification_report (sklearn):
              precision    recall  f1-score   support

     class 0     0.9882    0.7676    0.8640      5133
     class 1     0.1044    0.7473    0.1831       186

    accuracy                         0.7669      5319
   macro avg     0.5463    0.7574    0.5236      5319
weighted avg     0.9573    0.7669    0.8402      5319