Logistična regresija: Elastic Net izbor spremenljivk

1 Priprava podatkov

Target: DSWI01 | Predictors: 108 | Samples: 5319

Tudi tu delamo na celotni zbirki.

2 Elastic Net izbor spremenljivk

Najboljši C: 0.0599

Najboljši l1_ratio: 0.90

Izbrane spremenljivke (po izvirnih imenih):

  1. ACEInhibitors
  2. AcuteKidneyFailure
  3. Age
  4. AorticCalcificatio
  5. BIMA
  6. BMI
  7. BoneWaxOsteneG
  8. CC5085
  9. Cardioversion
  10. CockcraftGaultIndexPreop
  11. Diabetes
  12. DiabetesOnInsuline
  13. EUROscore
  14. EUROscore10
  15. EjectionFractionEF
  16. HospitalizationBeforeSurgeryMo
  17. IABPPreoperatively
  18. InfarctionPerioperativelyYN
  19. KongestiveHeartFailure
  20. LeukocytesSecondPostoperativeD
  21. LiverDiseaseYN
  22. MoreThan2UnitsOfErythrocytes
  23. NYHA3rdOr4thCategory
  24. NumberOfGrafts
  25. NumberOfReintubations
  26. PericardDrainage
  27. PericardialEffusion
  28. PerifernoArterijskoObolenje
  29. PleuralEffusion
  30. PneumothoraxJN
  31. PreoperativeInfectionYN
  32. PreviousCardiacOperation
  33. PsychoSyndrome
  34. Rebleeding
  35. Reintubation
  36. RethoracotomyYN
  37. TherapyRelevantPsychoSyndrome
  38. TiesselFibrinGlueMl
  39. TotalDrainage
  40. Tracheotomy
  41. Transfusion

Izbrane spremenljivke in koeficienti:

Feature Coefficient
BMI 0.4560
Transfusion 0.2692
BIMA 0.2434
PleuralEffusion 0.2128
AcuteKidneyFailure 0.1592
PerifernoArterijskoObolenje 0.1587
IABPPreoperatively -0.1571
RethoracotomyYN 0.1493
DiabetesOnInsuline 0.1432
HospitalizationBeforeSurgeryMo 0.1430
CockcraftGaultIndexPreop -0.1024
TherapyRelevantPsychoSyndrome 0.0985
PsychoSyndrome 0.0818
LiverDiseaseYN -0.0777
Cardioversion 0.0642
PreviousCardiacOperation -0.0557
ACEInhibitors 0.0518
Diabetes 0.0491
NumberOfReintubations 0.0452
EUROscore10 -0.0448
LeukocytesSecondPostoperativeD 0.0446
KongestiveHeartFailure 0.0442
TiesselFibrinGlueMl 0.0429
TotalDrainage 0.0411
PneumothoraxJN -0.0347
PericardDrainage 0.0327
EjectionFractionEF -0.0310
Rebleeding -0.0297
MoreThan2UnitsOfErythrocytes 0.0276
EUROscore -0.0247
CC5085 0.0235
Age 0.0208
Reintubation 0.0201
BoneWaxOsteneG -0.0199
InfarctionPerioperativelyYN -0.0104
PericardialEffusion -0.0095
NumberOfGrafts 0.0090
AorticCalcificatio 0.0071
PreoperativeInfectionYN 0.0027
Tracheotomy 0.0026
NYHA3rdOr4thCategory -0.0023

3 Multipla logistična regresija (po Elastic Net izboru)

Predictor Level OR CI95 p
ACEInhibitors ACEInhibitors=1.0 1.276 0.919–1.771 0.146
AcuteKidneyFailure AcuteKidneyFailure=1.0 1.696 1.131–2.545 0.011
AorticCalcificatio AorticCalcificatio=1.0 1.233 0.865–1.759 0.247
BIMA BIMA=1.0 5.109 2.896–9.014 < 0.001
BoneWaxOsteneG BoneWaxOsteneG=1.0 0.745 0.468–1.185 0.214
CC5085 CC5085=1.0 1.181 0.845–1.650 0.330
Cardioversion Cardioversion=1.0 1.504 0.827–2.736 0.181
Diabetes Diabetes=1.0 1.200 0.813–1.771 0.358
DiabetesOnInsuline DiabetesOnInsuline=1.0 1.709 1.084–2.695 0.021
HospitalizationBeforeSurgeryMo HospitalizationBeforeSurgeryMo=1.0 1.688 1.187–2.401 0.004
IABPPreoperatively IABPPreoperatively=1.0 0.100 0.013–0.766 0.027
InfarctionPerioperativelyYN InfarctionPerioperativelyYN=1.0 0.334 0.044–2.550 0.290
KongestiveHeartFailure KongestiveHeartFailure=1.0 1.205 0.680–2.134 0.524
LiverDiseaseYN LiverDiseaseYN=1.0 0.000 0.000–42799107853590738752786427358911785088316766606307426064561505893230227329280908140028098635146007242019638240668225379119009851773221694093290420016181924959981540159172123868400794720235033684631649020142211547832927184114653164059878420755009702515087437047275767486182588416.000 0.969
MoreThan2UnitsOfErythrocytes MoreThan2UnitsOfErythrocytes=1.0 1.167 0.751–1.811 0.492
NYHA3rdOr4thCategory NYHA3rdOr4thCategory=1.0 0.766 0.553–1.062 0.110
PericardDrainage PericardDrainage=1.0 1.281 0.915–1.793 0.149
PerifernoArterijskoObolenje PerifernoArterijskoObolenje=1.0 2.086 1.404–3.100 < 0.001
PleuralEffusion PleuralEffusion=1.0 2.063 1.422–2.993 < 0.001
PneumothoraxJN PneumothoraxJN=1.0 0.441 0.133–1.459 0.180
PreoperativeInfectionYN PreoperativeInfectionYN=1.0 1.657 0.689–3.985 0.259
PreviousCardiacOperation PreviousCardiacOperation=1.0 0.000 0.000–inf 1.000
PsychoSyndrome PsychoSyndrome=1.0 1.428 0.416–4.900 0.571
Rebleeding Rebleeding=1.0 0.434 0.184–1.025 0.057
Reintubation Reintubation=1.0 1.172 0.470–2.920 0.734
RethoracotomyYN RethoracotomyYN=1.0 3.355 1.819–6.186 < 0.001
TherapyRelevantPsychoSyndrome TherapyRelevantPsychoSyndrome=1.0 1.561 0.434–5.616 0.496
TiesselFibrinGlueMl TiesselFibrinGlueMl=1.0 1.666 0.882–3.146 0.116
Tracheotomy Tracheotomy=1.0 0.940 0.498–1.774 0.848
Transfusion Transfusion=1.0 1.998 1.358–2.940 < 0.001
Age Age 1.018 0.994–1.042 0.139
BMI BMI 1.157 1.115–1.201 < 0.001
CockcraftGaultIndexPreop CockcraftGaultIndexPreop 0.993 0.986–0.999 0.033
EUROscore EUROscore 0.966 0.929–1.004 0.082
EUROscore10 EUROscore10 0.743 0.380–1.453 0.385
EjectionFractionEF EjectionFractionEF 0.986 0.963–1.009 0.229
LeukocytesSecondPostoperativeD LeukocytesSecondPostoperativeD 1.014 0.994–1.034 0.159
NumberOfGrafts NumberOfGrafts 1.124 0.904–1.399 0.293
NumberOfReintubations NumberOfReintubations 1.469 0.724–2.983 0.287
PericardialEffusion PericardialEffusion 0.994 0.983–1.004 0.246
TotalDrainage TotalDrainage 1.000 1.000–1.000 0.142

3.1 Vrednotenje modela

3.1.1 ROC analiza

3.1.2 Vrednotenje napovednih vrednosti

Youden index: 0.515 (threshold 0.038)

Pred 0 Pred 1
True 0 3911 1222
True 1 46 140 

Medical-oriented classification measures:

Sensitivity    : 0.7527
Specificity    : 0.7619
Pos Pred Value : 0.1028
Neg Pred Value : 0.9884
Accuracy       : 0.7616

Classification_report (sklearn):
              precision    recall  f1-score   support

     class 0     0.9884    0.7619    0.8605      5133
     class 1     0.1028    0.7527    0.1809       186

    accuracy                         0.7616      5319
   macro avg     0.5456    0.7573    0.5207      5319
weighted avg     0.9574    0.7616    0.8367      5319