1차 데이터셋: qc_ASOS 데이터 (2-3시간 차이)
2차 데이터셋: mrg_ASOS_AAOS 데이터 (2-3시간 차이) x에 vis_log 가 없는 경우 y=flag
3차 데이터셋: mrg_ASOS_AAOS 데이터 (2-3시간 차이) x에 vis_log 를 추가하고 y=flag
데이터셋 주의 사항
vis_10m는 제외해야 된다.
(오로지 flag로만 비교할때 보다, vis_log가 남아 있을 때 결과가 약간 더 향상되는 경우가 있다. )
의사결정 나무
| 1차 2차 > 3차
---------------------------
precision | 1.0
recall | 0.50
f1-score | 0.53
support | 0.52
2차
precision recall f1-score support
0.0 0.99 0.99 0.99 10227
1.0 0.60 0.66 0.63 294
accuracy 0.98 10521
macro avg 0.79 0.82 0.81 10521
weighted avg 0.98 0.98 0.98 10521
3차
precision recall f1-score support
0.0 0.99 0.99 0.99 10227
1.0 0.59 0.62 0.61 294
accuracy 0.98 10521
macro avg 0.79 0.81 0.80 10521
weighted avg 0.98 0.98 0.98 10521랜덤포레스트
| 1차 2차 < 3차
---------------------------
precision | 1.0
recall | 1.00
f1-score | 0.09
support | 0.16
2차
precision recall f1-score support
0.0 0.97 1.00 0.99 10227
1.0 1.00 0.07 0.13 294
accuracy 0.97 10521
macro avg 0.99 0.53 0.56 10521
weighted avg 0.97 0.97 0.96 105213차
precision recall f1-score support
0.0 0.98 1.00 0.99 10227
1.0 0.87 0.41 0.56 294
accuracy 0.98 10521
macro avg 0.92 0.71 0.78 10521
weighted avg 0.98 0.98 0.98 10521
나이브 베이즈
| 1차 2차 < 3차
---------------------------
precision | 1.0
recall | 1.0
f1-score | 0.09
support | 0.16
2차
precision recall f1-score support
0.0 0.97 1.00 0.99 10227
1.0 1.00 0.07 0.13 294
accuracy 0.97 10521
macro avg 0.99 0.53 0.56 10521
weighted avg 0.97 0.97 0.96 105213차
precision recall f1-score support
0.0 0.98 1.00 0.99 10227
1.0 0.87 0.41 0.56 294
accuracy 0.98 10521
macro avg 0.92 0.71 0.78 10521
weighted avg 0.98 0.98 0.98 10521에이다 부스트
| 1차 2차 < 3차
---------------------------
precision | 1.0
recall | 0.75
f1-score | 0.54
support | 0.63
2차
precision recall f1-score support
0.0 0.99 0.99 0.99 10227
1.0 0.75 0.57 0.65 294
accuracy 0.98 10521
macro avg 0.87 0.78 0.82 10521
weighted avg 0.98 0.98 0.98 105213차
precision recall f1-score support
0.0 0.99 0.99 0.99 10227
1.0 0.76 0.59 0.66 294
accuracy 0.98 10521
macro avg 0.87 0.79 0.83 10521
weighted avg 0.98 0.98 0.98 10521
그레디언트 부스트 (시간 걸림)
| 1차 2차 > 3차
---------------------------
precision | 1.0
recall | 0.38
f1-score | 0.03
support | 0.06
2차
precision recall f1-score support
0.0 0.98 1.00 0.99 10227
1.0 0.78 0.33 0.47 294
accuracy 0.98 10521
macro avg 0.88 0.67 0.73 10521
weighted avg 0.98 0.98 0.97 105213차
precision recall f1-score support
0.0 0.98 1.00 0.99 10227
1.0 0.80 0.32 0.46 294
accuracy 0.98 10521
macro avg 0.89 0.66 0.72 10521
weighted avg 0.98 0.98 0.97 10521
스태킹
| 1차 2차 = 3차.
---------------------------
precision | 1.0
recall | 0.70
f1-score | 0.56
support | 0.62
2차
precision recall f1-score support
0.0 0.99 0.99 0.99 10227
1.0 0.75 0.55 0.64 294
accuracy 0.98 10521
macro avg 0.87 0.77 0.81 10521
weighted avg 0.98 0.98 0.98 105213차
precision recall f1-score support
0.0 0.99 1.00 0.99 10227
1.0 0.76 0.55 0.64 294
accuracy 0.98 10521
macro avg 0.88 0.77 0.81 10521
weighted avg 0.98 0.98 0.98 10521