Starting cxg2 and cc (36000, 15126) 36000 {'C': 0.01, 'loss': 'squared_hinge'} STARTING UNMASKING ROUND 1 rus cc cxg2 1 precision recall f1-score support az 0.94 0.94 0.94 5000 bg 1.00 1.00 1.00 2401 by 0.98 0.95 0.97 4777 ec 0.96 0.98 0.97 5000 ee 0.86 0.89 0.87 5000 ge 0.95 0.95 0.95 4123 ht 0.99 0.99 0.99 5000 kg 0.99 0.99 0.99 5000 kz 0.96 0.93 0.94 5000 lt 0.94 0.93 0.94 5000 lv 0.92 0.91 0.91 5000 md 0.98 0.97 0.97 5000 pw 0.98 0.97 0.98 2888 ru 0.90 0.90 0.90 5000 si 1.00 1.00 1.00 2339 so 0.88 0.89 0.88 3397 tj 0.95 0.97 0.96 5000 ua 0.93 0.94 0.94 5000 uz 0.92 0.92 0.92 5000 avg / total 0.95 0.95 0.95 84925 Reducing feature vectors. (398969, 15126) (84925, 15126) (398969, 15097) (84925, 15097) STARTING UNMASKING ROUND 2 rus cc cxg2 2 precision recall f1-score support az 0.91 0.92 0.91 5000 bg 1.00 1.00 1.00 2401 by 0.97 0.94 0.96 4777 ec 0.95 0.98 0.97 5000 ee 0.82 0.86 0.84 5000 ge 0.93 0.93 0.93 4123 ht 0.99 0.99 0.99 5000 kg 0.98 0.98 0.98 5000 kz 0.95 0.92 0.93 5000 lt 0.93 0.93 0.93 5000 lv 0.90 0.88 0.89 5000 md 0.97 0.96 0.97 5000 pw 0.98 0.97 0.98 2888 ru 0.90 0.89 0.89 5000 si 1.00 1.00 1.00 2339 so 0.89 0.87 0.88 3397 tj 0.94 0.97 0.96 5000 ua 0.92 0.94 0.93 5000 uz 0.88 0.88 0.88 5000 avg / total 0.93 0.93 0.93 84925 Reducing feature vectors. (398969, 15097) (84925, 15097) (398969, 15071) (84925, 15071) STARTING UNMASKING ROUND 3 rus cc cxg2 3 precision recall f1-score support az 0.89 0.91 0.90 5000 bg 1.00 1.00 1.00 2401 by 0.97 0.94 0.96 4777 ec 0.95 0.98 0.97 5000 ee 0.82 0.85 0.83 5000 ge 0.93 0.92 0.92 4123 ht 0.98 0.99 0.99 5000 kg 0.98 0.98 0.98 5000 kz 0.94 0.89 0.91 5000 lt 0.92 0.91 0.92 5000 lv 0.89 0.87 0.88 5000 md 0.97 0.96 0.96 5000 pw 0.97 0.97 0.97 2888 ru 0.89 0.88 0.89 5000 si 1.00 1.00 1.00 2339 so 0.88 0.86 0.87 3397 tj 0.94 0.96 0.95 5000 ua 0.92 0.93 0.93 5000 uz 0.87 0.87 0.87 5000 avg / total 0.93 0.93 0.93 84925 Reducing feature vectors. (398969, 15071) (84925, 15071) (398969, 15039) (84925, 15039) STARTING UNMASKING ROUND 4 rus cc cxg2 4 precision recall f1-score support az 0.88 0.90 0.89 5000 bg 1.00 1.00 1.00 2401 by 0.97 0.93 0.95 4777 ec 0.95 0.98 0.96 5000 ee 0.82 0.85 0.83 5000 ge 0.91 0.90 0.91 4123 ht 0.98 0.99 0.98 5000 kg 0.98 0.98 0.98 5000 kz 0.93 0.89 0.91 5000 lt 0.91 0.91 0.91 5000 lv 0.88 0.86 0.87 5000 md 0.97 0.96 0.96 5000 pw 0.97 0.97 0.97 2888 ru 0.89 0.88 0.88 5000 si 1.00 1.00 1.00 2339 so 0.88 0.85 0.86 3397 tj 0.93 0.96 0.95 5000 ua 0.92 0.93 0.93 5000 uz 0.86 0.87 0.86 5000 avg / total 0.92 0.92 0.92 84925 Reducing feature vectors. (398969, 15039) (84925, 15039) (398969, 15006) (84925, 15006) STARTING UNMASKING ROUND 5 rus cc cxg2 5 precision recall f1-score support az 0.87 0.90 0.89 5000 bg 1.00 1.00 1.00 2401 by 0.96 0.93 0.95 4777 ec 0.95 0.98 0.96 5000 ee 0.81 0.84 0.83 5000 ge 0.90 0.89 0.90 4123 ht 0.98 0.99 0.98 5000 kg 0.98 0.98 0.98 5000 kz 0.93 0.88 0.90 5000 lt 0.90 0.90 0.90 5000 lv 0.87 0.86 0.86 5000 md 0.96 0.95 0.96 5000 pw 0.97 0.97 0.97 2888 ru 0.88 0.87 0.88 5000 si 1.00 1.00 1.00 2339 so 0.88 0.84 0.86 3397 tj 0.93 0.96 0.95 5000 ua 0.92 0.93 0.92 5000 uz 0.86 0.86 0.86 5000 avg / total 0.92 0.92 0.92 84925 Reducing feature vectors. (398969, 15006) (84925, 15006) (398969, 14975) (84925, 14975) STARTING UNMASKING ROUND 6 rus cc cxg2 6 precision recall f1-score support az 0.85 0.88 0.87 5000 bg 1.00 1.00 1.00 2401 by 0.96 0.93 0.94 4777 ec 0.95 0.98 0.96 5000 ee 0.80 0.83 0.82 5000 ge 0.90 0.89 0.89 4123 ht 0.98 0.99 0.98 5000 kg 0.98 0.98 0.98 5000 kz 0.92 0.87 0.89 5000 lt 0.89 0.89 0.89 5000 lv 0.86 0.85 0.86 5000 md 0.96 0.95 0.96 5000 pw 0.97 0.97 0.97 2888 ru 0.88 0.87 0.87 5000 si 1.00 1.00 1.00 2339 so 0.88 0.83 0.85 3397 tj 0.93 0.96 0.94 5000 ua 0.91 0.93 0.92 5000 uz 0.85 0.86 0.85 5000 avg / total 0.91 0.91 0.91 84925 Reducing feature vectors. (398969, 14975) (84925, 14975) (398969, 14944) (84925, 14944) STARTING UNMASKING ROUND 7 rus cc cxg2 7 precision recall f1-score support az 0.85 0.87 0.86 5000 bg 1.00 1.00 1.00 2401 by 0.95 0.93 0.94 4777 ec 0.94 0.98 0.96 5000 ee 0.80 0.83 0.81 5000 ge 0.89 0.88 0.89 4123 ht 0.98 0.99 0.98 5000 kg 0.97 0.98 0.98 5000 kz 0.91 0.86 0.89 5000 lt 0.88 0.88 0.88 5000 lv 0.86 0.84 0.85 5000 md 0.96 0.95 0.96 5000 pw 0.97 0.96 0.97 2888 ru 0.87 0.87 0.87 5000 si 1.00 1.00 1.00 2339 so 0.88 0.82 0.85 3397 tj 0.93 0.95 0.94 5000 ua 0.92 0.92 0.92 5000 uz 0.85 0.85 0.85 5000 avg / total 0.91 0.91 0.91 84925 Reducing feature vectors. (398969, 14944) (84925, 14944) (398969, 14908) (84925, 14908) STARTING UNMASKING ROUND 8 rus cc cxg2 8 precision recall f1-score support az 0.85 0.87 0.86 5000 bg 1.00 1.00 1.00 2401 by 0.95 0.92 0.93 4777 ec 0.94 0.98 0.96 5000 ee 0.80 0.82 0.81 5000 ge 0.89 0.87 0.88 4123 ht 0.97 0.99 0.98 5000 kg 0.97 0.98 0.98 5000 kz 0.91 0.86 0.88 5000 lt 0.87 0.88 0.87 5000 lv 0.85 0.84 0.85 5000 md 0.95 0.95 0.95 5000 pw 0.97 0.97 0.97 2888 ru 0.87 0.86 0.87 5000 si 1.00 1.00 1.00 2339 so 0.87 0.82 0.85 3397 tj 0.93 0.95 0.94 5000 ua 0.90 0.92 0.91 5000 uz 0.84 0.85 0.84 5000 avg / total 0.91 0.91 0.91 84925 Reducing feature vectors. (398969, 14908) (84925, 14908) (398969, 14874) (84925, 14874) STARTING UNMASKING ROUND 9 rus cc cxg2 9 precision recall f1-score support az 0.85 0.87 0.86 5000 bg 1.00 1.00 1.00 2401 by 0.95 0.92 0.93 4777 ec 0.94 0.97 0.96 5000 ee 0.79 0.81 0.80 5000 ge 0.88 0.87 0.88 4123 ht 0.98 0.99 0.98 5000 kg 0.97 0.98 0.97 5000 kz 0.90 0.85 0.87 5000 lt 0.87 0.87 0.87 5000 lv 0.84 0.83 0.84 5000 md 0.93 0.94 0.94 5000 pw 0.97 0.97 0.97 2888 ru 0.87 0.85 0.86 5000 si 1.00 1.00 1.00 2339 so 0.87 0.82 0.84 3397 tj 0.91 0.94 0.93 5000 ua 0.90 0.92 0.91 5000 uz 0.84 0.84 0.84 5000 avg / total 0.90 0.90 0.90 84925 Reducing feature vectors. (398969, 14874) (84925, 14874) (398969, 14842) (84925, 14842) STARTING UNMASKING ROUND 10 rus cc cxg2 10 precision recall f1-score support az 0.84 0.86 0.85 5000 bg 1.00 1.00 1.00 2401 by 0.94 0.91 0.92 4777 ec 0.94 0.97 0.96 5000 ee 0.79 0.81 0.80 5000 ge 0.88 0.87 0.87 4123 ht 0.97 0.99 0.98 5000 kg 0.97 0.98 0.97 5000 kz 0.90 0.84 0.87 5000 lt 0.86 0.86 0.86 5000 lv 0.83 0.82 0.83 5000 md 0.93 0.94 0.93 5000 pw 0.97 0.96 0.97 2888 ru 0.86 0.85 0.85 5000 si 1.00 1.00 1.00 2339 so 0.87 0.81 0.84 3397 tj 0.91 0.94 0.93 5000 ua 0.90 0.91 0.90 5000 uz 0.83 0.84 0.84 5000 avg / total 0.90 0.90 0.90 84925 Reducing feature vectors. (398969, 14842) (84925, 14842) (398969, 14806) (84925, 14806) STARTING UNMASKING ROUND 11 rus cc cxg2 11 precision recall f1-score support az 0.84 0.86 0.85 5000 bg 1.00 1.00 1.00 2401 by 0.94 0.91 0.92 4777 ec 0.94 0.97 0.95 5000 ee 0.78 0.80 0.79 5000 ge 0.87 0.87 0.87 4123 ht 0.97 0.99 0.98 5000 kg 0.97 0.97 0.97 5000 kz 0.89 0.83 0.86 5000 lt 0.85 0.86 0.85 5000 lv 0.83 0.81 0.82 5000 md 0.93 0.93 0.93 5000 pw 0.96 0.96 0.96 2888 ru 0.85 0.84 0.85 5000 si 1.00 1.00 1.00 2339 so 0.87 0.81 0.84 3397 tj 0.91 0.94 0.92 5000 ua 0.89 0.91 0.90 5000 uz 0.83 0.83 0.83 5000 avg / total 0.89 0.89 0.89 84925 Reducing feature vectors. (398969, 14806) (84925, 14806) (398969, 14773) (84925, 14773) STARTING UNMASKING ROUND 12 rus cc cxg2 12 precision recall f1-score support az 0.84 0.85 0.84 5000 bg 1.00 1.00 1.00 2401 by 0.94 0.91 0.92 4777 ec 0.93 0.97 0.95 5000 ee 0.78 0.80 0.79 5000 ge 0.87 0.87 0.87 4123 ht 0.97 0.99 0.98 5000 kg 0.97 0.97 0.97 5000 kz 0.89 0.83 0.86 5000 lt 0.85 0.86 0.85 5000 lv 0.83 0.81 0.82 5000 md 0.92 0.93 0.93 5000 pw 0.96 0.96 0.96 2888 ru 0.84 0.83 0.84 5000 si 1.00 1.00 1.00 2339 so 0.87 0.81 0.84 3397 tj 0.90 0.94 0.92 5000 ua 0.89 0.91 0.90 5000 uz 0.83 0.83 0.83 5000 avg / total 0.89 0.89 0.89 84925 Reducing feature vectors. (398969, 14773) (84925, 14773) (398969, 14739) (84925, 14739) STARTING UNMASKING ROUND 13 rus cc cxg2 13 precision recall f1-score support az 0.83 0.85 0.84 5000 bg 1.00 1.00 1.00 2401 by 0.93 0.91 0.92 4777 ec 0.93 0.97 0.95 5000 ee 0.77 0.80 0.79 5000 ge 0.87 0.86 0.87 4123 ht 0.97 0.99 0.98 5000 kg 0.97 0.97 0.97 5000 kz 0.89 0.82 0.85 5000 lt 0.84 0.85 0.85 5000 lv 0.83 0.81 0.82 5000 md 0.92 0.93 0.93 5000 pw 0.96 0.96 0.96 2888 ru 0.84 0.83 0.84 5000 si 1.00 1.00 1.00 2339 so 0.86 0.81 0.83 3397 tj 0.90 0.94 0.92 5000 ua 0.89 0.90 0.90 5000 uz 0.82 0.83 0.83 5000 avg / total 0.89 0.89 0.89 84925 Reducing feature vectors. (398969, 14739) (84925, 14739) (398969, 14705) (84925, 14705) STARTING UNMASKING ROUND 14 rus cc cxg2 14 precision recall f1-score support az 0.83 0.85 0.84 5000 bg 1.00 1.00 1.00 2401 by 0.93 0.91 0.92 4777 ec 0.93 0.97 0.95 5000 ee 0.77 0.80 0.78 5000 ge 0.87 0.86 0.86 4123 ht 0.97 0.99 0.98 5000 kg 0.97 0.97 0.97 5000 kz 0.88 0.81 0.85 5000 lt 0.84 0.85 0.84 5000 lv 0.82 0.80 0.81 5000 md 0.92 0.93 0.93 5000 pw 0.96 0.96 0.96 2888 ru 0.84 0.83 0.83 5000 si 1.00 1.00 1.00 2339 so 0.86 0.81 0.83 3397 tj 0.90 0.94 0.92 5000 ua 0.88 0.90 0.89 5000 uz 0.82 0.83 0.83 5000 avg / total 0.89 0.89 0.89 84925 Reducing feature vectors. (398969, 14705) (84925, 14705) (398969, 14671) (84925, 14671) STARTING UNMASKING ROUND 15 rus cc cxg2 15 precision recall f1-score support az 0.82 0.84 0.83 5000 bg 1.00 1.00 1.00 2401 by 0.92 0.91 0.92 4777 ec 0.93 0.97 0.95 5000 ee 0.77 0.79 0.78 5000 ge 0.87 0.85 0.86 4123 ht 0.97 0.99 0.98 5000 kg 0.97 0.97 0.97 5000 kz 0.87 0.81 0.84 5000 lt 0.84 0.85 0.84 5000 lv 0.82 0.80 0.81 5000 md 0.92 0.93 0.92 5000 pw 0.96 0.96 0.96 2888 ru 0.84 0.83 0.83 5000 si 1.00 1.00 1.00 2339 so 0.86 0.80 0.83 3397 tj 0.90 0.93 0.92 5000 ua 0.88 0.89 0.89 5000 uz 0.82 0.82 0.82 5000 avg / total 0.89 0.89 0.89 84925 Reducing feature vectors. (398969, 14671) (84925, 14671) (398969, 14634) (84925, 14634) STARTING UNMASKING ROUND 16 rus cc cxg2 16 precision recall f1-score support az 0.82 0.84 0.83 5000 bg 1.00 1.00 1.00 2401 by 0.93 0.90 0.91 4777 ec 0.94 0.97 0.95 5000 ee 0.77 0.79 0.78 5000 ge 0.87 0.85 0.86 4123 ht 0.97 0.99 0.98 5000 kg 0.96 0.97 0.97 5000 kz 0.87 0.80 0.83 5000 lt 0.84 0.85 0.84 5000 lv 0.81 0.80 0.81 5000 md 0.92 0.93 0.92 5000 pw 0.96 0.96 0.96 2888 ru 0.84 0.82 0.83 5000 si 1.00 1.00 1.00 2339 so 0.86 0.80 0.83 3397 tj 0.90 0.93 0.91 5000 ua 0.87 0.89 0.88 5000 uz 0.82 0.82 0.82 5000 avg / total 0.88 0.88 0.88 84925 Reducing feature vectors. (398969, 14634) (84925, 14634) (398969, 14598) (84925, 14598) STARTING UNMASKING ROUND 17 rus cc cxg2 17 precision recall f1-score support az 0.82 0.84 0.83 5000 bg 1.00 1.00 1.00 2401 by 0.92 0.90 0.91 4777 ec 0.93 0.97 0.95 5000 ee 0.77 0.79 0.78 5000 ge 0.87 0.85 0.86 4123 ht 0.97 0.99 0.98 5000 kg 0.97 0.97 0.97 5000 kz 0.86 0.79 0.82 5000 lt 0.83 0.84 0.84 5000 lv 0.81 0.80 0.81 5000 md 0.91 0.92 0.92 5000 pw 0.96 0.96 0.96 2888 ru 0.83 0.82 0.83 5000 si 1.00 1.00 1.00 2339 so 0.86 0.80 0.83 3397 tj 0.89 0.93 0.91 5000 ua 0.87 0.89 0.88 5000 uz 0.81 0.82 0.82 5000 avg / total 0.88 0.88 0.88 84925 Reducing feature vectors. (398969, 14598) (84925, 14598) (398969, 14563) (84925, 14563) STARTING UNMASKING ROUND 18 rus cc cxg2 18 precision recall f1-score support az 0.83 0.84 0.83 5000 bg 1.00 1.00 1.00 2401 by 0.92 0.90 0.91 4777 ec 0.93 0.97 0.95 5000 ee 0.76 0.78 0.77 5000 ge 0.87 0.85 0.86 4123 ht 0.97 0.99 0.98 5000 kg 0.96 0.97 0.97 5000 kz 0.85 0.79 0.82 5000 lt 0.83 0.84 0.83 5000 lv 0.81 0.79 0.80 5000 md 0.91 0.92 0.92 5000 pw 0.96 0.96 0.96 2888 ru 0.83 0.82 0.83 5000 si 1.00 1.00 1.00 2339 so 0.86 0.80 0.83 3397 tj 0.89 0.93 0.91 5000 ua 0.87 0.89 0.88 5000 uz 0.81 0.82 0.81 5000 avg / total 0.88 0.88 0.88 84925 Reducing feature vectors. (398969, 14563) (84925, 14563) (398969, 14525) (84925, 14525) STARTING UNMASKING ROUND 19 rus cc cxg2 19 precision recall f1-score support az 0.82 0.83 0.83 5000 bg 1.00 1.00 1.00 2401 by 0.91 0.89 0.90 4777 ec 0.93 0.97 0.95 5000 ee 0.76 0.79 0.77 5000 ge 0.86 0.84 0.85 4123 ht 0.97 0.98 0.98 5000 kg 0.96 0.97 0.97 5000 kz 0.84 0.77 0.81 5000 lt 0.83 0.84 0.83 5000 lv 0.81 0.79 0.80 5000 md 0.91 0.92 0.91 5000 pw 0.96 0.96 0.96 2888 ru 0.83 0.82 0.82 5000 si 0.99 1.00 1.00 2339 so 0.86 0.80 0.83 3397 tj 0.89 0.93 0.91 5000 ua 0.87 0.88 0.88 5000 uz 0.81 0.81 0.81 5000 avg / total 0.88 0.88 0.88 84925 Reducing feature vectors. (398969, 14525) (84925, 14525) (398969, 14490) (84925, 14490) STARTING UNMASKING ROUND 20 rus cc cxg2 20 precision recall f1-score support az 0.82 0.83 0.83 5000 bg 1.00 1.00 1.00 2401 by 0.91 0.89 0.90 4777 ec 0.93 0.97 0.95 5000 ee 0.76 0.79 0.77 5000 ge 0.86 0.84 0.85 4123 ht 0.97 0.98 0.98 5000 kg 0.96 0.97 0.97 5000 kz 0.84 0.77 0.80 5000 lt 0.82 0.84 0.83 5000 lv 0.80 0.79 0.79 5000 md 0.91 0.92 0.91 5000 pw 0.96 0.96 0.96 2888 ru 0.83 0.81 0.82 5000 si 0.99 1.00 1.00 2339 so 0.85 0.80 0.82 3397 tj 0.89 0.93 0.91 5000 ua 0.87 0.88 0.87 5000 uz 0.81 0.81 0.81 5000 avg / total 0.88 0.88 0.88 84925 Reducing feature vectors. (398969, 14490) (84925, 14490) (398969, 14452) (84925, 14452) STARTING UNMASKING ROUND 21 rus cc cxg2 21 precision recall f1-score support az 0.81 0.83 0.82 5000 bg 1.00 1.00 1.00 2401 by 0.91 0.89 0.90 4777 ec 0.93 0.97 0.95 5000 ee 0.76 0.78 0.77 5000 ge 0.86 0.84 0.85 4123 ht 0.97 0.98 0.98 5000 kg 0.96 0.97 0.96 5000 kz 0.84 0.76 0.80 5000 lt 0.82 0.84 0.83 5000 lv 0.80 0.78 0.79 5000 md 0.91 0.92 0.91 5000 pw 0.96 0.96 0.96 2888 ru 0.83 0.81 0.82 5000 si 0.99 1.00 1.00 2339 so 0.86 0.80 0.83 3397 tj 0.89 0.93 0.91 5000 ua 0.86 0.88 0.87 5000 uz 0.81 0.81 0.81 5000 avg / total 0.87 0.87 0.87 84925 Reducing feature vectors. (398969, 14452) (84925, 14452) (398969, 14415) (84925, 14415) STARTING UNMASKING ROUND 22 rus cc cxg2 22 precision recall f1-score support az 0.80 0.82 0.81 5000 bg 0.99 1.00 1.00 2401 by 0.90 0.88 0.89 4777 ec 0.93 0.97 0.95 5000 ee 0.76 0.78 0.77 5000 ge 0.86 0.83 0.85 4123 ht 0.97 0.98 0.98 5000 kg 0.96 0.96 0.96 5000 kz 0.83 0.76 0.80 5000 lt 0.82 0.83 0.82 5000 lv 0.80 0.78 0.79 5000 md 0.90 0.92 0.91 5000 pw 0.95 0.95 0.95 2888 ru 0.82 0.81 0.82 5000 si 0.99 1.00 1.00 2339 so 0.85 0.79 0.82 3397 tj 0.89 0.93 0.91 5000 ua 0.84 0.86 0.85 5000 uz 0.81 0.81 0.81 5000 avg / total 0.87 0.87 0.87 84925 Reducing feature vectors. (398969, 14415) (84925, 14415) (398969, 14379) (84925, 14379) STARTING UNMASKING ROUND 23 rus cc cxg2 23 precision recall f1-score support az 0.80 0.82 0.81 5000 bg 1.00 1.00 1.00 2401 by 0.90 0.88 0.89 4777 ec 0.92 0.97 0.95 5000 ee 0.75 0.78 0.76 5000 ge 0.86 0.83 0.84 4123 ht 0.97 0.98 0.98 5000 kg 0.96 0.96 0.96 5000 kz 0.83 0.76 0.79 5000 lt 0.81 0.83 0.82 5000 lv 0.80 0.78 0.79 5000 md 0.91 0.92 0.91 5000 pw 0.95 0.95 0.95 2888 ru 0.82 0.81 0.81 5000 si 0.99 1.00 0.99 2339 so 0.86 0.78 0.82 3397 tj 0.89 0.92 0.90 5000 ua 0.84 0.86 0.85 5000 uz 0.81 0.81 0.81 5000 avg / total 0.87 0.87 0.87 84925 Reducing feature vectors. (398969, 14379) (84925, 14379) (398969, 14342) (84925, 14342) STARTING UNMASKING ROUND 24 rus cc cxg2 24 precision recall f1-score support az 0.80 0.82 0.81 5000 bg 0.99 1.00 1.00 2401 by 0.90 0.88 0.89 4777 ec 0.92 0.97 0.95 5000 ee 0.75 0.78 0.76 5000 ge 0.85 0.83 0.84 4123 ht 0.97 0.98 0.98 5000 kg 0.96 0.96 0.96 5000 kz 0.83 0.76 0.79 5000 lt 0.81 0.83 0.82 5000 lv 0.80 0.78 0.79 5000 md 0.90 0.92 0.91 5000 pw 0.95 0.95 0.95 2888 ru 0.82 0.81 0.81 5000 si 0.99 0.99 0.99 2339 so 0.85 0.78 0.82 3397 tj 0.89 0.92 0.90 5000 ua 0.83 0.85 0.84 5000 uz 0.81 0.81 0.81 5000 avg / total 0.87 0.87 0.87 84925 Reducing feature vectors. (398969, 14342) (84925, 14342) (398969, 14305) (84925, 14305) STARTING UNMASKING ROUND 25 rus cc cxg2 25 precision recall f1-score support az 0.80 0.82 0.81 5000 bg 1.00 1.00 1.00 2401 by 0.90 0.88 0.89 4777 ec 0.92 0.97 0.95 5000 ee 0.76 0.77 0.76 5000 ge 0.85 0.84 0.84 4123 ht 0.97 0.99 0.98 5000 kg 0.96 0.96 0.96 5000 kz 0.83 0.76 0.79 5000 lt 0.81 0.83 0.82 5000 lv 0.79 0.78 0.78 5000 md 0.90 0.91 0.91 5000 pw 0.95 0.95 0.95 2888 ru 0.82 0.80 0.81 5000 si 0.99 1.00 0.99 2339 so 0.85 0.78 0.82 3397 tj 0.88 0.93 0.90 5000 ua 0.83 0.85 0.84 5000 uz 0.80 0.80 0.80 5000 avg / total 0.87 0.87 0.87 84925 Reducing feature vectors. (398969, 14305) (84925, 14305) (398969, 14268) (84925, 14268) STARTING UNMASKING ROUND 26 rus cc cxg2 26 precision recall f1-score support az 0.80 0.82 0.81 5000 bg 1.00 1.00 1.00 2401 by 0.90 0.88 0.89 4777 ec 0.92 0.97 0.95 5000 ee 0.75 0.77 0.76 5000 ge 0.85 0.83 0.84 4123 ht 0.97 0.98 0.97 5000 kg 0.96 0.96 0.96 5000 kz 0.83 0.75 0.79 5000 lt 0.81 0.83 0.82 5000 lv 0.79 0.77 0.78 5000 md 0.90 0.91 0.91 5000 pw 0.95 0.95 0.95 2888 ru 0.82 0.80 0.81 5000 si 0.99 1.00 0.99 2339 so 0.85 0.78 0.81 3397 tj 0.88 0.92 0.90 5000 ua 0.83 0.85 0.84 5000 uz 0.80 0.80 0.80 5000 avg / total 0.86 0.87 0.86 84925 Reducing feature vectors. (398969, 14268) (84925, 14268) (398969, 14231) (84925, 14231) STARTING UNMASKING ROUND 27 rus cc cxg2 27 precision recall f1-score support az 0.79 0.81 0.80 5000 bg 1.00 1.00 1.00 2401 by 0.90 0.87 0.89 4777 ec 0.92 0.97 0.94 5000 ee 0.75 0.77 0.76 5000 ge 0.85 0.83 0.84 4123 ht 0.96 0.98 0.97 5000 kg 0.96 0.96 0.96 5000 kz 0.83 0.75 0.79 5000 lt 0.81 0.82 0.81 5000 lv 0.79 0.77 0.78 5000 md 0.90 0.91 0.91 5000 pw 0.95 0.95 0.95 2888 ru 0.81 0.80 0.81 5000 si 0.99 1.00 0.99 2339 so 0.85 0.78 0.81 3397 tj 0.88 0.92 0.90 5000 ua 0.83 0.84 0.84 5000 uz 0.80 0.80 0.80 5000 avg / total 0.86 0.86 0.86 84925 Reducing feature vectors. (398969, 14231) (84925, 14231) (398969, 14194) (84925, 14194) STARTING UNMASKING ROUND 28 rus cc cxg2 28 precision recall f1-score support az 0.79 0.81 0.80 5000 bg 1.00 1.00 1.00 2401 by 0.90 0.87 0.88 4777 ec 0.92 0.97 0.95 5000 ee 0.75 0.77 0.76 5000 ge 0.84 0.82 0.83 4123 ht 0.96 0.98 0.97 5000 kg 0.95 0.96 0.96 5000 kz 0.82 0.75 0.78 5000 lt 0.80 0.82 0.81 5000 lv 0.80 0.76 0.78 5000 md 0.89 0.91 0.90 5000 pw 0.95 0.95 0.95 2888 ru 0.81 0.80 0.80 5000 si 0.99 1.00 0.99 2339 so 0.85 0.78 0.81 3397 tj 0.88 0.92 0.90 5000 ua 0.82 0.84 0.83 5000 uz 0.80 0.80 0.80 5000 avg / total 0.86 0.86 0.86 84925 Reducing feature vectors. (398969, 14194) (84925, 14194) (398969, 14157) (84925, 14157) STARTING UNMASKING ROUND 29 rus cc cxg2 29 precision recall f1-score support az 0.79 0.81 0.80 5000 bg 1.00 1.00 1.00 2401 by 0.90 0.87 0.88 4777 ec 0.92 0.97 0.94 5000 ee 0.75 0.77 0.76 5000 ge 0.85 0.82 0.83 4123 ht 0.96 0.98 0.97 5000 kg 0.95 0.96 0.96 5000 kz 0.82 0.75 0.78 5000 lt 0.80 0.82 0.81 5000 lv 0.79 0.76 0.78 5000 md 0.89 0.91 0.90 5000 pw 0.95 0.95 0.95 2888 ru 0.80 0.80 0.80 5000 si 0.99 1.00 0.99 2339 so 0.84 0.78 0.81 3397 tj 0.88 0.92 0.90 5000 ua 0.82 0.84 0.83 5000 uz 0.79 0.80 0.80 5000 avg / total 0.86 0.86 0.86 84925 Reducing feature vectors. (398969, 14157) (84925, 14157) (398969, 14127) (84925, 14127) STARTING UNMASKING ROUND 30 rus cc cxg2 30 precision recall f1-score support az 0.79 0.81 0.80 5000 bg 1.00 1.00 1.00 2401 by 0.90 0.87 0.88 4777 ec 0.92 0.97 0.94 5000 ee 0.75 0.76 0.75 5000 ge 0.84 0.82 0.83 4123 ht 0.96 0.98 0.97 5000 kg 0.95 0.96 0.96 5000 kz 0.82 0.75 0.78 5000 lt 0.79 0.81 0.80 5000 lv 0.79 0.76 0.78 5000 md 0.90 0.91 0.90 5000 pw 0.95 0.95 0.95 2888 ru 0.80 0.80 0.80 5000 si 0.99 1.00 0.99 2339 so 0.84 0.78 0.81 3397 tj 0.87 0.92 0.89 5000 ua 0.82 0.83 0.82 5000 uz 0.79 0.79 0.79 5000 avg / total 0.86 0.86 0.86 84925 Reducing feature vectors. (398969, 14127) (84925, 14127) (398969, 14089) (84925, 14089) STARTING UNMASKING ROUND 31 rus cc cxg2 31 precision recall f1-score support az 0.78 0.80 0.79 5000 bg 1.00 1.00 1.00 2401 by 0.89 0.87 0.88 4777 ec 0.92 0.97 0.94 5000 ee 0.74 0.76 0.75 5000 ge 0.84 0.81 0.83 4123 ht 0.96 0.98 0.97 5000 kg 0.95 0.96 0.96 5000 kz 0.82 0.74 0.78 5000 lt 0.79 0.81 0.80 5000 lv 0.79 0.76 0.77 5000 md 0.89 0.91 0.90 5000 pw 0.95 0.95 0.95 2888 ru 0.80 0.79 0.80 5000 si 0.99 1.00 0.99 2339 so 0.85 0.78 0.81 3397 tj 0.87 0.91 0.89 5000 ua 0.81 0.83 0.82 5000 uz 0.79 0.79 0.79 5000 avg / total 0.86 0.86 0.86 84925 Reducing feature vectors. (398969, 14089) (84925, 14089) (398969, 14054) (84925, 14054) STARTING UNMASKING ROUND 32 rus cc cxg2 32 precision recall f1-score support az 0.79 0.80 0.79 5000 bg 1.00 1.00 1.00 2401 by 0.89 0.87 0.88 4777 ec 0.92 0.97 0.94 5000 ee 0.74 0.76 0.75 5000 ge 0.84 0.81 0.82 4123 ht 0.96 0.98 0.97 5000 kg 0.95 0.96 0.96 5000 kz 0.81 0.74 0.78 5000 lt 0.79 0.80 0.80 5000 lv 0.78 0.76 0.77 5000 md 0.89 0.90 0.90 5000 pw 0.94 0.95 0.95 2888 ru 0.80 0.79 0.80 5000 si 0.99 1.00 0.99 2339 so 0.84 0.78 0.81 3397 tj 0.87 0.91 0.89 5000 ua 0.81 0.82 0.81 5000 uz 0.79 0.79 0.79 5000 avg / total 0.85 0.85 0.85 84925 Reducing feature vectors. (398969, 14054) (84925, 14054) (398969, 14019) (84925, 14019) STARTING UNMASKING ROUND 33 rus cc cxg2 33 precision recall f1-score support az 0.78 0.80 0.79 5000 bg 1.00 1.00 1.00 2401 by 0.89 0.87 0.88 4777 ec 0.92 0.97 0.94 5000 ee 0.74 0.76 0.75 5000 ge 0.84 0.81 0.82 4123 ht 0.96 0.98 0.97 5000 kg 0.95 0.96 0.95 5000 kz 0.81 0.74 0.77 5000 lt 0.78 0.80 0.79 5000 lv 0.78 0.76 0.77 5000 md 0.88 0.90 0.89 5000 pw 0.95 0.95 0.95 2888 ru 0.79 0.79 0.79 5000 si 0.99 1.00 0.99 2339 so 0.84 0.77 0.81 3397 tj 0.87 0.91 0.89 5000 ua 0.81 0.82 0.81 5000 uz 0.78 0.79 0.79 5000 avg / total 0.85 0.85 0.85 84925 Reducing feature vectors. (398969, 14019) (84925, 14019) (398969, 13981) (84925, 13981) STARTING UNMASKING ROUND 34 rus cc cxg2 34 precision recall f1-score support az 0.78 0.80 0.79 5000 bg 1.00 1.00 1.00 2401 by 0.89 0.86 0.88 4777 ec 0.92 0.97 0.94 5000 ee 0.74 0.76 0.75 5000 ge 0.83 0.81 0.82 4123 ht 0.96 0.98 0.97 5000 kg 0.95 0.96 0.95 5000 kz 0.81 0.73 0.77 5000 lt 0.78 0.80 0.79 5000 lv 0.78 0.75 0.77 5000 md 0.88 0.90 0.89 5000 pw 0.94 0.95 0.95 2888 ru 0.79 0.79 0.79 5000 si 0.99 1.00 0.99 2339 so 0.84 0.77 0.80 3397 tj 0.87 0.91 0.89 5000 ua 0.80 0.82 0.81 5000 uz 0.78 0.79 0.78 5000 avg / total 0.85 0.85 0.85 84925 Reducing feature vectors. (398969, 13981) (84925, 13981) (398969, 13948) (84925, 13948) STARTING UNMASKING ROUND 35 rus cc cxg2 35 precision recall f1-score support az 0.78 0.80 0.79 5000 bg 0.99 1.00 1.00 2401 by 0.89 0.86 0.87 4777 ec 0.92 0.97 0.94 5000 ee 0.74 0.76 0.75 5000 ge 0.83 0.81 0.82 4123 ht 0.96 0.98 0.97 5000 kg 0.95 0.96 0.95 5000 kz 0.81 0.73 0.77 5000 lt 0.78 0.80 0.79 5000 lv 0.77 0.75 0.76 5000 md 0.88 0.90 0.89 5000 pw 0.95 0.94 0.95 2888 ru 0.79 0.78 0.78 5000 si 0.99 1.00 0.99 2339 so 0.84 0.77 0.80 3397 tj 0.87 0.91 0.89 5000 ua 0.80 0.81 0.81 5000 uz 0.78 0.78 0.78 5000 avg / total 0.85 0.85 0.85 84925 Reducing feature vectors. (398969, 13948) (84925, 13948) (398969, 13910) (84925, 13910) STARTING UNMASKING ROUND 36 rus cc cxg2 36 precision recall f1-score support az 0.78 0.80 0.79 5000 bg 0.99 1.00 1.00 2401 by 0.89 0.86 0.87 4777 ec 0.92 0.97 0.94 5000 ee 0.74 0.75 0.75 5000 ge 0.83 0.80 0.82 4123 ht 0.96 0.98 0.97 5000 kg 0.95 0.95 0.95 5000 kz 0.80 0.73 0.77 5000 lt 0.77 0.80 0.78 5000 lv 0.78 0.75 0.76 5000 md 0.88 0.90 0.89 5000 pw 0.94 0.95 0.94 2888 ru 0.79 0.78 0.78 5000 si 0.99 1.00 0.99 2339 so 0.84 0.76 0.80 3397 tj 0.87 0.91 0.89 5000 ua 0.80 0.81 0.80 5000 uz 0.78 0.78 0.78 5000 avg / total 0.85 0.85 0.85 84925 Reducing feature vectors. (398969, 13910) (84925, 13910) (398969, 13872) (84925, 13872) STARTING UNMASKING ROUND 37 rus cc cxg2 37 precision recall f1-score support az 0.77 0.79 0.78 5000 bg 0.99 1.00 1.00 2401 by 0.88 0.86 0.87 4777 ec 0.92 0.96 0.94 5000 ee 0.74 0.75 0.74 5000 ge 0.83 0.80 0.81 4123 ht 0.96 0.98 0.97 5000 kg 0.94 0.95 0.95 5000 kz 0.80 0.73 0.76 5000 lt 0.77 0.79 0.78 5000 lv 0.77 0.75 0.76 5000 md 0.88 0.90 0.89 5000 pw 0.94 0.95 0.94 2888 ru 0.79 0.77 0.78 5000 si 0.99 0.99 0.99 2339 so 0.83 0.76 0.79 3397 tj 0.87 0.90 0.88 5000 ua 0.80 0.81 0.80 5000 uz 0.77 0.78 0.78 5000 avg / total 0.84 0.85 0.84 84925 Reducing feature vectors. (398969, 13872) (84925, 13872) (398969, 13835) (84925, 13835) STARTING UNMASKING ROUND 38 rus cc cxg2 38 precision recall f1-score support az 0.77 0.79 0.78 5000 bg 0.99 1.00 1.00 2401 by 0.88 0.85 0.87 4777 ec 0.92 0.96 0.94 5000 ee 0.74 0.75 0.74 5000 ge 0.83 0.80 0.81 4123 ht 0.96 0.98 0.97 5000 kg 0.94 0.96 0.95 5000 kz 0.80 0.73 0.76 5000 lt 0.77 0.79 0.78 5000 lv 0.77 0.74 0.76 5000 md 0.88 0.90 0.89 5000 pw 0.94 0.94 0.94 2888 ru 0.79 0.77 0.78 5000 si 0.99 0.99 0.99 2339 so 0.83 0.75 0.79 3397 tj 0.87 0.90 0.88 5000 ua 0.79 0.81 0.80 5000 uz 0.77 0.78 0.78 5000 avg / total 0.84 0.84 0.84 84925 Reducing feature vectors. (398969, 13835) (84925, 13835) (398969, 13798) (84925, 13798) STARTING UNMASKING ROUND 39 rus cc cxg2 39 precision recall f1-score support az 0.77 0.79 0.78 5000 bg 0.99 1.00 1.00 2401 by 0.88 0.85 0.87 4777 ec 0.91 0.96 0.94 5000 ee 0.73 0.75 0.74 5000 ge 0.83 0.79 0.81 4123 ht 0.96 0.98 0.97 5000 kg 0.94 0.95 0.95 5000 kz 0.80 0.73 0.76 5000 lt 0.77 0.79 0.78 5000 lv 0.77 0.74 0.76 5000 md 0.88 0.89 0.89 5000 pw 0.94 0.94 0.94 2888 ru 0.78 0.77 0.78 5000 si 0.99 0.99 0.99 2339 so 0.83 0.75 0.79 3397 tj 0.86 0.90 0.88 5000 ua 0.79 0.80 0.80 5000 uz 0.77 0.78 0.77 5000 avg / total 0.84 0.84 0.84 84925 Reducing feature vectors. (398969, 13798) (84925, 13798) (398969, 13760) (84925, 13760) STARTING UNMASKING ROUND 40 rus cc cxg2 40 precision recall f1-score support az 0.76 0.79 0.77 5000 bg 0.99 1.00 1.00 2401 by 0.88 0.85 0.87 4777 ec 0.91 0.96 0.94 5000 ee 0.73 0.74 0.74 5000 ge 0.83 0.79 0.81 4123 ht 0.96 0.98 0.97 5000 kg 0.94 0.95 0.95 5000 kz 0.80 0.73 0.76 5000 lt 0.77 0.78 0.78 5000 lv 0.77 0.74 0.76 5000 md 0.88 0.89 0.88 5000 pw 0.94 0.94 0.94 2888 ru 0.78 0.77 0.78 5000 si 0.99 0.99 0.99 2339 so 0.82 0.75 0.79 3397 tj 0.86 0.90 0.88 5000 ua 0.78 0.80 0.79 5000 uz 0.77 0.78 0.77 5000 avg / total 0.84 0.84 0.84 84925 Reducing feature vectors. (398969, 13760) (84925, 13760) (398969, 13723) (84925, 13723) STARTING UNMASKING ROUND 41 rus cc cxg2 41 precision recall f1-score support az 0.76 0.79 0.78 5000 bg 0.99 1.00 1.00 2401 by 0.88 0.85 0.87 4777 ec 0.91 0.96 0.94 5000 ee 0.73 0.74 0.74 5000 ge 0.82 0.79 0.81 4123 ht 0.96 0.98 0.97 5000 kg 0.94 0.96 0.95 5000 kz 0.80 0.73 0.76 5000 lt 0.77 0.78 0.78 5000 lv 0.77 0.74 0.76 5000 md 0.87 0.89 0.88 5000 pw 0.94 0.94 0.94 2888 ru 0.78 0.77 0.77 5000 si 0.99 0.99 0.99 2339 so 0.82 0.75 0.78 3397 tj 0.86 0.90 0.88 5000 ua 0.78 0.80 0.79 5000 uz 0.77 0.78 0.77 5000 avg / total 0.84 0.84 0.84 84925 Reducing feature vectors. (398969, 13723) (84925, 13723) (398969, 13686) (84925, 13686) STARTING UNMASKING ROUND 42 rus cc cxg2 42 precision recall f1-score support az 0.76 0.79 0.77 5000 bg 0.99 1.00 1.00 2401 by 0.87 0.85 0.86 4777 ec 0.91 0.96 0.94 5000 ee 0.73 0.74 0.74 5000 ge 0.82 0.79 0.80 4123 ht 0.96 0.98 0.97 5000 kg 0.94 0.95 0.94 5000 kz 0.80 0.73 0.76 5000 lt 0.77 0.78 0.77 5000 lv 0.77 0.74 0.76 5000 md 0.87 0.89 0.88 5000 pw 0.94 0.94 0.94 2888 ru 0.78 0.77 0.77 5000 si 0.99 0.99 0.99 2339 so 0.82 0.74 0.78 3397 tj 0.86 0.90 0.88 5000 ua 0.78 0.80 0.79 5000 uz 0.77 0.78 0.77 5000 avg / total 0.84 0.84 0.84 84925 Reducing feature vectors. (398969, 13686) (84925, 13686) (398969, 13652) (84925, 13652) STARTING UNMASKING ROUND 43 rus cc cxg2 43 precision recall f1-score support az 0.76 0.78 0.77 5000 bg 0.99 1.00 0.99 2401 by 0.87 0.85 0.86 4777 ec 0.91 0.96 0.94 5000 ee 0.73 0.74 0.74 5000 ge 0.82 0.79 0.80 4123 ht 0.96 0.98 0.97 5000 kg 0.94 0.95 0.94 5000 kz 0.80 0.72 0.76 5000 lt 0.77 0.78 0.77 5000 lv 0.77 0.74 0.75 5000 md 0.87 0.89 0.88 5000 pw 0.93 0.94 0.94 2888 ru 0.78 0.77 0.77 5000 si 0.99 0.99 0.99 2339 so 0.83 0.75 0.78 3397 tj 0.86 0.90 0.88 5000 ua 0.78 0.79 0.78 5000 uz 0.76 0.78 0.77 5000 avg / total 0.84 0.84 0.84 84925 Reducing feature vectors. (398969, 13652) (84925, 13652) (398969, 13619) (84925, 13619) STARTING UNMASKING ROUND 44 rus cc cxg2 44 precision recall f1-score support az 0.76 0.78 0.77 5000 bg 0.99 1.00 0.99 2401 by 0.87 0.84 0.86 4777 ec 0.91 0.96 0.94 5000 ee 0.73 0.74 0.74 5000 ge 0.82 0.79 0.80 4123 ht 0.96 0.98 0.97 5000 kg 0.94 0.95 0.94 5000 kz 0.79 0.72 0.75 5000 lt 0.77 0.78 0.77 5000 lv 0.76 0.73 0.75 5000 md 0.87 0.89 0.88 5000 pw 0.94 0.94 0.94 2888 ru 0.78 0.76 0.77 5000 si 0.99 1.00 0.99 2339 so 0.82 0.74 0.78 3397 tj 0.85 0.90 0.88 5000 ua 0.78 0.79 0.78 5000 uz 0.76 0.77 0.77 5000 avg / total 0.84 0.84 0.84 84925 Reducing feature vectors. (398969, 13619) (84925, 13619) (398969, 13581) (84925, 13581) STARTING UNMASKING ROUND 45 rus cc cxg2 45 precision recall f1-score support az 0.76 0.78 0.77 5000 bg 0.99 1.00 1.00 2401 by 0.86 0.83 0.85 4777 ec 0.91 0.96 0.94 5000 ee 0.73 0.74 0.73 5000 ge 0.82 0.79 0.80 4123 ht 0.96 0.98 0.97 5000 kg 0.93 0.95 0.94 5000 kz 0.79 0.71 0.75 5000 lt 0.77 0.78 0.77 5000 lv 0.76 0.73 0.75 5000 md 0.86 0.89 0.88 5000 pw 0.93 0.93 0.93 2888 ru 0.77 0.76 0.77 5000 si 0.99 1.00 0.99 2339 so 0.82 0.74 0.78 3397 tj 0.85 0.90 0.87 5000 ua 0.77 0.79 0.78 5000 uz 0.75 0.76 0.76 5000 avg / total 0.83 0.83 0.83 84925 Reducing feature vectors. (398969, 13581) (84925, 13581) (398969, 13543) (84925, 13543) STARTING UNMASKING ROUND 46 rus cc cxg2 46 precision recall f1-score support az 0.76 0.78 0.77 5000 bg 0.99 1.00 1.00 2401 by 0.86 0.83 0.84 4777 ec 0.91 0.96 0.94 5000 ee 0.72 0.74 0.73 5000 ge 0.82 0.79 0.80 4123 ht 0.96 0.98 0.97 5000 kg 0.93 0.95 0.94 5000 kz 0.78 0.71 0.74 5000 lt 0.76 0.78 0.77 5000 lv 0.76 0.73 0.74 5000 md 0.87 0.88 0.87 5000 pw 0.93 0.93 0.93 2888 ru 0.77 0.76 0.76 5000 si 0.99 1.00 0.99 2339 so 0.81 0.74 0.78 3397 tj 0.85 0.90 0.87 5000 ua 0.77 0.79 0.78 5000 uz 0.75 0.76 0.76 5000 avg / total 0.83 0.83 0.83 84925 Reducing feature vectors. (398969, 13543) (84925, 13543) (398969, 13505) (84925, 13505) STARTING UNMASKING ROUND 47 rus cc cxg2 47 precision recall f1-score support az 0.75 0.78 0.77 5000 bg 0.99 1.00 0.99 2401 by 0.86 0.82 0.84 4777 ec 0.91 0.96 0.94 5000 ee 0.72 0.74 0.73 5000 ge 0.81 0.78 0.80 4123 ht 0.96 0.98 0.97 5000 kg 0.94 0.95 0.94 5000 kz 0.78 0.71 0.74 5000 lt 0.76 0.78 0.77 5000 lv 0.75 0.73 0.74 5000 md 0.86 0.88 0.87 5000 pw 0.93 0.93 0.93 2888 ru 0.77 0.75 0.76 5000 si 0.99 0.99 0.99 2339 so 0.82 0.74 0.78 3397 tj 0.85 0.89 0.87 5000 ua 0.77 0.78 0.77 5000 uz 0.75 0.76 0.75 5000 avg / total 0.83 0.83 0.83 84925 Reducing feature vectors. (398969, 13505) (84925, 13505) (398969, 13467) (84925, 13467) STARTING UNMASKING ROUND 48 rus cc cxg2 48 precision recall f1-score support az 0.75 0.78 0.77 5000 bg 0.99 1.00 0.99 2401 by 0.86 0.82 0.84 4777 ec 0.91 0.96 0.94 5000 ee 0.72 0.74 0.73 5000 ge 0.81 0.78 0.79 4123 ht 0.96 0.98 0.97 5000 kg 0.94 0.95 0.94 5000 kz 0.78 0.70 0.74 5000 lt 0.76 0.77 0.76 5000 lv 0.75 0.73 0.74 5000 md 0.86 0.88 0.87 5000 pw 0.93 0.93 0.93 2888 ru 0.77 0.75 0.76 5000 si 0.99 0.99 0.99 2339 so 0.82 0.74 0.78 3397 tj 0.85 0.89 0.87 5000 ua 0.77 0.78 0.77 5000 uz 0.74 0.76 0.75 5000 avg / total 0.83 0.83 0.83 84925 Reducing feature vectors. (398969, 13467) (84925, 13467) (398969, 13431) (84925, 13431) STARTING UNMASKING ROUND 49 rus cc cxg2 49 precision recall f1-score support az 0.75 0.78 0.76 5000 bg 0.99 1.00 0.99 2401 by 0.85 0.82 0.84 4777 ec 0.91 0.96 0.94 5000 ee 0.72 0.74 0.73 5000 ge 0.81 0.78 0.79 4123 ht 0.96 0.98 0.97 5000 kg 0.93 0.95 0.94 5000 kz 0.78 0.71 0.74 5000 lt 0.75 0.77 0.76 5000 lv 0.75 0.72 0.74 5000 md 0.86 0.88 0.87 5000 pw 0.93 0.93 0.93 2888 ru 0.77 0.75 0.76 5000 si 0.99 0.99 0.99 2339 so 0.82 0.74 0.77 3397 tj 0.85 0.89 0.87 5000 ua 0.76 0.78 0.77 5000 uz 0.74 0.75 0.75 5000 avg / total 0.83 0.83 0.83 84925 Reducing feature vectors. (398969, 13431) (84925, 13431) (398969, 13393) (84925, 13393) STARTING UNMASKING ROUND 50 rus cc cxg2 50 precision recall f1-score support az 0.75 0.77 0.76 5000 bg 0.99 1.00 0.99 2401 by 0.85 0.82 0.84 4777 ec 0.91 0.96 0.94 5000 ee 0.72 0.73 0.73 5000 ge 0.81 0.78 0.79 4123 ht 0.96 0.98 0.97 5000 kg 0.93 0.95 0.94 5000 kz 0.78 0.70 0.74 5000 lt 0.76 0.77 0.76 5000 lv 0.75 0.72 0.74 5000 md 0.86 0.88 0.87 5000 pw 0.93 0.93 0.93 2888 ru 0.77 0.75 0.76 5000 si 0.99 1.00 0.99 2339 so 0.81 0.74 0.77 3397 tj 0.85 0.89 0.87 5000 ua 0.76 0.78 0.77 5000 uz 0.74 0.75 0.75 5000 avg / total 0.83 0.83 0.83 84925 Reducing feature vectors. (398969, 13393) (84925, 13393) (398969, 13357) (84925, 13357) STARTING UNMASKING ROUND 51 rus cc cxg2 51 precision recall f1-score support az 0.75 0.77 0.76 5000 bg 0.99 1.00 1.00 2401 by 0.85 0.82 0.83 4777 ec 0.91 0.96 0.94 5000 ee 0.72 0.73 0.72 5000 ge 0.81 0.78 0.79 4123 ht 0.96 0.98 0.97 5000 kg 0.93 0.95 0.94 5000 kz 0.77 0.70 0.73 5000 lt 0.76 0.77 0.76 5000 lv 0.74 0.72 0.73 5000 md 0.85 0.87 0.86 5000 pw 0.93 0.93 0.93 2888 ru 0.76 0.75 0.76 5000 si 0.99 1.00 0.99 2339 so 0.81 0.74 0.77 3397 tj 0.85 0.89 0.87 5000 ua 0.76 0.77 0.77 5000 uz 0.74 0.75 0.75 5000 avg / total 0.83 0.83 0.83 84925 Reducing feature vectors. (398969, 13357) (84925, 13357) (398969, 13320) (84925, 13320) STARTING UNMASKING ROUND 52 rus cc cxg2 52 precision recall f1-score support az 0.75 0.77 0.76 5000 bg 0.99 1.00 0.99 2401 by 0.85 0.82 0.83 4777 ec 0.91 0.96 0.94 5000 ee 0.72 0.73 0.72 5000 ge 0.80 0.77 0.79 4123 ht 0.95 0.98 0.97 5000 kg 0.93 0.95 0.94 5000 kz 0.77 0.69 0.73 5000 lt 0.75 0.77 0.76 5000 lv 0.74 0.72 0.73 5000 md 0.85 0.87 0.86 5000 pw 0.93 0.93 0.93 2888 ru 0.76 0.75 0.76 5000 si 0.99 1.00 0.99 2339 so 0.81 0.74 0.77 3397 tj 0.85 0.89 0.87 5000 ua 0.76 0.77 0.77 5000 uz 0.74 0.75 0.74 5000 avg / total 0.82 0.82 0.82 84925 Reducing feature vectors. (398969, 13320) (84925, 13320) (398969, 13284) (84925, 13284) STARTING UNMASKING ROUND 53 rus cc cxg2 53 precision recall f1-score support az 0.74 0.77 0.76 5000 bg 0.99 1.00 0.99 2401 by 0.85 0.81 0.83 4777 ec 0.91 0.96 0.93 5000 ee 0.71 0.73 0.72 5000 ge 0.80 0.77 0.78 4123 ht 0.95 0.98 0.97 5000 kg 0.93 0.95 0.94 5000 kz 0.77 0.69 0.73 5000 lt 0.75 0.77 0.76 5000 lv 0.73 0.71 0.72 5000 md 0.85 0.87 0.86 5000 pw 0.93 0.93 0.93 2888 ru 0.76 0.75 0.75 5000 si 0.99 0.99 0.99 2339 so 0.81 0.73 0.77 3397 tj 0.85 0.89 0.87 5000 ua 0.76 0.77 0.76 5000 uz 0.74 0.75 0.74 5000 avg / total 0.82 0.82 0.82 84925 Reducing feature vectors. (398969, 13284) (84925, 13284) (398969, 13249) (84925, 13249) STARTING UNMASKING ROUND 54 rus cc cxg2 54 precision recall f1-score support az 0.75 0.77 0.76 5000 bg 0.99 1.00 0.99 2401 by 0.85 0.81 0.83 4777 ec 0.91 0.96 0.93 5000 ee 0.71 0.72 0.71 5000 ge 0.80 0.77 0.78 4123 ht 0.95 0.98 0.97 5000 kg 0.93 0.95 0.94 5000 kz 0.77 0.69 0.73 5000 lt 0.75 0.77 0.76 5000 lv 0.73 0.71 0.72 5000 md 0.85 0.87 0.86 5000 pw 0.93 0.93 0.93 2888 ru 0.75 0.74 0.75 5000 si 0.99 0.99 0.99 2339 so 0.81 0.73 0.77 3397 tj 0.85 0.88 0.86 5000 ua 0.76 0.77 0.76 5000 uz 0.74 0.75 0.74 5000 avg / total 0.82 0.82 0.82 84925 Reducing feature vectors. (398969, 13249) (84925, 13249) (398969, 13211) (84925, 13211) STARTING UNMASKING ROUND 55 rus cc cxg2 55 precision recall f1-score support az 0.74 0.77 0.75 5000 bg 0.99 1.00 0.99 2401 by 0.84 0.81 0.83 4777 ec 0.91 0.96 0.93 5000 ee 0.71 0.72 0.71 5000 ge 0.79 0.76 0.78 4123 ht 0.95 0.98 0.97 5000 kg 0.93 0.95 0.94 5000 kz 0.77 0.69 0.73 5000 lt 0.75 0.76 0.76 5000 lv 0.73 0.71 0.72 5000 md 0.84 0.86 0.85 5000 pw 0.93 0.93 0.93 2888 ru 0.75 0.74 0.75 5000 si 0.99 0.99 0.99 2339 so 0.81 0.73 0.77 3397 tj 0.85 0.88 0.86 5000 ua 0.76 0.76 0.76 5000 uz 0.73 0.74 0.74 5000 avg / total 0.82 0.82 0.82 84925 Reducing feature vectors. (398969, 13211) (84925, 13211) (398969, 13175) (84925, 13175) STARTING UNMASKING ROUND 56 rus cc cxg2 56 precision recall f1-score support az 0.74 0.77 0.75 5000 bg 0.99 1.00 0.99 2401 by 0.84 0.81 0.82 4777 ec 0.91 0.96 0.93 5000 ee 0.71 0.72 0.71 5000 ge 0.79 0.76 0.77 4123 ht 0.95 0.98 0.97 5000 kg 0.93 0.95 0.94 5000 kz 0.77 0.69 0.73 5000 lt 0.75 0.76 0.76 5000 lv 0.73 0.71 0.72 5000 md 0.84 0.86 0.85 5000 pw 0.93 0.93 0.93 2888 ru 0.75 0.74 0.74 5000 si 0.99 0.99 0.99 2339 so 0.81 0.73 0.76 3397 tj 0.84 0.88 0.86 5000 ua 0.75 0.76 0.76 5000 uz 0.73 0.74 0.74 5000 avg / total 0.82 0.82 0.82 84925 Reducing feature vectors. (398969, 13175) (84925, 13175) (398969, 13137) (84925, 13137) STARTING UNMASKING ROUND 57 rus cc cxg2 57 precision recall f1-score support az 0.74 0.77 0.75 5000 bg 0.99 1.00 0.99 2401 by 0.84 0.81 0.82 4777 ec 0.91 0.96 0.93 5000 ee 0.70 0.72 0.71 5000 ge 0.80 0.76 0.78 4123 ht 0.95 0.98 0.97 5000 kg 0.92 0.95 0.94 5000 kz 0.77 0.68 0.72 5000 lt 0.75 0.76 0.75 5000 lv 0.73 0.71 0.72 5000 md 0.84 0.86 0.85 5000 pw 0.93 0.93 0.93 2888 ru 0.75 0.74 0.74 5000 si 0.99 1.00 0.99 2339 so 0.80 0.73 0.76 3397 tj 0.84 0.88 0.86 5000 ua 0.75 0.76 0.76 5000 uz 0.73 0.74 0.74 5000 avg / total 0.82 0.82 0.82 84925 Reducing feature vectors. (398969, 13137) (84925, 13137) (398969, 13099) (84925, 13099) STARTING UNMASKING ROUND 58 rus cc cxg2 58 precision recall f1-score support az 0.74 0.77 0.75 5000 bg 0.99 1.00 0.99 2401 by 0.84 0.80 0.82 4777 ec 0.91 0.96 0.93 5000 ee 0.71 0.72 0.71 5000 ge 0.80 0.76 0.78 4123 ht 0.95 0.98 0.97 5000 kg 0.92 0.95 0.94 5000 kz 0.77 0.69 0.72 5000 lt 0.75 0.76 0.75 5000 lv 0.73 0.71 0.72 5000 md 0.84 0.86 0.85 5000 pw 0.92 0.93 0.93 2888 ru 0.74 0.74 0.74 5000 si 0.99 0.99 0.99 2339 so 0.80 0.73 0.76 3397 tj 0.84 0.88 0.86 5000 ua 0.75 0.76 0.75 5000 uz 0.73 0.74 0.73 5000 avg / total 0.82 0.82 0.82 84925 Reducing feature vectors. (398969, 13099) (84925, 13099) (398969, 13063) (84925, 13063) STARTING UNMASKING ROUND 59 rus cc cxg2 59 precision recall f1-score support az 0.74 0.77 0.75 5000 bg 0.99 1.00 0.99 2401 by 0.84 0.80 0.82 4777 ec 0.90 0.96 0.93 5000 ee 0.71 0.72 0.71 5000 ge 0.79 0.75 0.77 4123 ht 0.95 0.98 0.97 5000 kg 0.92 0.95 0.94 5000 kz 0.77 0.68 0.72 5000 lt 0.74 0.76 0.75 5000 lv 0.73 0.70 0.72 5000 md 0.84 0.86 0.85 5000 pw 0.92 0.93 0.93 2888 ru 0.74 0.73 0.74 5000 si 0.99 0.99 0.99 2339 so 0.80 0.72 0.76 3397 tj 0.84 0.88 0.85 5000 ua 0.75 0.76 0.75 5000 uz 0.73 0.74 0.73 5000 avg / total 0.81 0.81 0.81 84925 Reducing feature vectors. (398969, 13063) (84925, 13063) (398969, 13025) (84925, 13025) STARTING UNMASKING ROUND 60 rus cc cxg2 60 precision recall f1-score support az 0.73 0.77 0.75 5000 bg 0.99 1.00 0.99 2401 by 0.84 0.81 0.82 4777 ec 0.90 0.96 0.93 5000 ee 0.70 0.72 0.71 5000 ge 0.79 0.75 0.77 4123 ht 0.96 0.98 0.97 5000 kg 0.92 0.95 0.94 5000 kz 0.76 0.68 0.72 5000 lt 0.74 0.75 0.74 5000 lv 0.73 0.70 0.71 5000 md 0.84 0.86 0.85 5000 pw 0.92 0.93 0.93 2888 ru 0.74 0.73 0.74 5000 si 0.99 1.00 0.99 2339 so 0.80 0.72 0.76 3397 tj 0.83 0.88 0.85 5000 ua 0.74 0.75 0.75 5000 uz 0.73 0.73 0.73 5000 avg / total 0.81 0.81 0.81 84925 Reducing feature vectors. (398969, 13025) (84925, 13025) (398969, 12988) (84925, 12988) STARTING UNMASKING ROUND 61 rus cc cxg2 61 precision recall f1-score support az 0.73 0.77 0.75 5000 bg 0.99 1.00 0.99 2401 by 0.84 0.80 0.82 4777 ec 0.91 0.96 0.93 5000 ee 0.70 0.71 0.71 5000 ge 0.79 0.75 0.77 4123 ht 0.95 0.98 0.96 5000 kg 0.92 0.95 0.94 5000 kz 0.76 0.68 0.72 5000 lt 0.74 0.75 0.74 5000 lv 0.72 0.69 0.71 5000 md 0.84 0.86 0.85 5000 pw 0.92 0.93 0.92 2888 ru 0.74 0.73 0.73 5000 si 0.99 1.00 0.99 2339 so 0.80 0.72 0.76 3397 tj 0.83 0.87 0.85 5000 ua 0.74 0.75 0.74 5000 uz 0.73 0.73 0.73 5000 avg / total 0.81 0.81 0.81 84925 Reducing feature vectors. (398969, 12988) (84925, 12988) (398969, 12950) (84925, 12950) STARTING UNMASKING ROUND 62 rus cc cxg2 62 precision recall f1-score support az 0.73 0.77 0.75 5000 bg 0.99 1.00 0.99 2401 by 0.83 0.80 0.82 4777 ec 0.90 0.96 0.93 5000 ee 0.70 0.71 0.70 5000 ge 0.79 0.75 0.77 4123 ht 0.95 0.98 0.96 5000 kg 0.92 0.95 0.93 5000 kz 0.75 0.67 0.71 5000 lt 0.74 0.75 0.74 5000 lv 0.72 0.69 0.71 5000 md 0.83 0.86 0.85 5000 pw 0.92 0.92 0.92 2888 ru 0.74 0.73 0.73 5000 si 0.99 1.00 0.99 2339 so 0.80 0.72 0.76 3397 tj 0.83 0.87 0.85 5000 ua 0.74 0.75 0.74 5000 uz 0.73 0.73 0.73 5000 avg / total 0.81 0.81 0.81 84925 Reducing feature vectors. (398969, 12950) (84925, 12950) (398969, 12913) (84925, 12913) STARTING UNMASKING ROUND 63 rus cc cxg2 63 precision recall f1-score support az 0.73 0.76 0.74 5000 bg 0.99 1.00 0.99 2401 by 0.83 0.80 0.81 4777 ec 0.90 0.96 0.93 5000 ee 0.69 0.70 0.70 5000 ge 0.78 0.74 0.76 4123 ht 0.95 0.98 0.96 5000 kg 0.92 0.95 0.93 5000 kz 0.75 0.67 0.71 5000 lt 0.73 0.74 0.73 5000 lv 0.71 0.69 0.70 5000 md 0.83 0.86 0.84 5000 pw 0.92 0.93 0.93 2888 ru 0.73 0.72 0.73 5000 si 0.99 1.00 0.99 2339 so 0.80 0.71 0.76 3397 tj 0.83 0.87 0.85 5000 ua 0.73 0.74 0.74 5000 uz 0.72 0.72 0.72 5000 avg / total 0.81 0.81 0.81 84925 Reducing feature vectors. (398969, 12913) (84925, 12913) (398969, 12875) (84925, 12875) STARTING UNMASKING ROUND 64 rus cc cxg2 64 precision recall f1-score support az 0.73 0.76 0.74 5000 bg 0.99 1.00 0.99 2401 by 0.83 0.80 0.81 4777 ec 0.90 0.96 0.93 5000 ee 0.69 0.70 0.69 5000 ge 0.78 0.74 0.76 4123 ht 0.95 0.98 0.96 5000 kg 0.92 0.94 0.93 5000 kz 0.75 0.67 0.71 5000 lt 0.72 0.74 0.73 5000 lv 0.71 0.69 0.70 5000 md 0.83 0.85 0.84 5000 pw 0.92 0.93 0.92 2888 ru 0.73 0.72 0.73 5000 si 0.99 1.00 0.99 2339 so 0.80 0.72 0.76 3397 tj 0.82 0.87 0.85 5000 ua 0.73 0.74 0.74 5000 uz 0.72 0.72 0.72 5000 avg / total 0.80 0.81 0.80 84925 Reducing feature vectors. (398969, 12875) (84925, 12875) (398969, 12837) (84925, 12837) STARTING UNMASKING ROUND 65 rus cc cxg2 65 precision recall f1-score support az 0.73 0.76 0.74 5000 bg 0.99 1.00 0.99 2401 by 0.83 0.80 0.81 4777 ec 0.90 0.96 0.93 5000 ee 0.69 0.70 0.69 5000 ge 0.78 0.74 0.76 4123 ht 0.95 0.98 0.96 5000 kg 0.92 0.94 0.93 5000 kz 0.74 0.67 0.70 5000 lt 0.72 0.74 0.73 5000 lv 0.71 0.69 0.70 5000 md 0.82 0.85 0.84 5000 pw 0.92 0.92 0.92 2888 ru 0.73 0.72 0.73 5000 si 0.99 0.99 0.99 2339 so 0.80 0.71 0.75 3397 tj 0.82 0.87 0.85 5000 ua 0.73 0.74 0.74 5000 uz 0.71 0.72 0.71 5000 avg / total 0.80 0.80 0.80 84925 Reducing feature vectors. (398969, 12837) (84925, 12837) (398969, 12801) (84925, 12801) STARTING UNMASKING ROUND 66 rus cc cxg2 66 precision recall f1-score support az 0.72 0.75 0.74 5000 bg 0.99 1.00 0.99 2401 by 0.83 0.79 0.81 4777 ec 0.90 0.95 0.93 5000 ee 0.69 0.70 0.69 5000 ge 0.77 0.73 0.75 4123 ht 0.95 0.98 0.96 5000 kg 0.92 0.94 0.93 5000 kz 0.74 0.66 0.70 5000 lt 0.72 0.73 0.73 5000 lv 0.70 0.68 0.69 5000 md 0.82 0.84 0.83 5000 pw 0.92 0.92 0.92 2888 ru 0.73 0.72 0.72 5000 si 0.99 1.00 0.99 2339 so 0.80 0.72 0.75 3397 tj 0.82 0.86 0.84 5000 ua 0.73 0.74 0.73 5000 uz 0.71 0.71 0.71 5000 avg / total 0.80 0.80 0.80 84925 Reducing feature vectors. (398969, 12801) (84925, 12801) (398969, 12763) (84925, 12763) STARTING UNMASKING ROUND 67 rus cc cxg2 67 precision recall f1-score support az 0.72 0.75 0.74 5000 bg 0.99 1.00 0.99 2401 by 0.82 0.79 0.80 4777 ec 0.90 0.96 0.93 5000 ee 0.68 0.69 0.69 5000 ge 0.77 0.73 0.75 4123 ht 0.95 0.98 0.96 5000 kg 0.92 0.94 0.93 5000 kz 0.74 0.66 0.70 5000 lt 0.72 0.73 0.73 5000 lv 0.70 0.68 0.69 5000 md 0.82 0.84 0.83 5000 pw 0.92 0.92 0.92 2888 ru 0.73 0.71 0.72 5000 si 0.99 1.00 0.99 2339 so 0.80 0.71 0.75 3397 tj 0.82 0.86 0.84 5000 ua 0.73 0.74 0.73 5000 uz 0.70 0.71 0.71 5000 avg / total 0.80 0.80 0.80 84925 Reducing feature vectors. (398969, 12763) (84925, 12763) (398969, 12726) (84925, 12726) STARTING UNMASKING ROUND 68 rus cc cxg2 68 precision recall f1-score support az 0.72 0.75 0.73 5000 bg 0.99 1.00 0.99 2401 by 0.82 0.78 0.80 4777 ec 0.90 0.95 0.93 5000 ee 0.68 0.69 0.69 5000 ge 0.77 0.73 0.75 4123 ht 0.95 0.98 0.96 5000 kg 0.91 0.94 0.93 5000 kz 0.74 0.66 0.70 5000 lt 0.72 0.73 0.72 5000 lv 0.70 0.68 0.69 5000 md 0.82 0.84 0.83 5000 pw 0.92 0.92 0.92 2888 ru 0.73 0.71 0.72 5000 si 0.99 0.99 0.99 2339 so 0.80 0.71 0.75 3397 tj 0.82 0.86 0.84 5000 ua 0.73 0.74 0.73 5000 uz 0.70 0.71 0.71 5000 avg / total 0.80 0.80 0.80 84925 Reducing feature vectors. (398969, 12726) (84925, 12726) (398969, 12688) (84925, 12688) STARTING UNMASKING ROUND 69 rus cc cxg2 69 precision recall f1-score support az 0.72 0.75 0.73 5000 bg 0.99 1.00 0.99 2401 by 0.82 0.78 0.80 4777 ec 0.90 0.95 0.93 5000 ee 0.68 0.69 0.69 5000 ge 0.77 0.73 0.75 4123 ht 0.95 0.98 0.96 5000 kg 0.91 0.94 0.92 5000 kz 0.73 0.66 0.69 5000 lt 0.72 0.73 0.72 5000 lv 0.70 0.68 0.69 5000 md 0.82 0.84 0.83 5000 pw 0.92 0.92 0.92 2888 ru 0.72 0.71 0.72 5000 si 0.99 0.99 0.99 2339 so 0.80 0.71 0.75 3397 tj 0.82 0.86 0.84 5000 ua 0.73 0.74 0.73 5000 uz 0.70 0.71 0.70 5000 avg / total 0.80 0.80 0.80 84925 Reducing feature vectors. (398969, 12688) (84925, 12688) (398969, 12650) (84925, 12650) STARTING UNMASKING ROUND 70 rus cc cxg2 70 precision recall f1-score support az 0.71 0.74 0.73 5000 bg 0.99 1.00 0.99 2401 by 0.81 0.78 0.79 4777 ec 0.90 0.95 0.93 5000 ee 0.68 0.69 0.68 5000 ge 0.77 0.72 0.75 4123 ht 0.95 0.98 0.96 5000 kg 0.91 0.94 0.92 5000 kz 0.73 0.66 0.69 5000 lt 0.72 0.72 0.72 5000 lv 0.70 0.68 0.69 5000 md 0.81 0.84 0.83 5000 pw 0.92 0.92 0.92 2888 ru 0.73 0.71 0.72 5000 si 0.99 0.99 0.99 2339 so 0.79 0.71 0.75 3397 tj 0.81 0.86 0.84 5000 ua 0.73 0.74 0.73 5000 uz 0.70 0.71 0.71 5000 avg / total 0.79 0.80 0.79 84925 Reducing feature vectors. (398969, 12650) (84925, 12650) (398969, 12612) (84925, 12612) STARTING UNMASKING ROUND 71 rus cc cxg2 71 precision recall f1-score support az 0.71 0.74 0.73 5000 bg 0.99 1.00 0.99 2401 by 0.82 0.78 0.80 4777 ec 0.90 0.95 0.92 5000 ee 0.68 0.69 0.68 5000 ge 0.77 0.72 0.74 4123 ht 0.95 0.98 0.96 5000 kg 0.91 0.94 0.92 5000 kz 0.73 0.65 0.69 5000 lt 0.72 0.73 0.72 5000 lv 0.70 0.68 0.69 5000 md 0.82 0.84 0.83 5000 pw 0.91 0.92 0.92 2888 ru 0.72 0.71 0.72 5000 si 0.99 0.99 0.99 2339 so 0.79 0.71 0.75 3397 tj 0.81 0.86 0.83 5000 ua 0.72 0.73 0.73 5000 uz 0.70 0.71 0.70 5000 avg / total 0.79 0.79 0.79 84925 Reducing feature vectors. (398969, 12612) (84925, 12612) (398969, 12575) (84925, 12575) STARTING UNMASKING ROUND 72 rus cc cxg2 72 precision recall f1-score support az 0.71 0.74 0.73 5000 bg 0.99 1.00 0.99 2401 by 0.82 0.78 0.80 4777 ec 0.89 0.95 0.92 5000 ee 0.68 0.68 0.68 5000 ge 0.77 0.72 0.74 4123 ht 0.95 0.98 0.96 5000 kg 0.91 0.94 0.92 5000 kz 0.73 0.65 0.69 5000 lt 0.71 0.72 0.72 5000 lv 0.69 0.68 0.68 5000 md 0.82 0.84 0.83 5000 pw 0.91 0.92 0.92 2888 ru 0.72 0.71 0.71 5000 si 0.99 0.99 0.99 2339 so 0.79 0.71 0.75 3397 tj 0.81 0.86 0.83 5000 ua 0.72 0.73 0.73 5000 uz 0.69 0.71 0.70 5000 avg / total 0.79 0.79 0.79 84925 Reducing feature vectors. (398969, 12575) (84925, 12575) (398969, 12537) (84925, 12537) STARTING UNMASKING ROUND 73 rus cc cxg2 73 precision recall f1-score support az 0.71 0.74 0.73 5000 bg 0.99 1.00 0.99 2401 by 0.82 0.78 0.80 4777 ec 0.89 0.95 0.92 5000 ee 0.68 0.69 0.68 5000 ge 0.77 0.72 0.74 4123 ht 0.95 0.97 0.96 5000 kg 0.91 0.94 0.92 5000 kz 0.73 0.65 0.69 5000 lt 0.71 0.72 0.72 5000 lv 0.69 0.67 0.68 5000 md 0.81 0.84 0.83 5000 pw 0.91 0.92 0.92 2888 ru 0.72 0.71 0.71 5000 si 0.99 0.99 0.99 2339 so 0.79 0.71 0.75 3397 tj 0.81 0.85 0.83 5000 ua 0.72 0.73 0.73 5000 uz 0.69 0.70 0.70 5000 avg / total 0.79 0.79 0.79 84925 Reducing feature vectors. (398969, 12537) (84925, 12537) (398969, 12501) (84925, 12501) STARTING UNMASKING ROUND 74 rus cc cxg2 74 precision recall f1-score support az 0.71 0.74 0.72 5000 bg 0.99 1.00 0.99 2401 by 0.82 0.77 0.79 4777 ec 0.89 0.95 0.92 5000 ee 0.68 0.68 0.68 5000 ge 0.76 0.72 0.74 4123 ht 0.95 0.97 0.96 5000 kg 0.91 0.94 0.92 5000 kz 0.72 0.65 0.69 5000 lt 0.71 0.72 0.71 5000 lv 0.69 0.67 0.68 5000 md 0.81 0.84 0.82 5000 pw 0.91 0.92 0.91 2888 ru 0.72 0.71 0.71 5000 si 0.99 0.99 0.99 2339 so 0.79 0.71 0.75 3397 tj 0.80 0.85 0.83 5000 ua 0.72 0.73 0.72 5000 uz 0.69 0.70 0.70 5000 avg / total 0.79 0.79 0.79 84925 Reducing feature vectors. (398969, 12501) (84925, 12501) (398969, 12464) (84925, 12464) STARTING UNMASKING ROUND 75 rus cc cxg2 75 precision recall f1-score support az 0.71 0.73 0.72 5000 bg 0.99 1.00 0.99 2401 by 0.82 0.77 0.79 4777 ec 0.89 0.95 0.92 5000 ee 0.68 0.68 0.68 5000 ge 0.76 0.71 0.74 4123 ht 0.95 0.97 0.96 5000 kg 0.91 0.94 0.92 5000 kz 0.73 0.65 0.69 5000 lt 0.71 0.72 0.72 5000 lv 0.69 0.67 0.68 5000 md 0.81 0.84 0.82 5000 pw 0.91 0.92 0.91 2888 ru 0.72 0.70 0.71 5000 si 0.98 0.99 0.99 2339 so 0.79 0.71 0.75 3397 tj 0.80 0.85 0.82 5000 ua 0.72 0.72 0.72 5000 uz 0.69 0.70 0.69 5000 avg / total 0.79 0.79 0.79 84925 Reducing feature vectors. (398969, 12464) (84925, 12464) (398969, 12426) (84925, 12426) STARTING UNMASKING ROUND 76 rus cc cxg2 76 precision recall f1-score support az 0.71 0.73 0.72 5000 bg 0.99 1.00 0.99 2401 by 0.81 0.77 0.79 4777 ec 0.89 0.95 0.92 5000 ee 0.67 0.68 0.68 5000 ge 0.76 0.71 0.73 4123 ht 0.95 0.97 0.96 5000 kg 0.90 0.94 0.92 5000 kz 0.72 0.65 0.69 5000 lt 0.71 0.72 0.71 5000 lv 0.69 0.67 0.68 5000 md 0.80 0.84 0.82 5000 pw 0.91 0.91 0.91 2888 ru 0.72 0.70 0.71 5000 si 0.99 0.99 0.99 2339 so 0.79 0.71 0.75 3397 tj 0.79 0.84 0.82 5000 ua 0.71 0.73 0.72 5000 uz 0.69 0.70 0.69 5000 avg / total 0.79 0.79 0.79 84925 Reducing feature vectors. (398969, 12426) (84925, 12426) (398969, 12388) (84925, 12388) STARTING UNMASKING ROUND 77 rus cc cxg2 77 precision recall f1-score support az 0.71 0.73 0.72 5000 bg 0.99 1.00 0.99 2401 by 0.81 0.77 0.79 4777 ec 0.89 0.95 0.92 5000 ee 0.68 0.68 0.68 5000 ge 0.76 0.71 0.74 4123 ht 0.94 0.98 0.96 5000 kg 0.90 0.94 0.92 5000 kz 0.72 0.65 0.68 5000 lt 0.71 0.72 0.71 5000 lv 0.68 0.67 0.68 5000 md 0.80 0.84 0.82 5000 pw 0.92 0.91 0.92 2888 ru 0.72 0.70 0.71 5000 si 0.99 0.99 0.99 2339 so 0.79 0.70 0.74 3397 tj 0.79 0.84 0.82 5000 ua 0.72 0.73 0.72 5000 uz 0.69 0.70 0.69 5000 avg / total 0.79 0.79 0.79 84925 Reducing feature vectors. (398969, 12388) (84925, 12388) (398969, 12352) (84925, 12352) STARTING UNMASKING ROUND 78 rus cc cxg2 78 precision recall f1-score support az 0.70 0.73 0.71 5000 bg 0.99 1.00 0.99 2401 by 0.81 0.77 0.79 4777 ec 0.89 0.95 0.92 5000 ee 0.67 0.68 0.67 5000 ge 0.76 0.71 0.74 4123 ht 0.95 0.98 0.96 5000 kg 0.90 0.93 0.92 5000 kz 0.72 0.65 0.68 5000 lt 0.71 0.71 0.71 5000 lv 0.68 0.67 0.68 5000 md 0.80 0.83 0.82 5000 pw 0.91 0.91 0.91 2888 ru 0.72 0.70 0.71 5000 si 0.98 0.99 0.99 2339 so 0.78 0.70 0.74 3397 tj 0.79 0.84 0.82 5000 ua 0.71 0.73 0.72 5000 uz 0.69 0.69 0.69 5000 avg / total 0.78 0.79 0.78 84925 Reducing feature vectors. (398969, 12352) (84925, 12352) (398969, 12315) (84925, 12315) STARTING UNMASKING ROUND 79 rus cc cxg2 79 precision recall f1-score support az 0.70 0.73 0.71 5000 bg 0.99 1.00 0.99 2401 by 0.81 0.77 0.79 4777 ec 0.89 0.95 0.92 5000 ee 0.67 0.68 0.67 5000 ge 0.76 0.70 0.73 4123 ht 0.95 0.97 0.96 5000 kg 0.90 0.93 0.91 5000 kz 0.72 0.65 0.68 5000 lt 0.70 0.71 0.71 5000 lv 0.68 0.67 0.67 5000 md 0.79 0.83 0.81 5000 pw 0.91 0.91 0.91 2888 ru 0.71 0.70 0.70 5000 si 0.98 0.99 0.99 2339 so 0.78 0.69 0.73 3397 tj 0.79 0.84 0.81 5000 ua 0.71 0.73 0.72 5000 uz 0.69 0.69 0.69 5000 avg / total 0.78 0.78 0.78 84925 Reducing feature vectors. (398969, 12315) (84925, 12315) (398969, 12279) (84925, 12279) STARTING UNMASKING ROUND 80 rus cc cxg2 80 precision recall f1-score support az 0.70 0.72 0.71 5000 bg 0.99 1.00 0.99 2401 by 0.80 0.76 0.78 4777 ec 0.89 0.95 0.92 5000 ee 0.67 0.67 0.67 5000 ge 0.75 0.70 0.72 4123 ht 0.95 0.97 0.96 5000 kg 0.90 0.93 0.91 5000 kz 0.71 0.64 0.67 5000 lt 0.70 0.71 0.70 5000 lv 0.68 0.66 0.67 5000 md 0.79 0.83 0.81 5000 pw 0.91 0.91 0.91 2888 ru 0.71 0.69 0.70 5000 si 0.98 0.99 0.99 2339 so 0.78 0.69 0.73 3397 tj 0.79 0.84 0.81 5000 ua 0.71 0.72 0.72 5000 uz 0.68 0.69 0.68 5000 avg / total 0.78 0.78 0.78 84925 Reducing feature vectors. (398969, 12279) (84925, 12279) (398969, 12241) (84925, 12241) STARTING UNMASKING ROUND 81 rus cc cxg2 81 precision recall f1-score support az 0.70 0.72 0.71 5000 bg 0.99 1.00 0.99 2401 by 0.80 0.75 0.78 4777 ec 0.88 0.95 0.91 5000 ee 0.67 0.67 0.67 5000 ge 0.75 0.70 0.72 4123 ht 0.95 0.97 0.96 5000 kg 0.90 0.93 0.91 5000 kz 0.71 0.64 0.67 5000 lt 0.70 0.70 0.70 5000 lv 0.68 0.66 0.67 5000 md 0.79 0.83 0.81 5000 pw 0.91 0.91 0.91 2888 ru 0.71 0.69 0.70 5000 si 0.98 0.99 0.99 2339 so 0.77 0.68 0.73 3397 tj 0.78 0.84 0.81 5000 ua 0.71 0.72 0.71 5000 uz 0.68 0.69 0.68 5000 avg / total 0.78 0.78 0.78 84925 Reducing feature vectors. (398969, 12241) (84925, 12241) (398969, 12204) (84925, 12204) STARTING UNMASKING ROUND 82 rus cc cxg2 82 precision recall f1-score support az 0.69 0.72 0.71 5000 bg 0.99 1.00 0.99 2401 by 0.80 0.75 0.77 4777 ec 0.89 0.95 0.92 5000 ee 0.67 0.67 0.67 5000 ge 0.75 0.70 0.72 4123 ht 0.95 0.97 0.96 5000 kg 0.89 0.93 0.91 5000 kz 0.71 0.64 0.67 5000 lt 0.70 0.70 0.70 5000 lv 0.68 0.65 0.66 5000 md 0.78 0.83 0.80 5000 pw 0.91 0.91 0.91 2888 ru 0.70 0.69 0.70 5000 si 0.98 0.99 0.99 2339 so 0.77 0.69 0.73 3397 tj 0.79 0.84 0.81 5000 ua 0.71 0.71 0.71 5000 uz 0.68 0.68 0.68 5000 avg / total 0.78 0.78 0.78 84925 Reducing feature vectors. (398969, 12204) (84925, 12204) (398969, 12168) (84925, 12168) STARTING UNMASKING ROUND 83 rus cc cxg2 83 precision recall f1-score support az 0.69 0.72 0.71 5000 bg 0.99 1.00 0.99 2401 by 0.80 0.75 0.77 4777 ec 0.88 0.95 0.91 5000 ee 0.67 0.67 0.67 5000 ge 0.75 0.70 0.72 4123 ht 0.95 0.97 0.96 5000 kg 0.89 0.93 0.91 5000 kz 0.71 0.64 0.67 5000 lt 0.70 0.70 0.70 5000 lv 0.68 0.65 0.67 5000 md 0.78 0.83 0.80 5000 pw 0.91 0.91 0.91 2888 ru 0.70 0.69 0.69 5000 si 0.98 0.99 0.99 2339 so 0.77 0.68 0.73 3397 tj 0.78 0.84 0.81 5000 ua 0.70 0.71 0.71 5000 uz 0.68 0.68 0.68 5000 avg / total 0.78 0.78 0.78 84925 Reducing feature vectors. (398969, 12168) (84925, 12168) (398969, 12131) (84925, 12131) STARTING UNMASKING ROUND 84 rus cc cxg2 84 precision recall f1-score support az 0.69 0.72 0.70 5000 bg 0.99 1.00 0.99 2401 by 0.79 0.74 0.77 4777 ec 0.88 0.94 0.91 5000 ee 0.66 0.67 0.66 5000 ge 0.74 0.69 0.72 4123 ht 0.95 0.97 0.96 5000 kg 0.89 0.93 0.91 5000 kz 0.71 0.62 0.66 5000 lt 0.69 0.70 0.69 5000 lv 0.67 0.65 0.66 5000 md 0.78 0.83 0.80 5000 pw 0.90 0.91 0.91 2888 ru 0.69 0.69 0.69 5000 si 0.98 0.99 0.99 2339 so 0.77 0.68 0.72 3397 tj 0.78 0.84 0.81 5000 ua 0.70 0.70 0.70 5000 uz 0.67 0.68 0.68 5000 avg / total 0.77 0.77 0.77 84925 Reducing feature vectors. (398969, 12131) (84925, 12131) (398969, 12095) (84925, 12095) STARTING UNMASKING ROUND 85 rus cc cxg2 85 precision recall f1-score support az 0.68 0.71 0.70 5000 bg 0.99 1.00 0.99 2401 by 0.79 0.74 0.76 4777 ec 0.88 0.95 0.91 5000 ee 0.66 0.66 0.66 5000 ge 0.74 0.69 0.71 4123 ht 0.94 0.97 0.96 5000 kg 0.89 0.93 0.91 5000 kz 0.70 0.62 0.66 5000 lt 0.69 0.69 0.69 5000 lv 0.67 0.64 0.66 5000 md 0.76 0.82 0.79 5000 pw 0.90 0.91 0.91 2888 ru 0.69 0.69 0.69 5000 si 0.98 0.99 0.99 2339 so 0.77 0.68 0.72 3397 tj 0.78 0.84 0.81 5000 ua 0.69 0.69 0.69 5000 uz 0.67 0.67 0.67 5000 avg / total 0.77 0.77 0.77 84925 Reducing feature vectors. (398969, 12095) (84925, 12095) (398969, 12057) (84925, 12057) STARTING UNMASKING ROUND 86 rus cc cxg2 86 precision recall f1-score support az 0.68 0.72 0.70 5000 bg 0.99 1.00 0.99 2401 by 0.79 0.74 0.76 4777 ec 0.88 0.95 0.91 5000 ee 0.66 0.66 0.66 5000 ge 0.74 0.69 0.71 4123 ht 0.95 0.97 0.96 5000 kg 0.89 0.93 0.91 5000 kz 0.70 0.62 0.66 5000 lt 0.69 0.69 0.69 5000 lv 0.66 0.64 0.65 5000 md 0.76 0.82 0.79 5000 pw 0.90 0.91 0.91 2888 ru 0.69 0.68 0.69 5000 si 0.99 0.99 0.99 2339 so 0.77 0.68 0.72 3397 tj 0.78 0.83 0.81 5000 ua 0.69 0.69 0.69 5000 uz 0.67 0.67 0.67 5000 avg / total 0.77 0.77 0.77 84925 Reducing feature vectors. (398969, 12057) (84925, 12057) (398969, 12019) (84925, 12019) STARTING UNMASKING ROUND 87 rus cc cxg2 87 precision recall f1-score support az 0.68 0.71 0.70 5000 bg 0.99 1.00 1.00 2401 by 0.79 0.74 0.76 4777 ec 0.88 0.95 0.91 5000 ee 0.66 0.66 0.66 5000 ge 0.74 0.68 0.71 4123 ht 0.95 0.97 0.96 5000 kg 0.89 0.93 0.91 5000 kz 0.70 0.62 0.66 5000 lt 0.69 0.69 0.69 5000 lv 0.67 0.64 0.66 5000 md 0.75 0.81 0.78 5000 pw 0.90 0.91 0.91 2888 ru 0.69 0.68 0.69 5000 si 0.98 0.99 0.99 2339 so 0.77 0.68 0.72 3397 tj 0.78 0.83 0.81 5000 ua 0.69 0.69 0.69 5000 uz 0.67 0.67 0.67 5000 avg / total 0.77 0.77 0.77 84925 Reducing feature vectors. (398969, 12019) (84925, 12019) (398969, 11981) (84925, 11981) STARTING UNMASKING ROUND 88 rus cc cxg2 88 precision recall f1-score support az 0.68 0.71 0.70 5000 bg 0.99 1.00 1.00 2401 by 0.78 0.73 0.76 4777 ec 0.88 0.95 0.91 5000 ee 0.66 0.66 0.66 5000 ge 0.73 0.68 0.71 4123 ht 0.94 0.97 0.96 5000 kg 0.88 0.93 0.90 5000 kz 0.70 0.62 0.65 5000 lt 0.68 0.68 0.68 5000 lv 0.66 0.64 0.65 5000 md 0.75 0.81 0.78 5000 pw 0.90 0.91 0.90 2888 ru 0.69 0.68 0.69 5000 si 0.98 0.99 0.99 2339 so 0.76 0.67 0.72 3397 tj 0.78 0.83 0.80 5000 ua 0.68 0.69 0.68 5000 uz 0.67 0.67 0.67 5000 avg / total 0.76 0.77 0.76 84925 Reducing feature vectors. (398969, 11981) (84925, 11981) (398969, 11943) (84925, 11943) STARTING UNMASKING ROUND 89 rus cc cxg2 89 precision recall f1-score support az 0.68 0.71 0.69 5000 bg 0.99 1.00 0.99 2401 by 0.78 0.73 0.75 4777 ec 0.88 0.95 0.91 5000 ee 0.65 0.66 0.65 5000 ge 0.73 0.68 0.70 4123 ht 0.94 0.97 0.96 5000 kg 0.88 0.92 0.90 5000 kz 0.70 0.62 0.65 5000 lt 0.68 0.67 0.68 5000 lv 0.66 0.64 0.65 5000 md 0.75 0.81 0.78 5000 pw 0.90 0.91 0.90 2888 ru 0.69 0.68 0.68 5000 si 0.99 0.99 0.99 2339 so 0.77 0.67 0.72 3397 tj 0.78 0.83 0.80 5000 ua 0.68 0.68 0.68 5000 uz 0.66 0.67 0.67 5000 avg / total 0.76 0.76 0.76 84925 Reducing feature vectors. (398969, 11943) (84925, 11943) (398969, 11906) (84925, 11906) STARTING UNMASKING ROUND 90 rus cc cxg2 90 precision recall f1-score support az 0.67 0.71 0.69 5000 bg 0.99 1.00 0.99 2401 by 0.78 0.72 0.75 4777 ec 0.88 0.95 0.91 5000 ee 0.65 0.66 0.65 5000 ge 0.74 0.68 0.71 4123 ht 0.94 0.97 0.96 5000 kg 0.88 0.92 0.90 5000 kz 0.70 0.61 0.65 5000 lt 0.68 0.67 0.68 5000 lv 0.66 0.64 0.65 5000 md 0.74 0.81 0.77 5000 pw 0.90 0.90 0.90 2888 ru 0.69 0.68 0.68 5000 si 0.99 0.99 0.99 2339 so 0.76 0.67 0.71 3397 tj 0.78 0.82 0.80 5000 ua 0.67 0.68 0.68 5000 uz 0.66 0.67 0.67 5000 avg / total 0.76 0.76 0.76 84925 Reducing feature vectors. (398969, 11906) (84925, 11906) (398969, 11873) (84925, 11873) STARTING UNMASKING ROUND 91 rus cc cxg2 91 precision recall f1-score support az 0.67 0.71 0.69 5000 bg 0.99 1.00 0.99 2401 by 0.78 0.72 0.75 4777 ec 0.88 0.95 0.91 5000 ee 0.65 0.66 0.65 5000 ge 0.73 0.68 0.70 4123 ht 0.94 0.97 0.95 5000 kg 0.88 0.92 0.90 5000 kz 0.69 0.61 0.65 5000 lt 0.67 0.67 0.67 5000 lv 0.66 0.63 0.65 5000 md 0.74 0.81 0.77 5000 pw 0.90 0.91 0.90 2888 ru 0.69 0.68 0.68 5000 si 0.99 0.99 0.99 2339 so 0.77 0.67 0.71 3397 tj 0.78 0.82 0.80 5000 ua 0.67 0.67 0.67 5000 uz 0.66 0.67 0.66 5000 avg / total 0.76 0.76 0.76 84925 Reducing feature vectors. (398969, 11873) (84925, 11873) (398969, 11835) (84925, 11835) STARTING UNMASKING ROUND 92 rus cc cxg2 92 precision recall f1-score support az 0.67 0.71 0.69 5000 bg 0.99 1.00 0.99 2401 by 0.77 0.72 0.75 4777 ec 0.88 0.94 0.91 5000 ee 0.65 0.65 0.65 5000 ge 0.73 0.68 0.70 4123 ht 0.94 0.97 0.95 5000 kg 0.88 0.92 0.90 5000 kz 0.69 0.61 0.65 5000 lt 0.67 0.67 0.67 5000 lv 0.66 0.63 0.65 5000 md 0.74 0.81 0.77 5000 pw 0.90 0.90 0.90 2888 ru 0.68 0.67 0.68 5000 si 0.99 0.99 0.99 2339 so 0.76 0.67 0.71 3397 tj 0.77 0.82 0.80 5000 ua 0.67 0.67 0.67 5000 uz 0.66 0.67 0.66 5000 avg / total 0.76 0.76 0.76 84925 Reducing feature vectors. (398969, 11835) (84925, 11835) (398969, 11797) (84925, 11797) STARTING UNMASKING ROUND 93 rus cc cxg2 93 precision recall f1-score support az 0.67 0.71 0.69 5000 bg 0.99 1.00 0.99 2401 by 0.77 0.72 0.75 4777 ec 0.88 0.94 0.91 5000 ee 0.64 0.65 0.65 5000 ge 0.73 0.68 0.70 4123 ht 0.94 0.97 0.96 5000 kg 0.88 0.92 0.90 5000 kz 0.69 0.61 0.65 5000 lt 0.67 0.67 0.67 5000 lv 0.66 0.63 0.64 5000 md 0.74 0.80 0.77 5000 pw 0.90 0.90 0.90 2888 ru 0.68 0.67 0.68 5000 si 0.99 0.99 0.99 2339 so 0.76 0.67 0.71 3397 tj 0.77 0.82 0.80 5000 ua 0.67 0.67 0.67 5000 uz 0.66 0.67 0.66 5000 avg / total 0.76 0.76 0.76 84925 Reducing feature vectors. (398969, 11797) (84925, 11797) (398969, 11760) (84925, 11760) STARTING UNMASKING ROUND 94 rus cc cxg2 94 precision recall f1-score support az 0.67 0.70 0.69 5000 bg 0.99 1.00 0.99 2401 by 0.77 0.72 0.74 4777 ec 0.88 0.94 0.91 5000 ee 0.65 0.65 0.65 5000 ge 0.73 0.67 0.70 4123 ht 0.94 0.97 0.96 5000 kg 0.88 0.92 0.90 5000 kz 0.68 0.61 0.64 5000 lt 0.67 0.67 0.67 5000 lv 0.66 0.63 0.64 5000 md 0.74 0.80 0.77 5000 pw 0.89 0.90 0.90 2888 ru 0.68 0.67 0.68 5000 si 0.99 0.99 0.99 2339 so 0.76 0.66 0.71 3397 tj 0.77 0.82 0.79 5000 ua 0.67 0.67 0.67 5000 uz 0.66 0.67 0.66 5000 avg / total 0.76 0.76 0.76 84925 Reducing feature vectors. (398969, 11760) (84925, 11760) (398969, 11722) (84925, 11722) STARTING UNMASKING ROUND 95 rus cc cxg2 95 precision recall f1-score support az 0.66 0.70 0.68 5000 bg 0.99 1.00 0.99 2401 by 0.77 0.72 0.74 4777 ec 0.87 0.94 0.91 5000 ee 0.64 0.65 0.65 5000 ge 0.72 0.67 0.70 4123 ht 0.94 0.97 0.95 5000 kg 0.88 0.92 0.90 5000 kz 0.69 0.60 0.64 5000 lt 0.66 0.67 0.66 5000 lv 0.64 0.62 0.63 5000 md 0.71 0.74 0.72 5000 pw 0.89 0.90 0.89 2888 ru 0.68 0.68 0.68 5000 si 0.99 0.99 0.99 2339 so 0.76 0.66 0.70 3397 tj 0.77 0.81 0.79 5000 ua 0.66 0.67 0.67 5000 uz 0.65 0.66 0.66 5000 avg / total 0.75 0.75 0.75 84925 Reducing feature vectors. (398969, 11722) (84925, 11722) (398969, 11684) (84925, 11684) STARTING UNMASKING ROUND 96 rus cc cxg2 96 precision recall f1-score support az 0.66 0.70 0.68 5000 bg 0.99 1.00 0.99 2401 by 0.76 0.72 0.74 4777 ec 0.87 0.94 0.91 5000 ee 0.64 0.64 0.64 5000 ge 0.72 0.67 0.69 4123 ht 0.94 0.97 0.95 5000 kg 0.88 0.92 0.90 5000 kz 0.68 0.60 0.64 5000 lt 0.66 0.66 0.66 5000 lv 0.65 0.62 0.64 5000 md 0.70 0.73 0.72 5000 pw 0.89 0.90 0.90 2888 ru 0.67 0.67 0.67 5000 si 0.99 0.99 0.99 2339 so 0.76 0.66 0.70 3397 tj 0.77 0.81 0.79 5000 ua 0.66 0.67 0.67 5000 uz 0.65 0.66 0.66 5000 avg / total 0.75 0.75 0.75 84925 Reducing feature vectors. (398969, 11684) (84925, 11684) (398969, 11648) (84925, 11648) STARTING UNMASKING ROUND 97 rus cc cxg2 97 precision recall f1-score support az 0.66 0.70 0.68 5000 bg 0.99 1.00 0.99 2401 by 0.76 0.72 0.74 4777 ec 0.88 0.94 0.91 5000 ee 0.64 0.64 0.64 5000 ge 0.72 0.66 0.69 4123 ht 0.94 0.97 0.95 5000 kg 0.88 0.92 0.90 5000 kz 0.68 0.60 0.64 5000 lt 0.66 0.66 0.66 5000 lv 0.65 0.62 0.63 5000 md 0.70 0.73 0.72 5000 pw 0.90 0.90 0.90 2888 ru 0.68 0.67 0.67 5000 si 0.99 0.99 0.99 2339 so 0.76 0.66 0.71 3397 tj 0.76 0.81 0.79 5000 ua 0.66 0.67 0.66 5000 uz 0.65 0.66 0.66 5000 avg / total 0.75 0.75 0.75 84925 Reducing feature vectors. (398969, 11648) (84925, 11648) (398969, 11613) (84925, 11613) STARTING UNMASKING ROUND 98 rus cc cxg2 98 precision recall f1-score support az 0.66 0.70 0.68 5000 bg 0.99 1.00 0.99 2401 by 0.76 0.71 0.74 4777 ec 0.87 0.94 0.91 5000 ee 0.64 0.64 0.64 5000 ge 0.72 0.66 0.69 4123 ht 0.94 0.97 0.95 5000 kg 0.87 0.92 0.90 5000 kz 0.68 0.60 0.64 5000 lt 0.66 0.66 0.66 5000 lv 0.64 0.62 0.63 5000 md 0.70 0.73 0.71 5000 pw 0.90 0.90 0.90 2888 ru 0.68 0.67 0.67 5000 si 0.98 0.99 0.99 2339 so 0.76 0.66 0.71 3397 tj 0.76 0.81 0.79 5000 ua 0.66 0.66 0.66 5000 uz 0.65 0.66 0.65 5000 avg / total 0.75 0.75 0.75 84925 Reducing feature vectors. (398969, 11613) (84925, 11613) (398969, 11577) (84925, 11577) STARTING UNMASKING ROUND 99 rus cc cxg2 99 precision recall f1-score support az 0.66 0.70 0.68 5000 bg 0.99 1.00 0.99 2401 by 0.76 0.71 0.73 4777 ec 0.87 0.94 0.91 5000 ee 0.64 0.64 0.64 5000 ge 0.72 0.66 0.69 4123 ht 0.94 0.97 0.95 5000 kg 0.87 0.92 0.89 5000 kz 0.68 0.60 0.64 5000 lt 0.65 0.66 0.66 5000 lv 0.64 0.62 0.63 5000 md 0.70 0.73 0.71 5000 pw 0.89 0.90 0.90 2888 ru 0.67 0.67 0.67 5000 si 0.98 0.99 0.99 2339 so 0.75 0.66 0.70 3397 tj 0.76 0.81 0.78 5000 ua 0.66 0.66 0.66 5000 uz 0.65 0.66 0.65 5000 avg / total 0.75 0.75 0.75 84925 Reducing feature vectors. (398969, 11577) (84925, 11577) (398969, 11541) (84925, 11541) STARTING UNMASKING ROUND 100 rus cc cxg2 100 precision recall f1-score support az 0.65 0.69 0.67 5000 bg 0.99 1.00 0.99 2401 by 0.76 0.71 0.73 4777 ec 0.87 0.94 0.91 5000 ee 0.64 0.64 0.64 5000 ge 0.72 0.66 0.69 4123 ht 0.94 0.97 0.95 5000 kg 0.87 0.92 0.89 5000 kz 0.68 0.59 0.63 5000 lt 0.65 0.65 0.65 5000 lv 0.64 0.61 0.63 5000 md 0.70 0.73 0.71 5000 pw 0.89 0.90 0.90 2888 ru 0.67 0.67 0.67 5000 si 0.98 0.99 0.99 2339 so 0.75 0.66 0.70 3397 tj 0.76 0.81 0.78 5000 ua 0.66 0.66 0.66 5000 uz 0.65 0.66 0.65 5000 avg / total 0.74 0.75 0.74 84925 Reducing feature vectors. (398969, 11541) (84925, 11541) (398969, 11503) (84925, 11503)