Statistical Analysis

Vocabulary & Grammar
Proficiency Results

Statistical results by language app efficacy based on vocabulary/grammar proficiency measured by college placement test performance.

Proficiency Results by User Level

Statistical analysis based on college placement test performance

Year Language App Improved Proficiency Study Hours for
First College Semester
Sample
Size
Statistical
Report
Percent 95% CI Mean Range
BEGINNER USERS
2019 Rosetta Stone 88 82-93 13 10-17 143
2019 Mango Languages 82 72-88 15 12-20 87
2018 italki 78 68-85 19 13-28 102
2016 Babbel 92 88-95 21 18-26 325
2016 Busuu 84 77-89 22 17-34 144
2015 Language Zen 79 70-86 25 18-41 101
2012 Duolingo 84 75-90 34 26-49 88
INTERMEDIATE USERS
Explanatory Notes

Methodology and data interpretation guidelines

Data Rounding

The numbers in the table are rounded for clarity and presentation purposes.

College Placement Test

Web Based Computer Adaptive Placement Exam (WebCAPE), Spanish WebCAPE Computer Adaptive Placement Exam by Jerry Larson and Kim Smith, online version Charles Bush. ©1998, 2004 Humanities Technology and Research Support Center, Brigham Young University,

italki is a special service that connects users to teachers and tutors; it is not a stand alone language app.

Efficacy Measurement

Efficacy: Gain in college placement test (WebCAPE points) per one study hour.

Study Hours Definition

Study Hours for One College Semester: Number of study hours in a two-month study period needed to cover the requirements for first college semester of Spanish.

Confidence Intervals

95% CI: 95% confidence interval around the mean.

Range Definition

Range: Transformed 95% CI limits for efficacy; upper and lower limits divided by the threshold requirement for placement in second college semester of Spanish (270 WebCAPE points).

Researcher
ROUMEN VESSELINOV, Ph.D.