Prediction of language mistakes is a task introduced by Duolingo as part the Second Language Acquisition Modeling topic that aims to learn from history improve experience learners. Using transfer learning means pre-trained models, we propose framework can actual distribution according which faraway words sentence have higher chance produce errors. To adapt information provided more approaches b...