The EBOLA vaccine Deployment, Acceptance & Compliance (EBODAC) project was launched with the goal to develop strategies and tools to promote the acceptance and uptake of new candidate Ebola vaccines. In addition, EBODAC developed an Interactive Voice Response (IVR)-based Mobile Training and Support (MOTS) service as an innovative way to provide refresher trainings on vaccinations and disease surveillance to a large group of remotely located community health workers (CHWs), with a special focus on Ebola. This report covers the results from a quasi-experimental, multi-method pre- and post-test assessment conducted with CHWs located in Kambia District, Sierra Leone to assess the effectiveness of MOTS.