The Expanded Programme on Immunization (EPI) and Vaccine Preventable Disease (VPD) Surveillance (VPDS) programs generate multiple data sources (e.g., routine administrative data, VPD case data, and coverage surveys). However, there are challenges with the use of these siloed data for programmatic decision-making, including poor data accessibility and lack of timely analysis, contributing to missed vaccinations, immunity gaps, and, consequently, VPD outbreaks in populations with limited access to immunization and basic healthcare services. Data triangulation, or the integration of multiple data sources, can be used to improve the availability of key indicators for identifying immunization coverage gaps, under-immunized (UI) and un-immunized (zero-dose (ZD)) children, and for assessing program performance at all levels of the healthcare system. Here, we describe the data triangulation processes, prioritization of indicators, and capacity building efforts in Bangladesh, Nigeria, and Rwanda. We also describe the analyses used to generate meaningful data, key indicators used to identify immunization coverage inequities and performance gaps, and key lessons learned. Triangulation processes and lessons learned may be leveraged by other countries, potentially leading to programmatic changes that promote improved access and utilization of vaccination services through the identification of UI and ZD children.

INTRODUCTION: High quality, timely and complete immunization data are essential for program planning and decision-making. In Nigeria, the National Health Management Information System (NHMIS) Routine Immunization (RI) module and dashboard (on the District Health Information System version 2 (DHIS2) platform) support the use of real time RI data. We deployed an automated short message service (SMS) notification system that works with the existing RI module to facilitate improvements in RI data in the DHIS2. METHODS: A pilot project was performed using intervention and control local government areas (LGAs). A mixed methods approach using both qualitative and quantitative methods was used to evaluate the system. We assessed changes in reporting rates across different reports. The evaluation also included baseline and post-intervention surveys of health facility (HF) staff. RESULTS: Reporting timeliness (76% pre and 99% post intervention) and completeness (83% pre and 99% post intervention) were consistently higher during the post-intervention than the pre-intervention period for facilities in the intervention LGA while reporting timeliness (65% pre and 66% post intervention) and completeness (71% and 77% post intervention) for facilities in the control LGA showed no change. Users reported that the SMS system was easy to understand and helped to facilitate improvements in consistency of data and timeliness of reporting. Inability of health care workers to effect changes at the HF level and the lack of immediate feedback were reported as key challenges to timeliness and quality of reports. CONCLUSION: An SMS-based intervention improved timeliness and completeness of health data reporting. However, the intervention should be evaluated on a larger scale over a longer time period before considering a national implementation.

INTRODUCTION: the National Primary Health Care Development Agency, African Field Epidemiology Network, United States Centers for Disease Control and Prevention and the Bill and Melinda Gates Foundation are implementing a Routine Immunization (RI) Module as part of their Routine Health Data Management System based on the 2013 - 2015 Accountability Framework for RI in Nigeria. To inform planning and evidence-based decision making, a data management needs assessment was conducted in Bauchi state which was one of the states selected for the deployment of the DHIS2 RI module. METHODS: desk reviews were conducted, and a semi-structured questionnaire was administered in four Local Government Areas (LGAs) in Bauchi state that were selected based on the initial evaluation of the performance of all 20 Bauchi LGAs. Ganjuwa and Shira were selected as high-performing LGAs and Alkaleri and Bogoro as low-performing LGAs. Four Health Facilities (HF) were selected in each LGA based on rural or urban classification, type of HFs (private or public), security and accessibility. RESULTS: local Immunization Officers (LIOs) prepare monthly reports in high-performing LGAs, and Community Health Care workers are mostly (69%) responsible for report compilation at the HFs. Shira and Alkaleri met 77% and 44% of training indicator targets, respectively, in the previous 12 months. Data recording and reporting was the type of training received the most by health facility personnel. Functioning refrigerators were in all visited LGAs, working thermometer and updated temperature monitoring charts were available in all the cold chain stores. However, no health facility reported having available computers for data-related activities. CONCLUSION: this assessment provided an improved understanding of the Bauchi state Routine Health Data Management System and informed the content of the state-wide scale-up.

INTRODUCTION: Timely and accurate data are necessary for informing sound decision-making and developing effective routine immunization (RI) programs. We launched a pilot project in Kano State to strengthen routine immunization (RI) data reporting through the immunization module of the District Health Information System version 2 (DHIS2). We examined the completeness and timeliness of reporting monthly RI data one year before and one year after DHIS2 module pilot in the State. METHODS: The first phase of the DHIS2 RI module pilot in Kano included training on RI data tools in November 2014 and in January 2015 for 36 state and zonal personnels, 276 local government area (LGA) personnel, and 2,423 health facility (HF) staff. A RI-focused dashboard to display core RI accountability framework indicators, such as completeness and timeliness of reporting, planned immunization sessions conducted, coverage and dropout was implemented. Report completeness was ratio of submitted reports to number of health facilities while report timeliness was ratio of reports on the DHIS2 by 14th of the month to number of expected. RESULTS: Completeness of data reporting increase from 70% in 2014 to 87% in 2015, while timeliness of reporting increase from 64% to 87% over the same period. Challenges encountered during the implementation process included limited access to internet, power outages, health workers strike, staff attrition and competing state activities. CONCLUSION: The pilot implementation of the DHIS2 immunization module in Kano State led to modest improvement in the reporting of RI services. Several lessons learned were used to guide scale-up to other states in the country.

INTRODUCTION: the Growing Expertise in E-health Knowledge and Skills (GEEKS) program is an applied apprenticeship program that aims to improve informatics capacity at various levels of the national health system and create a sustainable informatics workforce. Nigeria adapted the GEEKS model in 2019 as a mechanism to strengthen data quality and use of routine immunization (RI) and vaccine-preventable disease (VPD) surveillance data among Expanded Programme on Immunization (EPI) staff. Since the start of the GEEKS-EPI program, there has not been a formal assessment conducted to measure the extent to which GEEKS-EPI has been able to build local informatics workforce capacity and strengthen RI and VPD surveillance (VPDS) data quality and use in Nigeria. METHODS: we conducted a qualitative assessment to inform the extent to which GEEKS-EPI has been able to build informatics skillsets to enhance local workforce capacity, foster collaboration across government agencies, and create a sustainable informatics workforce in Nigeria. In-Depth Interviews (IDIs) and Focus Group Discussions (FGDs) were held with GEEKS-EPI supervisors, mentors, and mentees from previous GEEKS-EPI cohorts. RESULTS: while there were challenges reported during early implementation of the GEEKS-EPI program in Nigeria, particularly early on in the COVID-19 pandemic, participants and supervisors reported that the fellowship provided a framework for building a sustainable RI and VPDS informatics workforce through regular mentorship, peer-to-peer exchanges and Subject Matter Expert (SME)-led trainings. CONCLUSION: lessons learned from early implementation of GEEKS-EPI in Nigeria will help to inform its implementation in other countries, where strengthened national RI and VPDS informatics capacity is the primary objective.

Routine immunization (RI) delivery was declared a public health concern in Nigeria in 2017 because of persistently low immunization coverage rates reported in independent surveys. However, administrative coverage rates remain high, suggesting serious data quality issues. We posit that a shorter timespan between service provision and data reporting can improve the monitoring of RI data, and developed a short message system (SMS) text reporting strategy to generate daily RI data points from health facilities (HFs). The goal was to assess whether daily data collection produces complete, reliable and internally consistent data points. The SMS reporting platform was piloted between December 2017 and April 2018 in two Local Government Areas (LGAs, equivalent to districts) of Nasarawa state, Nigeria. The 145 healthcare workers from 55 HFs received one mobile phone and pre-configured SIM card, and were trained to send data through predefined codes. Healthcare workers compiled the data after each vaccination session and transmitted them via SMS. We analyzed completeness, number of weekly sessions, and supportive supervision conducted. During the pilot phase, we received data from 85% (n = 47) of the 55 HFs. We expected 66 fixed-post sessions and 30 outreach sessions per week, but received data for 33 fixed-post and 8 outreach weekly session on average. More HFs reported on Tuesdays compared to other days of the week. When assessing internal consistency, we observed that the reported number of children vaccinated was sometimes higher than the number of doses available from opening a given number of vaccine vials. When found, this discrepancy was noted for all antigens during fixed-post and outreach vaccination sessions. Despite these initial discrepancies, transmitting RI data sessions via texting is feasible and can provide real-time updates to the performance of the RI services at the HF level.

Background. Kano State, Nigeria, introduced inactivated polio vaccine (IPV) into its routine immunization (RI) schedule in March 2015 and was the pilot site for an RI data module for the National Health Management Information System (NHMIS). We determined factors impacting IPV introduction and the value of the RI module on monitoring new vaccine introduction. Methods. Two assessment approaches were used: (1) analysis of IPV vaccinations reported in NHMIS, and (2) survey of 20 local government areas (LGAs) and 60 associated health facilities (HF). Results. By April 2015, 66% of LGAs had at least 20% of HFs administering IPV, by June all LGAs had HFs administering IPV and by July, 91% of the HFs in Kano reported administering IPV. Among surveyed staff, most rated training and implementation as successful. Among HFs, 97% had updated RI reporting tools, although only 50% had updated microplans. Challenges among HFs included: IPV shortages (20%), hesitancy to administer 2 injectable vaccines (28%), lack of knowledge on multi-dose vial policy (30%) and age of IPV administration (8%). Conclusion. The introduction of IPV was largely successful in Kano and the RI module was effective in monitoring progress, although certain gaps were noted, which should be used to inform plans for future vaccine introductions.