The Common Denominators of Administrative Data and Official Statistics

February 26, 2019 Data Management Systems and MEL
Explainer

Miss the earlier post in this series? Check out the introductory post, Understanding National Data Ecosystems, before reading more!

What does “fit-for-purpose” data actually mean? 

It depends: on who you ask, and what decision is at stake. For governments and development partners – particularly those who rely on data from country systems for program planning and management – much frustration came from perceived redundancies in statistical and administrative data systems. 

 

Strengths and Limitations of Statistics

Overall, interviewees expressed confidence in statistical data, which are produced or overseen by National Statistical Offices (NSOs). However, serious barriers to the usefulness of statistical data for programmatic decisions included:

  • poor timeliness;
  • limited disaggregation – by sex, age, location, ethnicity, and disability status; and
  • incomplete access to machine-readable microdata.

As city and municipal interviewees pointed out, survey data disaggregated by region – oftentimes two or more administrative levels above – are not useful for local planning purposes.

Much of this frustration is inherent in how statistical data are collected. Statistics are often based on a representative sample, which is used to make population-wide generalizations. Collecting and publishing hyper-local statistical information – dis-aggregatable across 1,500+ Philippine cities and municipalities, for example – would require significantly more financial, time, and human resource investment in data collection and processing. In many countries, the decennial population census consumes 10-15% of the NSOs operating budget for the decade – underscoring the financial infeasibility of frequent, disaggregated statistics. 

In some contexts, a secondary concern lies with the politicization of statistics, which can result in direct interference or under-resourcing. Increased investment in NSOs – to ensure they are able to remain independent government entities, provided the appropriate human, technical, and financial resources, and empowered with appropriate legal authority to coordinate National Statistical Systems – is vital. 

 

The Missing Middle in Administrative Data

Yet human development inequities, and subnational governance responsibilities, often require more timely and disaggregated data than official statistics can provide. Administrative data systems are a potential resource that can complement official statistics, addressing some of data timeliness and disaggregation gaps. For example, when used with a statistical denominator, administrative data from ministries of health can provide more accurate picture of disease rates. However, many expressed serious concerns with administrative data quality. 

In contrast with statistical information – for which interviewees could typically pinpoint specific methodological or political issues impacting data quality – there was generally not a clear understanding of how to systematically assess the quality of available administrative data. 

In most cases, service delivery workers are mandated to report administrative data at the facility or local levels: teachers are expected to report student attendance in education management information systems (EMIS), doctors and nurses in health management information systems (HMIS), etc. Common challenges to this type of data collection include infrastructure (connectivity, technology), and – more importantly – local staff incentives and trade-offs of dedicating time to such reporting. 

But we frequently found that custodial data agencies often did not perceive their own data quality as a concern. This mismatch between administrative data user trust and custodial perceptions contributed to a pessimism regarding the usefulness of data in decision-making. 

 

“We went to the ministry to get school enrollment rates [from the EMIS]… but when we got to the target district, we found a discrepancy between ministry and district-level enrollment data… I’m not sure why there was an inconsistency.”

                                                                                                                                                                       – Interviewee

 

In many cases, there was some consensus that NSOs or National Planning Commissions should serve as administrative data quality overseers. However, in many contexts such a role is beyond either agency’s mandate. Even with a fully elaborated framework, limitations in NSO legal mandates – and the financial resources and staff skill sets needed to conduct data quality assurance – make achieving such centralized, top-down data quality a challenge. 

So – are there systemic opportunities to increase the quality and trust in administrative data? Stay tuned for our next post, where we explore opportunities for greater quality and trust – provided we get the incentives right.

Over the past two years, Development Gateway (DG) worked across seven countries and two regions to support the roll-out of UNICEF’s Data for Children Strategic Framework. This work included developing country ecosystem diagnostics and strategic action plans for UNICEF Country Offices in Myanmar, Papua New Guinea, Philippines, Thailand, Viet Nam, Lesotho, and Ethiopia; and for the UNICEF East Asia and Pacific Regional Office. Development Gateway holds long-term agreement with UNICEF to continue this work around the world.

Image: DFID UK, (CC BY 2.0)

Share This Post

Related from our library

Developing Data Systems: Five Issues IREX and DG Explored at Festival de Datos

IREX and Development Gateway: An IREX Venture participated in Festival de Datos from November 7-9, 2023. In this blog, Philip Davidovich, Annie Kilroy, Josh Powell, and Tom Orrell explore five key issues discussed at Festival de Datos on advancing data systems and how IREX and DG are meeting these challenges.

January 17, 2024 Data Management Systems and MEL
Fertilizer Technical Working Groups Provide Key Insights into Africa’s Fertilizer Sector

From June 2021 to September 2022, Development Gateway: An IREX Venture’s (DG’s) Visualizing Insights on Fertilizer for African Agriculture (VIFAA) program convened 12 Fertilizer Technical Working Groups in 14 countries which have yielded essential information on Africa’s fertilizer sector, including insights on how geopolitical events have impacted the fertilizer sector and what is needed to mitigate resulting threats to food security throughout Africa.

May 4, 2023 Agriculture
The Cashew-IN Platform: An Assessment of the Cashew Sectors in Five Countries (Part 2)

In the first part of this blog series, we discussed the CALM assessment of the cashew data ecosystem, key findings from the assessment, and how DG is using the findings as well as partner and stakeholder feedback to guide the development of the Cashew-IN platform, a website that will facilitate access to and use of data to improve decision-making for policymakers, farmers, and the private sector. In this blog, we will look at the indicators on the Cashew-IN platform and what the data is telling us about the cashew sector more broadly.

April 27, 2023 Agriculture