Custom Assessment Landscape Methodology 2.0 – Reflections After Five Years

March 19, 2024 Process & Tools
Annie Kilroy
Thought Leadership

After nearly 25 years of implementing digital solutions to support development, government, and civil society partners across the globe, Development Gateway: An IREX Venture (DG) has learned that supplying data or digital tools alone is not enough to influence behavior change; there must also be sufficient demand for the solution, and it must fit the needs of key users. To do this requires a holistic understanding of the data and digital ecosystem in which a given solution operates and the institutional, managerial, individual, and technical factors that enable—or discourage—using data and digital solutions for better development decisions. Our flagship Custom Assessment Landscape Methodology (CALM) was first published in late 2018, outlining our approach to optimizing decision-making with data and digital solutions by comprehensively assessing the complex ecosystem of information, tools, decision-makers, power relations, and decision spaces.

Since CALM was first introduced, we have used CALM to: 

Five years later, our latest white paper re-introduces CALM to help our partners, collaborators, and teammates better understand and engage with this kind of flexible and adaptive assessment methodology. This “CALM 2.0” publication explains:

  • WHAT CALM’s theory of change is, including its roots in the problem-driven iterative adaptation (PDIA) approach to capacity-building, human-centered design thinking, and Agile software development;
  • WHY we believe this is the best approach to understanding the complex digital ecosystems in which we work;
  • HOW CALM’s implementation methodology aligns with its theory of change by being adaptive and co-designed with stakeholders, rather than rigid and prescriptive; and
  • DEFINITIONS for key CALM terms like decision space, use cases, supply/demand/use, and incentives.

Although we’ve updated our documentation, our key message from CALM 1.0 remains the same: we assert that simply supplying data or digital tools alone is insufficient; to be truly equitable and sustainable, digital solutions must involve a systems-level understanding of incentives, decision spaces, and user needs. We hope that CALM 2.0 readers better understand what these approaches and methods are, why DG applies them to ecosystem assessments, and how they can lead to more useful and usable digital systems and solutions. We look forward to the next five years of applying and adapting CALM and developing sustainable digital tools to drive better development outcomes.

Read the entire white paper here.


Recent Posts

Launching the Early Grade Education Activity (ASAS) Program: A Collaborative Project from IREX and DG

IREX and Development Gateway: An IREX Venture (DG) are pleased to announce their collaborative work on the USAID-funded Early Grades Education Activity (ASAS) program, which launched in August 2023 and will run through July 2028. This blog explores how the ASAS program will empower teachers, universities, communities, and stakeholders within Jordan’s Ministry of Education and throughout the country to deliver inclusive and holistic early-grade education for Jordanian students from kindergarten to grade three in order to strengthen numeracy and literacy skills.

July 9, 2024 Education
At a Glance | Evidence-Informed Policymaking: Education Data-Driven Decision Mapping in Kenya and Senegal

Development Gateway: An IREX Venture (DG) and our strategic partner IREX, supported by the William & Flora Hewlett Foundation, conducted a study of the education data systems in Kenya and Senegal. In our findings from this study, we underscore the necessity of a harmonized approach to education data management and share insights that provide a valuable roadmap for future reforms and investments in education data systems.

July 2, 2024 Data Management Systems and MEL, Education
At a Glance | Tracking Climate Finance in Africa: Political and Technical Insights on Building Sustainable Digital Public Goods

In order to combat the effects of climate change, financing is needed to fund effective climate fighting strategies. Our white paper, “Tracking Climate Finance in Africa: Political and Technical Insights on Building Sustainable Digital Public Goods,” explores the importance of climate finance tracking, common barriers to establishing climate finance tracking systems, and five insights on developing climate finance tracking systems.

June 24, 2024 Data Management Systems and MEL, Global Data Policy