Development Gateway Launches the IATI Import Tool

March 31, 2016
Aid Effectiveness & Management, Innovation, Launch, Open Data

Since the launch of the IATI Data Standard, DG has been in the forefront in promoting its uptake and use – particularly amongst national governments.

A little over a year ago, we began a program which sought to create sustainable integrations of IATI data across five nationally-owned Aid Information Management Systems (AIMS). One of the outcomes of this work were recommendations around proposed enhancements to the data standard and improvements to publisher quality.

Another result of this work, we are proud to share, has been the development of an open source IATI Import Tool, available to the public via GitHub.

Fully integratable with AIMS – Aid Management Platforms and other systems – the tool has already been used to import hundreds of millions of dollars of additional aid flow data into the AIMS of Burkina Faso, Chad, Cote d’Ivoire, Madagascar, and Senegal. Furthermore, this tool can be updated to support new versions of the IATI Standard, and now comes as a standard part of DG’s Aid Management Platform.

Technology and Architecture

The IATI Import Tool has been developed using the Spring Framework on the backend and ReactJS library on the frontend. The Spring Framework provides a comprehensive programming and configuration model for developing modern Java-based enterprise applications. ReactJS is an open source JavaScript library that makes it easy to develop reusable user interface components.

The tool has a flexible architecture, designed specifically to make the tool easily adaptable to future IATI versions and different AIMS. This flexibility is achieved through the use of data processing modules called “processors”. New processors can be added to support any source data or destination system.

<p>Processors</p>

The integration to an AIMS is done via REST API endpoints. Documentation of the endpoints that the AIMS system should provide is available on the IATI Import Tools’ GitHub page.

User Workflow

The IATI Import Tool has a user friendly user interface that is organized as a wizard, which takes users through the following steps:

Step 1: Source Input

<p>Step 1</p>

The source input is uploaded into the system and processed. Currently we support IATI 1.03, IATI 1.04, IATI 1.05 and IATI 2.01. This can be easily expanded to support other types of data files, too – IATI and otherwise.

Step 2: Filter Data

<p>Step 2</p>

The source activity/project information is then parsed and processed. The user can select the criteria of inclusion in the import process from a list of known fields, like “Status”, “Recipient Country”.

Step 3: Choose Projects

<p>Step 3</p>

After applying filters, the next step returns only projects/activities that match the applied filters. In this step, a user can select which projects/activities to import. The user can also map the projects to existing projects in the destination system.

Step 4: Choose Fields

Users can now select and map fields that will be included in the import. The user can also save mappings for use in future imports.

Step 5: Mapping Values

<p>Step 5</p>

This step allows users to map field values in the source file to values used in the destination system. These value mappings can be saved as a template, then selected from the “Load Existing Template” menu. This uses the previous mappings with the new file’s field values.

Step 6: Importing

<p>Step 6</p>

Once the source files are processed and filtered, and their projects, fields, and values are mapped the destination system is contacted through a series of REST Endpoints with the new and/or updated project information

Get Involved

The IATI Import Tool is licensed under an Apache 2.0 open-source license, now comes as a standard part of the Aid Management Platform, and is compatible with other AIMS. If you are interested in using or extending the tool you can get it on our GitHub repository. Please also check the wiki for additional documentation on how to integrate the tool with a target system, and let us know about your experiences!

Share This Post

Related from our library

Advancing Tobacco Control in Zambia: The TCDI Website

In response to the impending threat of tobacco use in Zambia and the various dangers that accompany it, the Tobacco Control Data Initiative website creates a “one-stop shop” to access the relevant data that Zambia’s policymakers need to advance tobacco control legislation.

December 14, 2022 Health
DG’s Open Contracting Portal Designated as a Digital Public Good

Digital Public Goods Alliance designated DG’s Open Contracting Portal as a digital public good in September 2022. The Portal provides procurement analytics that can be used to improve procurement efficiency and, in turn, reduce corruption and increase impact.

December 6, 2022 Open Contracting and Procurement Analytics, Process & Tools
Photo by Antonio Grosz on Unsplash
Announcing Development Gateway’s aLIVE Program: Advancing Livestock Data in Ethiopia

Development Gateway: an IREX Venture (DG)—with funding from The Bill & Melinda Gates Foundation (BMGF) and in partnership with Ethiopia’s Ministry of Agriculture (MoA)—is pleased to announce a new program, a Livestock Information Vision for Ethiopia (aLIVE). This four-year, $5 million program will empower Ethiopia’s stakeholders in the livestock sector to make data-informed decisions by providing relevant, accurate, timely, and digital livestock data and analytics. Ultimately, the aLIVE program will support Ethiopia in meeting national food demands as well as achieving food security while building a robust, more independent economy.

December 2, 2022 Agriculture