Over the past
two decades, alternative data sources have become increasingly important in the
compilation of Consumer Price Indices. Sources such as scanner data,
web-scraped price data, and administrative records are being utilized more and
more within national statistical systems for calculating price indices. In
response, the UN Task Team on Scanner Data was established in 2017 as part of
the UN Committee of Experts on Big Data and Data Science for Official
Statistics. Its initial mandate focused on exploring the use of scanner data in
official statistics, particularly in the context of consumer price statistics.
Subsequently, the team's scope expanded to include other alternative data
sources, including web-scraped and administrative data, relevant to the
construction of consumer price statistics.
The Task Team
has developed a comprehensive e-handbook detailing the application of these
alternative data sources for compiling consumer price indices, which includes
guidelines on data classification. This handbook is available on the UNSD wiki.
In conjunction
with the e-handbook, the Task Team is also releasing aligned training materials
via the UN learning platform. These courses are based on the following
structured curriculum that may be further expanded in the future:
1. Alternative
Data Sources (ADS) to compile CPI: an overview
2. Data
acquisition (forthcoming)
3. Preparation of
data (forthcoming)
4. Classification (forthcoming)
5. Data filtering
and missing prices (forthcoming)
6. Price index
methods (forthcoming)
7. Aggregation and implementation of a new production system (forthcoming)
Each course
consists of modules released on the UN learning platform. After each module there is a quiz to assess the participant's understanding of the material presented. Upon completing
all modules and quizzes successfully, attendees receive a certificate for the course.
For any observation or
suggestion, please send a message to Federico Polidoro (fpolidoro@worldbank.org) or Luigi
Palumbo (luigi.palumbo@bancaditalia.it).