Investing in young and emerging evaluators: Reflections from the 2nd Summer Evaluation Bootcamp in Mongolia

Xin Xin Yang (Multi-Country Evaluation Specialist at UNICEF) reflects on the 2nd Summer Evaluation Bootcamp for Young and Emerging Evaluators (YEEs) in Mongolia, a program designed to empower the next generation of M&E professionals in Mongolia and China.

Investing in young and emerging evaluators (YEEs) is essential for strengthening national evaluation capacities and promoting inclusive, culturally responsive evaluation practices. To address this need, the evaluation community has launched various initiatives aimed at engaging YEEs, enhancing their skills, and fostering their leadership potential. A notable example is the 2nd Summer Evaluation Bootcamp for YEEs in Mongolia, which took place from July 9 to 11, 2024, as part of the global ‘Youth in Evaluation Week’. This event, collaboratively organized by UNICEF, the Mongolian Evaluation Association, and American University, is a vibrant component of the Eval4Action movement.

The bootcamp was designed to empower the next generation of monitoring and evaluation (M&E) professionals in Mongolia and China. The event attracted a full house with 23 participants, including representatives from government agencies, private research firms, academic institutions, international organizations, and students. Given that evaluation is a relatively new profession and most evaluation assignments in the real world require that evaluators possess expertise in both evaluation and other areas, the bootcamp adopted a broad interpretation of “young and emerging evaluators”. This inclusive approach encouraged participation from evaluators with limited experience across all age groups, including established professionals from other fields.

This mix of fresh perspectives and budding expertise fostered vibrant discussions and a rich exchange of ideas. The feedback received in the post-training surveys was overwhelmingly positive: 66.7% of participants were not just satisfied but highly impressed with the sessions, and the remaining participants also expressed their overall satisfaction with the experience.

Here are some key takeaways contributing to the success of this transformative event, which may inspire and benefit the organization of similar activities.

Leveraging global evaluation campaigns to increase VOPEs’ impact

This bootcamp showcased how a young and fledgling evaluation association can organize impactful events and rapidly develop its international profile by leveraging global campaigns.

Founded in 2021 amidst the COVID-19 pandemic, the Mongolian Evaluation Association is committed to enhancing the professionalization and institutionalization of evaluation practices at the national level in Mongolia. It has successfully organized several events during the gLOCAL Evaluation Weeks and Youth in Evaluation Weeks. These campaigns provide crucial momentum for NECD activities, particularly for new Voluntary Organizations for Professional Evaluation (VOPEs) in countries still cultivating a culture of evaluation. By aligning with these global movements, local organizers can adopt a shared agenda while customizing themes and approaches to fit their unique contexts. This alignment also facilitates access to broader support from the evaluation community, bridging gaps in human resources and expertise.

During the 2024 bootcamp, prominent leaders from the Asia Pacific Evaluation Association, International Organization for Cooperation in Evaluation, EvalYouth Global, and EvalYouth Asia delivered speeches in a session dedicated to creating career and training opportunities for YEEs at various levels. These presentations not only reinforced a sense of belonging among the YEEs to the global evaluation community but also inspired their dedication to pursuing a career in evaluation.

Strengthening partnerships for cultural responsiveness and international standards

The bootcamp adeptly addressed the dual objectives of integrating international evaluation standards and methods while nurturing culturally responsive evaluation practices among YEEs. This achievement is largely attributed to the strategic partnership between the Mongolian Evaluation Association and American University.

In April 2023, the Mongolian Evaluation Association formalized its collaboration with American University’s Measurement & Evaluation Program through a Memorandum of Understanding (MoU). This MoU promotes active participation from American University faculty and alumni in various educational activities, including learning sessions, evaluation case competitions, and evaluation bootcamps. During the inaugural Summer Evaluation Bootcamp last year, American University facilitators conducted three training sessions. This year, the collaboration was further strengthened, with American University providing  trainers for five sessions covering essential technical topics such as Logic Models, Qualitative Analysis, Quantitative Methods, Complexity in Evaluation, and Most Significant Change.

In addition, experienced Mongolian evaluators shared their in-depth understanding of the cultural and social nuances involved in conducting evaluations in the country. They led sessions on the Evaluators' Competency Framework, the Nexus of Environmental, Social, and Governance Impact Measurement and Management, and Evaluation Report & Communication in Mongolia. This collaborative framework ensured active participation from seasoned national and international evaluators and contributed to high course quality through the incorporation of contemporary evaluation practices and local contextual knowledge.

Adopting a strategic sub-regional NECD approach

UNICEF has been pivotal in enhancing and sustaining the Summer Evaluation Bootcamp’s impact. From the outset, UNICEF’s vision for this event extended beyond Mongolia, aiming for a broader reach. While the primary participants of the bootcamp were YEEs from Mongolia, facilitated by the country’s robust evaluation association, UNICEF also intended for this event to serve as a learning opportunity for Chinese participants. This would allow them to observe the impact of a VOPE, a model not yet established in China.

UNICEF has a decentralized evaluation function, with a multi-country evaluation specialist overseeing work in China, Mongolia, and DPRK. This enabled the planning and execution of NECD activities from a sub-regional perspective and facilitated the selection of four participants from China who were invited to attend the bootcamp. These participants, representing higher education institutions, international development partners and civil society organizations , exemplified institutions that could potentially contribute to building a community of evaluators and strengthening the evaluation culture in China.

UNICEF also provided financial support for the event, allowing the Mongolian Evaluation Association to rent a venue near Ulaanbaatar suitable for small group training sessions. The tranquil setting, combined with the available amenities, created an ideal environment for participants to focus on training content, build bonds with peers, and experience the unique Mongolian culture that influences evaluation practices in the country.

UNICEF’s involvement in the bootcamp contributed greatly to its success. The attendance of Chinese participants elevated the event’s profile, and using a sub-regional model established a new approach to supporting NECD events, attracting interest from several potential donors to support future bootcamps. From this perspective, UNICEF’s investment effectively served as seed money to leverage further financial support.

Final thoughts

The second Summer Evaluation Bootcamp in Mongolia exemplifies the power of strategic partnerships and global collaboration in fostering the next generation of evaluators. By integrating international standards with culturally responsive practices, and leveraging support from organizations like UNICEF, the Mongolian Evaluation Association, and American University, the Summer Evaluation Bootcamp has created a robust platform for YEEs to develop their skills and leadership potential. The event’s success highlights the importance of investing in young evaluators and sets a precedent for future NECD activities, demonstrating how targeted initiatives can contribute to building a vibrant and sustainable evaluation ecosystem in a sub-region.

I hope this blog post has provided some useful insights and lessons for those who are interested in or involved in national evaluation capacity development. The views expressed in this blog are those of the author and do not necessarily reflect the official position of UNICEF.  I welcome your comments and feedback. Thank you for reading.