Shows
EvaluLand49: Advocacy Evaluation with Robin Lin MillerI chat with Robin Lin Miller about the book she wrote with George Ayala, "Breaking Barriers: Sexual and Gender Minority-Led Advocacy to End AIDS in Africa and the Caribbean." We discuss MPact, Project ACT, and the evaluation of the initiatives.
About Robin Lin Miller
Robin Lin Miller, PhD is Professor of Psychology, director of doctoral training in ecological-community psychology, and associate director of training in program evaluation at Michigan State University. She served as lead evaluation specialist for Gay Men’s Health Crisis in the early years of the HIV epidemic and established its first De...2025-07-081h 02EvaluLand48: The Garden of Evaluation ApproachesIn this episode, I chat with the authors of The Garden of Evaluation Approaches about their innovative and helpful framework for thinking about evaluation theory and approaches. They each share their personal journeys into evaluation as well as into this work they have been collaborating on for years. We also discuss evaluation theory more broadly, including how to make it more accessible to new and emerging evaluators.
About guests:
Bianca Montrosse-Moorhead is a Professor of Research Methods, Measurement, and Evaluation at the University of Connecticut, where she also directs the Partnership for Evaluation and Educational...2025-04-221h 20EvaluLand47: Jennifer VillalobosIn this week’s episode, I talk with Dr. Jennifer Villalobos about evaluator education, the scholar-practitioner model, evaluation careers, and how the current administration is affecting evaluation.
Contact information: Jennifer P. Villalobos - jennifer.villalobos@cgu.edu
About Dr. Jennifer Villalobos: Jennifer P. Villalobos, PhD, is an Assistant Professor of Practice and Director of the Doctor of Evaluation Practice (D.Eval) program at Claremont Graduate University. As an evaluator, scholar-practitioner, and organizational psychologist, her work focuses on advancing socially responsive evaluation, helping organizations increase their DEI profile, positive psychological interventions, and the intersection of evaluation ed...2025-03-2556 minEvaluLand46: Reflections on Foundations of EvaluationI share my reflections on teaching Foundations of Evaluation after a major course revision, including how it's been going for the first four weeks.
Music by Matt Ingelson, http://www.mattingelsonmusic.com/Support EvaluLand2025-02-2550 minEvaluLand45: Sheila Robinson and Kim LeonardThis episode featured Kim Leonard and Sheila Robinson discussing their careers in evaluation and survey design. They shared how they met on Twitter in 2012 and began collaborating, writing blog posts that eventually became their book "Designing Quality Survey Questions" published by Sage Publications. Sheila and Kim discussed their process for writing the book, starting with blog content and building it out over several years into a full manuscript. They also covered common issues they see in surveys and tips for developing effective survey questions.
Sheila Robinson: https://www.sheilabrobinson.com/ & https://www.linkedin.com/in/sheilabrobinson/
...2024-05-281h 02EvaluLand44: Brittany DernbergerThis month I chat with Brittany Dernberger about her evaluation background and practice.
Brittany Dernberger is a sociologist and gender inequality expert who has led research, evaluation, and organizational learning across academia, philanthropy, government, large international NGOs, and small nonprofits. Brittany currently leads global initiatives to measure systems-level change at CARE and co-chairs the American Evaluation Association Systems in Evaluation Topical Interest Group.
Learn more about Brittany’s work at http://brittanydernberger.com/. Access CARE’s completed Systems-Level Impact evaluations at https://careevaluations.org/evaluation/keywords/systems-level-impact/. The AEA Systems in Evaluation TIG paper on Prin...2024-04-2350 minEvaluLand43: Allison PrieurThis month I talk with Allison Prieur about her experiences as a graduate student in evaluation and running a business.
Some resources mentioned or suggested for listeners:
Logic of evaluation
Evaluation of logic in practice
Destination Dissertation
Allison Prieur's LinkedIn profile
Music by Matt Ingelson, http://www.mattingelsonmusic.com/Support EvaluLand2024-03-2650 min
Between the Data - NVivo Podcast SeriesEpisode 55: Demystifying Research and Evaluation: A Conversation with Dr. Dana LanellIn this podcast episode, Dr. Dana Linnell, Assistant Professor of Psychology in Evaluation at the University of Wisconsin-Stout focuses on the evaluation profession, including defining evaluation, data visualization practices in evaluation, the role of politics in evaluation, and more. Dana is one of our Keynote speakers at this year’s Lumivero Virtual Conference in September 27 and 28, 2023. REGISTER for FREE 2023-07-1730 minEvaluLand42: Making ECB sticky with Corey Newhouse and Jessica Manta MeyerIn this episode, I chat with Corey Newhouse and Jessica Manta Meyer, both from Public Profit, about how to make evaluation capacity building sticky for the organizations we work with.
Some resources mentioned:
TIERS Framework
Tipping Point Community
Irvine Foundation
Change Cadet
NonProfit AF article on capacity building does not work
Info on the Public Profit’s evaluation cohort
Contact information:
info@publicprofit.net
About Corey:
Corey got her start as a teacher at Summerbridge Cincinnati in the early 1990s and has been involved in educational equity and social ju...2023-06-201h 12EvaluLand41: Theory-based approaches for navigating complexity with Michael MosesIn this episode, I chat with Michael Moses about theory-based approaches for navigating complexity, adaptive management, participatory strategy, and actions to shift power.
Things and resources mentioned:
Systems thinking in evaluation (including a discussion of complexity) - Bob Williams and Sjon Van't Hof
Outcome mapping and outcome harvesting and emergent learning
Emergent Learning (including before action reviews, after action reviews, emergent learning tables, and more approaches for supporting collective learning and action)
Strategy Testing - Deborah Ladner and the Asia Foundation
Kat Haugh - visual facilitation, sensemaking, and notetaking
Learning to Make All Voices Count Initiative...2023-05-2355 minEvaluLand40: Community-based participatory research with Dr. Tatiana BustosIn this episode, I chat with Dr. Tatiana Elisa Bustos on community-based participatory research (CBPR). We talked about what it is, how it compares to research and other similar forms of inquiry, and how to get started doing CBPR.
Disclaimer: Views expressed here are personal and not reflective of the speaker's respective employers or agencies.
Contact information
Dr. Tatiana Elisa Bustos
tbust002@gmail.com
@TElisa72
https://www.linkedin.com/in/tebustos/
About Dr. Bustos
Dr. Tatiana Elisa Bustos knows that community partner engagement is key to...2023-02-0734 minEvaluLand39: #Eval22 Conference PreviewIn this episode, I provide a brief overview of the #Eval22 conference, describe the schedule at a glance, and provide tips for getting the most out of the conference. I hope to see you in New Orleans! Say hi to me at the conference to get an EvaluLand nametag ribbon.
Eval22 Resources
Register to attend the AEA Annual Business Meeting on November 3 at 2pm ET; a recording will be made available after the meeting.
Register to attend TIG virtual meetings before and after the conference
See the conference schedule at a glance or the entire searchable...2022-11-0115 minEvaluLand38: Subcontracting with Dr. Tamara HamaiI talked with Dr. Tamara Hamai of Hamai Consulting about contracting, subcontracting, and independent consulting in evaluation. We discussed the minor differences between contracting and subcontracting, cleared up a common misconception of what subcontracting relationships are like, how to get into subcontracting, and tips for setting up contracts.
Contact information:
Tamara Hamai
Hamai Consulting
assistant@hamaiconsulting.com
https://sustainableimpact.co
About Dr. Tamara Hamai:
Tamara Hamai, Ph.D., has dedicated her career to empowering organizations and rebuilding our global systems to encourage children’s holistic growth and well-being, fr...2022-09-0652 minEvaluLand37: Strategic Planning with Carrie Tanasichuk and Harry DaleyThis episode I chatted with Carrie Tanasichuk and Harry Daley about how they have been using theories of change as their main process for facilitating strategic planning with non-profits.
In the episode, they also mentioned:
The Community Foundation of Saint John’s impact measurement and evaluation principles
The Community Builder’s Approach to Theory of Change
The Miles Nadal JCC Theory of Change
About Carrie and Harry:
*Carrie Tanasichuk *(Twitter DrCarrieTee & [carrie@sjfoundation.ca](carrie@sjfoundation.ca)) has 16 years of experience in evaluation. She is passionate about using her expertise to help organizations demo...2022-08-021h 02EvaluLand36: Evaluation Job Market with Bradlie NaboursThis episode I chatted with Bradlie Nabours about how he got into the field of evaluation and his experience applying for evaluation jobs. He also talks about his evaluation experience and provides great tips on applying for jobs in the evaluation space.
Job search & application recommendations:
Don’t give up. Know your worth. The job process is difficult, but don’t settle and remember it doesn’t reflect necessarily on you. Keep applying!
Don’t limit yourself in what positions you look for. Expand your horizons.
Network like your life depends on it! This includes having an onlin...2022-07-0554 minEvaluLand35: International Evaluation with Dr. Tristi NicholsOn this episode, I’m chatting with Dr. Tristi Nichols about her work conducting international evaluation and her journey into the international and evaluation spaces.
Resources:
Footprint evaluation
OECD DAC Criteria for Evaluation Framework
List of websites to find international evaluation:
https://www.ungm.org/ type “evaluation” in the title bar [for UN only]
https://reliefweb.int/ or https://reliefweb.int/jobs
https://www.evalcommunity.com/
Contact information:
Tristi Nichols
tnichols@manitouinc.com
914-414-8288
@tristiempo
https://www.linkedin.com/in/drtristinichols/
Music by Matt Ingels...2022-06-0757 minEvaluLand34: Evaluation Job Market with Dr. Ayesha BoyceOn this episode, I’m chatting with Dr. Ayesha Boyce about the evaluation job market. Ayesha provides a ton of great insights and information about how to search for jobs, what to consider when looking for jobs, and tips for being a strong job candidate.
Ayesha was previously on the podcast discussing "teaching evaluation and supporting students and colleagues of color."
Contact information:
Ayesha Boyce
Email: ayesha.boyce@asu.edu
Twitter: @AyeshaBoyce
Website: https://education.asu.edu/about/people/ayesha-boyce
About GUEST:
Ayesha Boyce is currently an...2022-05-0359 minEvaluLand33: Worker Training Evaluation with Dr. Eric PersaudOn this episode, I’m chatting with Eric Persaud about evaluation at the National Institutes of Health, including his work in the Worker Training Program at the National Institute of Environmental Health Sciences. We also talked about his dissertation, how he got into the field of evaluation, and his experiences in conducting evaluation in general.
About Dr. Eric Persaud:
Eric Persaud received his doctorate in Public Health at the Department of Environmental and Occupational Health Sciences, State University of New York-Downstate Health Sciences University. He focuses on evaluating and researching training programs related to preparing wo...2022-04-1249 minEvaluLand32: Systemic Design Thinking with Jan NogaThis episode I chatted with Jan Noga about systemic design thinking. There’s a wealth of resources and information provided below!
Contact information:
Jan Noga
Jan.Noga@pathfinderevaluation.com
www.pathfinderevaluation.com
About Jan Noga:
Jan Noga is an independent evaluation consultant based in Cincinnati, Ohio. She holds a bachelor’s degree from Stanford in developmental and counseling psychology with specialization in early and middle childhood and a master’s degree from the University of Cincinnati in instructional design and technology. Jan has worked in the non-profit and public sector...2022-03-081h 05EvaluLand31: Trauma-informed organizations with Martha BrownThis episode I chat with Martha Brown, PhD about trauma-informed evaluation, but more specifically about how we as evaluators can help organizations become more trauma-informed. We talk about trauma, the SAMHSA model of trauma-informed work, and much more!
Martha talked about trauma-informed evaluation also on the Glass Frog podcast with Debbie Gowensmith and on the Community Possibilities podcast. Other resources mentioned include the AEA365 series on trauma-informed evaluation and the Center for Victims of Torture.
For an introductory, self-paced course to learn more about trauma and what it means to be trauma-informed, visit https://www...2022-02-081h 01EvaluLand30: Eval21Reflections with Radical (Re)imaginingI chat with Libby Smith and Tiffany Tovey, two of the three hosts of the Radical Re(imagining) podcast, to chat about what felt radical about the 2021 AEA virtual conference.
We'd love to hear from you! What felt radical to you about the conference? Feel free to add your reflections on LinkedIn or Twitter. Be sure to use the #Eval21 hashtag, and tag us in your reflections!
Twitter accounts:
@RadReImagining
@work_with_libby
@Tiffany7001
@EvaluLand
@danawanzer
Music by Matt Ingelson, http://www.mattingelsonmusic.com/Support EvaluLand2021-12-0738 minEvaluLand29: Project Management with Jennifer PumaJennifer Puma and I talk about project management in evaluation, including how she manages evaluation projects from start to finish and how she brings her project management training into her organizations and with the clients she works with. We discuss things like scoping projects, setting up ad hoc meetings, how project management aligns with various types of budgeting approaches, and so much more!
Also, be sure to check out the Glass Frog Podcast, which is another evaluation-related podcast that I highly recommend!
As a reformed management consultant, Jennifer leverages more than 15 years of consulting and...2021-12-021h 14EvaluLand28: Project Management with Jennifer BisgardJennifer Bisgard and I talk about project management in evaluation, including how she manages evaluation projects from start to finish and useful tools in her company's practice. Jennifer has a wealth of information in her over 20 years of experience leading evaluation projects, and I learned a lot about how to better do this work from her. Khulisa has a wonderful library of resources including blog posts about QASP, analyzing WhatsApp data, and using rubrics. Every Tuesday they publish #EvalTuesdayTip.
Ms Jennifer Bisgard co-founded Khulisa Management Services in 1993. An expert in monitoring and evaluation (M&E) and organisational...2021-11-181h 08EvaluLand27: Independent Consulting with Elizabeth GrimElizabeth and I discuss her new independent consulting business (Elizabeth Grim Consulting LLC) and how she meets clients where they are, builds capacity and relationships, and leans into her values in the work. We also discuss Brene Brown's values exercise and another version of the exercise as a card deck, how we've embraced new ways of thinking about the world, and reporting in evaluation.
Music by Matt Ingelson, http://www.mattingelsonmusic.com/Support EvaluLand2021-10-2654 minEvaluLand26: Evaluation entrepreneurship with Nina Sabarre_Note: Sorry for the poor audio quality on my end. Recording is hard... _
Nina and I discuss her incredible journey through evaluation from research analyst to independent consultant to founder and principal of her own evaluation consulting firm, Intention 2 Impact. We discuss starting up her business and how that's been going. Along the way, we also discuss her evaluation background, including her dissertation-in-progress on entrepreneurship in evaluation.
Music by Matt Ingelson, http://www.mattingelsonmusic.com/Support EvaluLand2021-09-2855 minEvaluLand25: What's the difference between evaluation and research? An interview by James PannI'm interviewed by James Pann, PhD about my latest research on evaluation study in the American Journal of Evaluation. We discuss the difference between research and evaluation, the pros and cons of professionalization, the definition of evaluation, and other evaluation related topics.
Link to the article in AJE
Link to the YouTube video of the interview
If you've got ideas for the podcast, or would like to be a guest on the podcast (students, practitioners, scholars, and others are all welcome!), then please email me at dana@danawanzer.com
Music by...2021-07-1358 minEvaluLand24: Evaluation Worldwide - Eastern Europe, Central Asia, and South CaucasusAfter chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world.
This episode is one in which I chat with evaluators from the Eastern Europe, Central Asia, and South Caucasus (ECA) about what evaluation looks like in their region. I chat with Tamara Kabysh-Rybalka and Dana Reva, both of whom are involved with EvalYouth ECA, about their experiences evaluating in their region.
We discuss a variety of topics, including how they define evaluation, how their countries and region affects how...2021-05-1140 minEvaluLand23: Evaluation Worldwide - Middle East and North AfricaAfter chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world.
This episode is one in which I chat with evaluators from the Middle East and North Africa (MENA) about what evaluation looks like in their region. I chat with Hayat Askar and Sana Ben Salem about their experiences evaluating in their region, specifically Jordan and Tunisia, respectively.
We discuss a variety of topics, including how they define evaluation, how their countries and region affects how evaluation is done, what...2021-04-2748 minEvaluLand22: Evaluation Worldwide - Latin America and CaribbeanAfter chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world.
This episode is one in which I chat with evaluators from Latin America and the Caribbean (LAC) about what evaluation looks like in their region. I chat with Claudia Olavarría and Gerardo Sánchez-Romero about evaluation in the LAC region. They are the co-chairs of EvalYouth LAC, which you can contact via Twitter, Facebook, or email via evalyouthlac@gmail.com.
We discuss a variety of topics, including how th...2021-04-131h 06EvaluLand21: Evaluation Worldwide - EuropeAfter chatting with folks from EvalYouth about the Global Mentoring Program, they suggested a series of podcast episodes on what evaluation looks like around the world.
This episode is one in which I chat with evaluators from Europe about what evaluation looks like in their region. I chat with Tom Ling and Oto Potluka about European evaluation. They are both board members of the European Evaluation Society, the professional association for evaluators in Europe. We discuss a variety of topics, including the streams of evaluation happening in evaluation, the role of evaluators in program design, reflective practice...2021-03-3047 min
This Might Be A PodcastThis Might Be A Podcast - Episode 123.5 - John Linnell’s House of MayorsLydia Sekscenski, Dana Williamson and myself dissect the 1996 solo EP by John Linnell, released for the Hello Recording Club. We discuss every track, talk about the mayors, the music, and find a few covers.2021-03-2141 minEvaluLand20: The Influence of Carol Weiss with Gregory Greenman IIWe’re getting meta today… looking at the influence of a major influencer in evaluation: Carol Weiss! I chat with Gregory Greenman II about his dissertation examining citation metrics of her work across disciplines.
About Gregory:
Gregory spends a lot of his time thinking about the nature of evidence and its role in policy decisions. He believes that applying sound evaluative thinking and appropriate research methods helps us down the path toward building a just and equitable society. His current research examines the "how and why" of evidence-based policymaking and how we evaluate interdisciplinary research.
2021-03-1647 minEvaluLand19: Book Publishing with Helen SalmonI chat with Helen Salmon from SAGE Publishing about book publishing! We go over how to generate ideas for books, what the book publishing process looks like, and about some of the most recent evaluation books from SAGE!
Sage has been a friendly publisher for evaluation books for decades. As Patton stated in the third edition of Qualitative Research and Evaluation Methods (2002): "[Sara Miller McCune's] vision and follow-through have made Sage publications the leading publisher of both evaluation and qualitative inquiry books." (p. xxiv).
Some recent evaluation books mentioned:
Evaluation in Today's World by...2021-03-0236 minEvaluLand18: EvalYouth Global Mentoring ProgramIn this week's episode, I chat with Sawsan Al-Zatari, Zach Tilton, and Teddy Theoharis about the EvalYouth Global Mentoring Program (EY-GMP).
Links:
EvalYouth
YEEs in VOPEs
Mentoring program
E-Learning
Youth participatory evaluation
EY-GMP evaluations:
2017-18 Pilot Phase
2018-19
2020 in-progress
How to get involved:
Become a volunteer for EvalYouth
Join a Task Force
Follow on social media: Twitter, LinkedIn, Facebook, and YouTube
Music by Matt Ingelson, http://www.mattingelsonmusic.com/Support EvaluLand2021-02-1644 minEvaluLand17: Teaching Interpersonal Effectiveness with Tiffany Smith and Libby SmithThis week I chat with Tiffany Smith and Libby Smith about our experiences teaching a course on interpersonal effectiveness in the MS in Applied Psychology program at the University of Wisconsin-Stout. We also discuss why teaching interpersonal skills is important and why we believe these skills can and should be explicitly taught.
Some background on the course
The course is a 3-credit, 8-week course that focuses on developing self-awareness through personal and collaborative reflective practice. It is the third course in the evaluation concentration. Tiffany brought this course to our evaluation program and taught it...2021-02-021h 04EvaluLand16: Social Justice Evaluation with Dr. Aisha RiosThis week I chat with Dr. Aisha Rios to both get to know her a little better and to talk about social justice in evaluation.
Topics & Resources Mentioned:
Getting to know Dr. Rios and Coactive Change a little better
What is social justice in evaluation?
Emergent strategy as guiding Dr. Rios in framing social justice evaluation as about imagining different futures
Abolition literature as another influence for Dr. Rios
Studying up vs studying down: "Up the anthropologist-Perspectives gained from studying up" by Laura Nader
AEA session “Illuminating the future context through an equity lens: Why systems ev...2021-01-191h 04EvaluLand15: PodcastingI've received multiple questions about my podcasting setup and process. Rather than answer the questions individually, I thought I would podcast about it! I discuss why I got into podcasting, my recording technology and room setup, the audio processing my husband (aka audio engineer) does, podcast hosting, the general timeline for me to create an episode, and some extra few questions.
Technology
Old microphone: FIFINE Plug & Play Home Studio USB Condenser Microphone
Mic stand: Gator Frameworks Short Weighted Base Microphone Stand
New microphone: Audio-Technica AT 2020 Cardioid Condenser Studio XLR Microphone
USB audio interface: Focusrite Scarlett Solo (3...2021-01-0524 minEvaluLand14: Coalition EvaluationThis episode I chat with Ann Webb Price and Susan Wolfe about coalition evaluation, partnering together in evaluation, the independent consulting TIG of AEA, and so much more!
Topics & Resources Mentioned:
How Ann and Susan started working together
What is coalition evaluation?
How coalition evaluation uses a systems approach
Advice for doing coalition evaluation, including not just "but why?" but "but why here?"
Community Coalition Action Theory, which one book they recommend is Ignite!
Tearless logic model approach
How they are adapting their approaches to Covid-19
Workshops on coalitions and evaluation
A new partnership: Positive Impact...2020-12-0858 minEvaluLand13: Out-of-School-Time EvaluationIn this episode, I chat with Aasha Joshi and Hannah Lantos about their recent chapter "Demystifying data: Strategies and tools for making data more meaningful in OST programs" in the recently released book Measure, Use, Improve! Data Use in Out-of-School Time, edited by Christina Russell and Corey Newhouse. The book will be particularly useful to leadership-level staff in out-of-school time organizations that are thinking about deepening their own learning and evaluation systems, yet aren’t sure where to start.
We talked about:
What it means to demystify data in OST programs
How OST program evaluation is un...2020-11-241h 04EvaluLand12: Eval20 Virtual Experience - Post-Conference ReflectionsThank you to everyone who participated in the call-in to share their own reflections about the 2020 AEA virtual experience!
In this episode, I start with thanking the conference organizers, sharing my own reflections, and then pass it off to the eight people who called in to share their own reflections:
Rachael Lawrence (@R8chLawrence)
Rakesh Mohan (@RakeshMohanEval)
Ann Price (@annwprice)
Elizabeth Grim (@ecgrim)
Jeremy Danz (@DanzJeremy)
Veronica Olazabal (@veroviews)
Tiffany Smith (@Tiffany7001
Libby Smith (@work_with_libby)
Music by Matt Ingelson, http://www.mattingelsonmusic.com/Support EvaluLand2020-11-1034 minEvaluLand11: Eval20 Virtual Experience - Pre-Conference ReflectionsThank you to everyone who participated in the call-in to share their own reflections about the 2020 AEA virtual experience! After the conference, please sure your own thoughts and reflections by calling in. It's very similar to leaving a voicemail!
In this episode, I start with my own reflection about the conference, how I'm going to make the most of the conference, and what I am personally excited about. Then, we get to hear from nine other evaluators (in no particular order):
Tom Archibald, associate professor at Virgina Tech (@tgarchibald)
Bianca Montrosse-Moorhead, associate professor at University of...2020-10-2740 minEvaluLand10: Nonprofit Evaluation and Music with Chari SmithThis week, Chari Smith joins me to talk about nonprofit evaluation, how to build a culture of evaluation, the relationship between music and evaluation, and the AEA conference.
Chari Smith wrote a book! Nonprofit Program Evaluation Made Simple: Get your Data. Show your Impact. Improve your Programs. Sign up for the mailing list to learn more about the book, including the launch date.
Resources & People Mentioned:
In 4 All blog post on adapting to Covid-19
Managing applied social research by Russ-eft and colleagues (2017)
Enhancing the effectiveness of logic models by Jones et al. (2020)
Northwest Housing...2020-10-131h 05EvaluLand9: R with David KeyesThis week I am joined by David Keyes. We talked about R, why evaluators should learn R, tips for teaching courses, and more!
Interested in getting started with R? Check out David's free course!
Interested in learning how to do inferential statistics in R? Check our our new course!
Resources:
Blog posts
Dana's R journey
What is a tidyverse-centric approach?
How to make beautiful tables in R
How to make functions in R
How to evaluate R packages
Using Word reference documents with R Markdown to create custom reports
If...2020-09-291h 05EvaluLand8: Solopreneurship with Ann K. EmeryThisThis week I am joined by Ann K. Emery about her journeys in evaluation and entrepreneurship. Ann K. Emery is an internationally-acclaimed speaker who equips organizations to get their data out of dusty spreadsheets and into real-world conversations. She now runs Depict Data Studio.
If you’d rather watch this talk, you can do so on YouTube here.
Topics & Resources Mentioned:
#EvalTwitter hashtag on Twitter (also follow #eval and #dataviz)
Company of One by Paul Jarvis
Nina Sabarre presentation on getting into independent consulting
Independent consulting vs. entrepreneurship
Teaching (and blogging and YouTube-ing) as a...2020-09-151h 04EvaluLand7: Trust and Numbers with Anjie RosgaThis week, we’re chatting with AnnJanette, or Anjie, Rosga about objectivity, trust and numbers, truth and power, and more.
AnnJanette (Anjie) Rosga, PhD, co-directs the small, Berkeley-based consulting firm Informing Change which works to support strategic learning initiatives in the social sector. Most of Anjie’s projects involve facilitating strategy development, promoting equity and participatory research, and leading evaluation for hard-to-measure initiatives that cross disciplines, sectors, geographies, and/or cultures.
This episode centers around Anjie's 3-part Medium series on Trust & Numbers. Read the 3-part series here: Part 1, Part 2, and Part 3
Some resources, quot...2020-09-011h 06EvaluLand6: Research RoundupThis week I discuss some of the latest Research on Evaluation (RoE) articles that have come out in 2020.
Articles Mentioned:
At the beginning I mention the RoE TIG’s definition of RoE, which is summarized here.
Evaluation Journal of Australasia – Special Issue on Values in Evaluation
Vol 19, Issue 4: Guest Editors: Keryn Hassall, Kelly Hannum, Amy Gullickson and Mathea Roorda
Vol 20, Issue 2: Guest Editors: Ayesha S Boyce, Amy M Gullickson, Keryn Hassall and Kelly Hannum
New Directions for Evaluation Volume 2020, Issue 166 - Examining issues facing communities of color today: The role of evaluation to incite change: Issue Edit...2020-08-1850 minEvaluLand5: MS in Applied Psychology - Evaluation Reflections
“If you are someone who is interested in bringing change, or making the world a better place, or if you would like the results of your work to get used, evaluation is something that you might be interested in.”
This episode is a bit different. I asked three of my students to reflect on their experiences in the MS in Applied Psychology program at University of Wisconsin-Stout, as well as their experiences in the two evaluation courses. Emma, Omar, and Jade share their thoughts and reflections.
Click here to learn more about the MS in Appl...2020-08-0425 minEvaluLand4: Teaching Evaluation and Supporting Students and Colleagues of Color with Ayesha BoyceThis week I am joined by Dr. Ayesha Boyce, assistant professor of educational research methodology at the University of North Carolina at Greensboro, to discuss teaching evaluation and supporting students and colleagues of color.
Topics Covered:
Reflections on five years of teaching evaluation
The -ologies: ontology, epistemology, and axiology beyond just methodology
Favorite evaluation activity (of course, it’s the evaluating the cookie activity!)
Mentoring students of color. Five keys from Ayesha (see upcoming CJPE article):
Consider impact of vicarious trauma
Assist with facilitation peer mentors/squads
Respect, honor, and celebrate students’ culture, religion, and family
Be v...2020-07-2146 minEvaluLand3: Evaluation Education and Data Cleaning with Jennifer Ann MorrowThis week I am joined by Dr. Jennifer Ann Morrow, the program coordinator of the Evaluation Statistics and Measurement doctoral program (soon to be named "Evaluation Statistics and Methodology) at the University of Tennessee-Knoxville. We talked about teaching evaluation and data cleaning in evaluation.
Topics Covered:
Jennifer’s background, philosophy, and experience in teaching evaluation (01:58)
Our favorite evaluation activities: evaluating cookies, one-pages on hot topics and people in evaluation, evaluation failures, self-reflection journals, practical experience outside of class (11:33)
Personal professional development in data visualization and R (32:00)
What’s giving Jennifer life in evaluation right now (38:40)
Data clea...2020-07-0755 minEvaluLand2: Meta-Evaluation, Research on Evaluation, & Evaluation Theory with Zach TiltonThis week I am joined by Zach Tilton, a Doctoral Research Associate at the Interdisciplinary PhD in Evaluation Program at Western Michigan University. We discussed research on evaluation and meta-evaluation.
Topics Covered:
How Zach got into evaluation and at Western Michigan University (01:12)
What peacebuilding evaluation is (03:52)
Evaluation specialists vs generalists (05:45)
Research on evaluation and meta-evaluation (09:50)
Prescriptive vs descriptive theories (22:35)
Evaluation theory (25:00)
Zach’s dissertation: RoE on peacebuilding evaluation (35:50)
Adjusting to life amidst Covid-19 (40:10)
What’s next for Zach (46:00)
What’s giving life for Zach (50:55)
Resources mentioned:
Western Michigan University Interdisciplinary PhD in Evaluation, including Michae...2020-06-2355 minEvaluLand1: Strategic Evaluation with Kathleen DollThis week I am joined by Kathleen Doll, who recently completed her PhD at Claremont Graduate University. We discuss her dissertation on strategic planning in evaluation design.
Topics Covered:
Why did Kathleen choose to get a PhD in evaluation at Claremont Graduate University? (02:12)
How did Kathleen get to her dissertation topic of strategic evaluation? (05:09)
Dissertation design (07:56)
What is strategic evaluation planning? (09:25)
Results! What are the benefits of strategic evaluation planning? (10:44)
Who should be doing strategic evaluation planning? (16:22)
How does strategic evaluation planning align with developmental evaluation? (19:20)
How does this work with funders? (21:47)
How Kathleen’s work ha...2020-06-0938 minEvaluLandIntroducing EvaluLandWelcome to EvaluLand! This episode is a brief introduction to the podcast and to me, your host, Dana Linnell Wanzer.
If you’d like to learn more about the podcast, check us out!
Website: evaluland.fireside.fm
Twitter: @EvaluLand
Email: podcast@danawanzer.com
Music by Matt Ingelson, http://www.mattingelsonmusic.com/Support EvaluLand2020-06-0101 min