Skip to main content
Unlocking the Potential of Assessments

Unlocking the Potential of Assessments

By John Kleeman
This monthly series delves into creating, delivering and reporting on valid and reliable assessments. "Unlocking the Potential of Assessments" offers advice and thought leadership to those just starting out with assessments, those who have been in the industry at length and anyone with a keen interest in the future of assessments lead by host, John Kleeman.

Join Questionmark on our quest to discover and examine the latest in best practice guidance with a wide array of guests - including assessment luminaries, industry influencers, SMEs and customers - and discuss "all things assessment."
Listen on
Where to listen
Apple Podcasts Logo

Apple Podcasts

Breaker Logo

Breaker

Google Podcasts Logo

Google Podcasts

Overcast Logo

Overcast

Pocket Casts Logo

Pocket Casts

RadioPublic Logo

RadioPublic

Spotify Logo

Spotify

Ep. 23 - Assessment Luminary, Stephen Sireci
John Kleeman is joined by assessment luminary, Stephen Sireci, Professor in the Psychometrics Program and Director, Center for Educational Assessment at University of Massachusetts Amherst. His work is well known in the world of assessment. Steve shares how he got into assessment and discusses his research around validity, the five sources for validity evidence and his good practice advice.
32:04
January 26, 2022
Ep. 22 - Assessment Luminary, Jarrod Morgan, Meazure Learning
John Kleeman is joined by assessment luminary, Jarrod Morgan, Founder of ProctorU (now known as Meazure Learning) and Chief Strategy Officer. Jarrod has been a leader in the educational technology field for over 16 years. Jarrod shares how he got started in assessment and discusses all things proctoring, including where he sees proctoring going, good practices in remote proctoring and the human first approach.
28:20
December 21, 2021
Ep. 21 - Assessment Luminary, Marten Roorda, Riiid Labs
John Kleeman is joined by assessment luminary, Marten Roorda, Chief Measurement and Learning Officer at AI and education company, Riiid Labs. Marten is a pioneer in educational technology, a leading innovator in computer-based testing, e-learning and adaptive learning and has an extensive background, which includes ACT, CITO and more. Marten shares how he got started in assessment and discusses how to use AI in assessment, adaptive learning and his best practice advice.
28:42
November 09, 2021
Ep. 20 - Assessment Luminary, Alina von Davier, Duolingo
John Kleeman is joined by assessment luminary, Alina von Davier, Ph.D, Chief of Assessment at Duolingo. At Duolingo, Alina and her team operate at the forefront of computational psychometrics. Alina shares how she got into assessment and discusses how to make a high stakes test equitable with multiple instances, her experience as a female leader in the assessment space and her advice to people who want to progress in assessment.
32:59
October 13, 2021
Ep. 19 - Assessment Luminary, Riz Khan, SAP
John Kleeman is joined by assessment luminary and "Learning Enthusiast," Riz Khan of SAP. Riz is Global COO and Vice President of Training and Adoption at SAP and frequently partners with CxOs, executives and leadership groups to help them understand the importance of corporate education and the power of user adoption. Riz shares his background in assessment and learning and discusses the value of investing in learning and training and how assessments fit in, his best practice advice and the future of learning and adoption.
29:12
September 15, 2021
Ep. 18 - Assessment Luminary, Gavin Cooney, Learnosity
John Kleeman is joined by assessment luminary, Gavin Cooney, CEO and co-Founder of Learnosity, the leading provider of assessment infrastructure for the learning industry. As you may have heard Learnosity recently acquired Questionmark. Gavin discusses how he got into assessment and dives into various topics, including the importance of accessibility and inclusivity in education, the trends he's noticed and how Questionmark and Leanosity fit together.
27:32
August 18, 2021
Ep. 17 - Assessment Luminaries, Sharon Shrock and William Coscarelli
John Kleeman is joined by assessment luminaries, Sharon Shrock and Bill Coscarelli, co-authors of award winning book "Criterion-Referenced Test Development." Sharon and Bill discuss how they got into assessment and tell the story of their book. The pair also shares patterns in testing they've seen working with various organizations and their advice.
31:04
July 27, 2021
Ep. 16 - Assessment Luminary, Dr. Leanne Furby, National League for Nursing
John Kleeman is joined by assessment luminary, Dr. Leanne Furby, Director of the Assessment Services Division at National League for Nursing. Leanne discusses how she got into assessments, talks about the assessment program at NLN and remote proctoring during COVID-19 and explains spaced learning and how it helps.
25:00
June 17, 2021
Ep. 15 - Assessment Luminary, Akil Bello, FairTest
John Kleeman is joined by assessment luminary, Akil Bello, who is an expert in assessment reform. He currently serves as the Senior Director of Advocacy and Advancement at FairTest, the National Center for Fair and Open Testing. Akil discusses how he got interested in assessments and talks about his work with admissions tests, whether recruitment tests are fair and his thoughts on what the testing industry should be doing better.
27:06
May 19, 2021
Ep. 14 - Assessment Luminary, Helen Baron, Psychometric Test Development
John Kleeman is joined by assessment luminary, Helen Baron, who is an expert in psychometric measurement and assessment. Helen works with test publishers and employers on developing tests and assessment processes. Helen discusses how she got into assessment, and dives into her time at SHL, the different types of assessments used in recruiting and where personality tests come in and her work on assessment standards.
27:16
April 20, 2021
Ep. 13 - Assessment Luminary, Wendy Kirkpatrick, Kirkpatrick Partners
John Kleeman is joined by assessment luminary, Wendy Kirkpatrick, President and Founder of Kirkpatrick Partners. As a global driving force of the use and implementation of the Kirkpatrick Model, Wendy leads companies to measurable success through training and evaluation. Wendy discusses how she got into training and assessments, and dives into the four levels of evaluation, why level three is the most important and how to measure behavior and her tips for evaluating training while remote working.
32:26
March 09, 2021
Ep. 12 - Assessment Luminary, Chris Norton, Mentor Group
John Kleeman is joined by assessment luminary, Chris Norton, Director at Mentor Group, a global sales transformation company based in UK. Chris shares his background and experience with assessments and discusses the value and best practice advice on using assessments in the sales space, the new Questionmark B2B Sales Qualification by Mentor Group and the future of digital selling.
31:34
February 10, 2021
Ep. 11 - Assessment Luminary, Bernt Nilsen, Datakortet
John Kleeman is joined by assessment luminary, Bernt Nilsen, founder of Datakoret (ECDL Norway) and Norsk Test, the leading test developer and supplier of national certification programs in Norway. Bernt discusses how he got into the assessment world and shares what's important when running a testing service business, his best practice advice for creating high-stakes assessments and the value in anonymous testing.
27:30
January 12, 2021
Ep. 10 - Assessment Luminary, Alan Thiemann, Attorney and General Counsel to ATP
John Kleeman is joined by renowned attorney, Alan Thiemann of Hans Santos, PLLC and General Counsel to the Assocation of Test Publishers (ATP). Alan discusses how he got into testing and his role at ATP and dives into topics such as privacy and remote proctoring, how to avoid being taken to court for a bad test and testing controversies in the US.
28:17
November 24, 2020
Ep. 9 - Assessment Luminary, Liberty Munson, Microsoft
John Kleeman is joined by assessment luminary, Liberty Munson, who is the Senior Psychometrician for Microsoft. Liberty discussess how she got into assessments, why people stay in jobs, the value of certifications and the future assessments, among other topics. Liberty also shares her aha! moment - listen to hear more!
33:54
September 09, 2020
Ep. 8 - Assessment Luminary, Jim Holm, Examity
John Kleeman is joined by assessment luminary, Jim Holm, CEO of Examity, the leading solution for learning validation and test security. Jim discusses how he got into his current role and the challenges he's faced with COVID-19, and dives into remote proctoring, including the value, his best practice advice, the future of proctoring and his views on artificial intelligence and proctoring.
30:34
July 22, 2020
Ep. 7 - Assessment Luminary, Paul Crump, Cambridge Assessment
John Kleeman is joined by assessment luminary, Paul Crump of Cambridge Assessment, the non-teaching department of the University of Cambridge that develops and delivers examinations and tests around the world through their three exam boards.  Crump discusses his background in assessments and dives into the Thinking Skills testing initiated by Cambridge Assessment and his best practice advice for those creating questions and assessment.
28:50
May 19, 2020
Ep. 6 - Assessment Luminary, Sue Martin, Certification Expert
Host, John Kleeman is joined by assessment luminary, Sue Martin, a pioneer in the assessment industry responsible for implementing the first test center network in Europe. Sue shares her story and advice on transforming certification programs. Discover the five most important considerations when setting up your certification program.
29:53
April 15, 2020
Ep. 5 - Assessment Luminary, William G Harris, ATP
John Kleeman is joined by assessment luminary, William G Harris, Chief Executive Officer of the Association of Test Publishers (ATP), the leading international organization for publishers of assessment programs. G Harris discusses his background in assessments and dives into his advice for those starting out in assessments, the importance of validity in assessments and the different sets of standards for testing, among other topics.
26:14
March 17, 2020
Ep. 4 - Assessment Luminary, Dave Foster, Caveon
John Kleeman is joined by assessment luminary, Dave Foster, CEO of Caveon, the first test security company. Dave is a psychologist, psychometrician and recognized luminary in the measurement industry. In this episode, Dave discusses his background in assessments and dives into the main risks and threats of testing, his recommendations on the key measures you should take with test security and how statistical analysis fits into this, among other topics.
27:21
February 18, 2020
Ep. 3 - Assessment Luminary, Steve Dept, cApStAn
John Kleeman is joined by assessment luminary, Steve Dept, CEO and founding partner of cApStAn, a high-profile language service provider. Steve received his education in English, Dutch, French and German but he is essentially an autodidact and a field practitioner. In this episode, Steve discusses his background in assessments and dives into good practice advice for translating tests, including the translation process, translation technology and other translation resources.
37:06
January 14, 2020
Ep. 2 - Assessment Luminary, Steve Lay, Questionmark
John Kleeman is joined by one of Questionmark's product managers, Steve Lay. Steve is an expert on scalable, computerized assessment and integration between systems, and has ensured that the million of assessments delivered by Questionmark are robust and scalable. He is also active in the IMS and other e-learning standards groups. In this episode, John dives into many topics with Steve including the impact of technology on the assessment process, QTI and LTI and proctoring.
34:56
December 04, 2019
Ep. 1 - Assessment Luminary, Jim Parry, Compass Consultants
Host, John Kleeman is joined by assessment luminary, Jim Parry, who has over 40 years of experience as a course designer, developer and instructor. Jim discusses his 12-year tenure at the Coast Guard as a civilian employee as the Test Development and e-testing Manager, during which he guided the move from paper to online testing for the entire Coast Guard.
35:42
November 01, 2019