It Depends: Understanding Psychometrics for Testing + Assessment, by Dr. Amanda Dainis + Tim Burnett30 Jan 2024

Ep2 - JTAs (Job Tasks Analysis), Unravelling the Essentials of Effective Test Development

Top Episode Takeaways:

🧠 Importance of Job Task Analysis (JTA) in Psychometrics: The podcast emphasizes the critical role of JTA in creating and updating certification exams. JTA helps ensure that exam questions are relevant and representative of the actual knowledge, skills, and abilities required for the job.

🤝 Role of Subject Matter Experts (SMEs): SMEs are vital in the JTA process. Their input helps form a comprehensive understanding of the job role. The podcast highlights the challenges and strategies in recruiting and managing SMEs, and the importance of diverse representation from various geographical locations and job roles.

📊 Survey and Analysis in JTA: A significant part of JTA involves conducting a survey among industry professionals to validate the competencies and tasks identified by SMEs. This data is then analyzed to create an exam blueprint, guiding the distribution of questions across different job-related topics.

Get the full transcript here: ⁠https://www.testcommunity.network/podcast-it-depends⁠

Learn about: Psychometrics, Job Task Analysis (JTA), Certification Exams, Subject Matter Experts (SMEs), Exam Blueprint, Knowledge, Skills, and Abilities (KSAs), Test Development, Accreditation, Item Writing, Survey Analysis, Validation, Cut Scores, Legal Challenges, Psychometricians

Connect with us:

⁠Amanda Dainis, PhD, MPA⁠

⁠Tim Burnett⁠

A proud supporter of the ⁠https://www.testcommunity.network

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(12)

It Depends Episode 10: Criterion, Norm, CAT & LOFT

This episode of the It Depends Podcast examines criterion referenced testing, norm referenced testing, computer adaptive testing (CAT), and linear on-the-fly testing (LOFT). Amanda and Tim explore the...

29 Nov 202459min

Ep9 - Test Centre V Online Proctoring

This episode of the It Depends Podcast compares online proctoring and test centres for assessment delivery. Amanda and Tim explore the advantages and challenges of both methods, discussing candidate e...

20 Sep 202449min

Ep8 - Testing on a Budget

This episode of the It Depends Podcast explores testing on a budget, from test development to secure delivery. Amanda and Tim discuss testing on a budget, exploring various ways organisations can impl...

14 Aug 202438min

Ep 7 - Performance Based Testing

This episode of the It Depends Podcast explores performance-based testing in professional certification and licensure. Amanda and Tim discuss the benefits and challenges of performance tests compared ...

16 Juli 202439min

Episode 6 - Exam Maintenance

Top Episode Takeaways: 📈 Test maintenance involves regularly monitoring test and item performance statistics to ensure content remains current and secure, and should be conducted annually at minimum...

20 Juni 202438min

Ep5: Test Blueprints

Top Episode Takeaways: 📐 Test blueprints provide the overall design and structure for an assessment. They define what content areas the test will cover and what proportion of the test each content ...

12 Maj 202427min

Ep4: Exploring Item Types

Top Episode Takeaways: 📝 Multiple choice questions are the most common item type, but they can be done well or poorly. A good multiple choice question takes effort to create but can measure a wide r...

18 Apr 202437min