Measurement Demystified , livre ebook

Association for Talent Development - Peggy Parskey , Vance David

Découvre YouScribe en t'inscrivant gratuitement

Je m'inscris

Obtenez un accès à la bibliothèque pour le consulter en ligne
En savoir plus

255 pages

English

Vous pourrez modifier la taille du texte de cet ouvrage

Obtenez un accès à la bibliothèque pour le consulter en ligne
En savoir plus

A propos
Informations
Extrait

Description

Your Groundbreaking Framework for Measurement and Reporting

Most people find measurement, analytics, and reporting daunting—and L&D professionals are no different. As these practices have become critically important for organizations’ efforts to improve performance, talent development professionals have often been slow to embrace them for many reasons, including the seeming complexity and challenge of the practices. Few organizations have a well-thought-out measurement and reporting strategy, and there are often scant resources, limited time, and imperfect data to work with when organizations do attempt to create one.

Measurement Demystified: Creating Your L&D Measurement, Analytics, and Reporting Strategy is a much-needed and welcomed resource that breaks new ground with a framework to simplify the discussion of measurement, analytics, and reporting as it relates to L&D and talent development practitioners. This book helps practitioners select and use the right measures for the right reasons; select, create, and use the right types of reports; and create a comprehensive measurement and reporting strategy.

Recognizing the angst and reluctance people often show in these areas, authors and experts David Vance and Peggy Parskey break down the practices and processes by providing a common language and an easy-to-use structure. They describe five types of reports, four broad reasons to measure, and three categories of measures. Their method works for large and small organizations, even if yours is an L&D staff of one or two. The guidance remains the same: Start small and grow.

Measurement Demystified is a great first book for talent development professionals with no prior knowledge of or experience with measurement and a valuable resource for measurement experts. Those adept at lower levels of training evaluation will grow their knowledge base and capabilities, while measurement experts will discover shortcuts and nuggets of information to enhance their practices. A more comprehensive treatment of these important topics will not be found elsewhere.

Sujets

Efficacité professionnelle

Efficacité

Business

Economics

Training

Employabilité, métiers et formations

Informations

Publié par	Association for Talent Development
Date de parution	17 novembre 2020
Nombre de lectures	0
EAN13	9781950496860
Langue	English
Poids de l'ouvrage	4 Mo

Informations légales : prix de location à la page 0,1950€. Cette information est donnée uniquement à titre indicatif conformément à la législation en vigueur.

Extrait

© 2021 ASTD DBA the Association for Talent Development (ATD) All rights reserved. Printed in the United States of America.
24 23 22 21 1 2 3 4 5
No part of this publication may be reproduced, distributed, or transmitted in any form or by any means, including photocopying, recording, information storage and retrieval systems, or other electronic or mechanical methods, without the prior written permission of the publisher, except in the case of brief quotations embodied in critical reviews and certain other noncommercial uses permitted by copyright law. For permission requests, please go to copyright.com , or contact Copyright Clearance Center (CCC), 222 Rosewood Drive, Danvers, MA 01923 (telephone: 978.750.8400; fax: 978.646.8600).
ATD Press is an internationally renowned source of insightful and practical information on talent development, training, and professional development.
ATD Press 1640 King Street Alexandria, VA 22314 USA
Ordering information: Books published by ATD Press can be purchased by visiting ATD’s website at td.org/books or by calling 800.628.2783 or 703.683.8100.
Library of Congress Control Number: 2020946222
ISBN-10: 1-950496-85-6 ISBN-13: 978-1-950496-89-1 e-ISBN: 978-1-950496-86-0
ATD Press Editorial Staff Director: Sarah Halgas Manager: Melissa Jones Community Manager, Learning & Development: Eliza Blanchard Developmental Editor: Kathryn Stafford Copy Editor: Jack Harlow Text Design: Shirley E.M. Raybuck Cover Design: Rose Richey
Printed by P.A. Hutchison Company, Mayfield, PA
Contents
List of Figures
List of Tables
Foreword
Preface
Introduction
Part I. Foundations of Measurement
1. The Talent Development Reporting Principles (TDRp) Framework
Reasons for Measuring
A Framework for Measurement
Measurement Maturity
TDRp Measures
TDRp Reports
The Complete TDRp Framework
Integration of the TDRp Framework With Other Standard-Setting Efforts
Conclusion
2. Introduction to Basic Measures
The Consequences of Focusing on a Single Type of Measure
The Solution: Be Purposeful About What You Measure
Conclusion
Part II. Measurement
3. Efficiency Measures
Formal Learning Measures
Informal Learning Measures
Conclusion
4. Effectiveness Measures
The Five Levels of Effectiveness Measures
Level 1: Reaction
Level 2: Learning
Level 3: Behavior and Application
Level 4: Results and Impact
Level 5: ROI
Conclusion
5. Outcome Measures
The Importance of Outcome Measures
Most Common Outcome Measures
Types of Outcome Measures
Application Rate as a Leading Indicator
Flexibility in Creating Outcome Measures
The Special Case of Competency Measures
Conclusion
6. Creating a Measurement Strategy
Why a Measurement and Reporting Strategy Is Important
Steps to Create a Measurement Strategy
Elements of a Measurement and Reporting Strategy
Conclusion
7. Selecting Measures
Measures for Programs
Measures for General Studies Courses
Department Initiatives
Other Measures the CLO May Request
Conclusion
Part III. Reporting
8. Reporting
Types of Reports and Data Displays
Reporting to Inform
Reporting to Monitor
Reporting to Evaluate and Analyze
Reporting to Manage
Conclusion
9. The Three Management Reports
Running Learning Like a Business
The TDRp Management Reporting Framework
Conclusion
10. Creating Your Reporting Strategy
Elements of a Measurement and Reporting Strategy
Report Types and Formats
Plans to Generate and Distribute the Reports
Resources Required for Reporting
Conclusion
11. Creating Plans
Creating Plans for Outcome Measures
Creating Plans for Efficiency and Effectiveness Measures
Conclusion
12. Reporting Year-to-Date Results and Making Forecasts
Reporting YTD Results
Making Forecasts
Conclusion
Part IV. Putting It All Together
13. Implementing Measurement and Reporting
L&D’s Opportunity
What’s Changing?
Managing the Change
Tools and Templates
Conclusion
14. Pulling It All Together
Key Takeaways
Opportunities
Closing Thoughts
Appendixes
A. History of the TDRp Approach
B. Sample Roles and Responsibilities Agreement
C. Sample Measurement and Reporting Strategy
D. Sample TDRp Implementation Plan
E. Glossary
F. Resources on Survey Design
References
Index
About the Authors
Figures
Figure I-1. Chapter Layout
Figure I-2. The Interplay of Reporting, Analytics, Measurement, and Methodologies
Figure 1-1. Why Do We Want to Measure?
Figure 1-2. The Four Reasons for Measuring
Figure 1-3. Hierarchy of Reasons to Measure
Figure 1-4. HC BRidge Framework Adapted From Boudreau and Ramstad
Figure 1-5. What CEOs Want to See
Figure 1-6. The Complete TDRp Framework
Figure 2-1. Consequences of Being Overly Focused on Efficiency
Figure 2-2. Consequences of Being Overly Focused on Effectiveness
Figure 2-3. Consequences of Being Overly Focused on Outcomes
Figure 3-1. Categories of Efficiency Measures
Figure 3-2. Example of Chart With L&D Mix of Courses by Delivery Modality
Figure 3-3. Components of Total Cost
Figure 4-1. Categories of Effectiveness Measures
Figure 4-2. Common Level 1 Question Areas
Figure 4-3. Score Distribution of Two Courses
Figure 4-4. Example Using a Trend Line to Forecast Safety Without Training
Figure 4-5. Techniques for Isolation
Figure 4-6. Simple Example of the Chain of Evidence Approach
Figure 4-7. Methods to Convert Data to Money
Figure 5-1. Most Common Learning Outcome Measures
Figure 5-2. Example of a Five-Point Competency Scale for Sales Representatives
Figure 6-1. Benefits of a Measurement and Reporting Strategy
Figure 6-2. Reasons for Measuring
Figure 8-1. Graphical Depiction of Trends
Figure 8-2. Sample Dashboard From Marathon
Figure 8-3. Custom Dashboard From Metrics That Matter
Figure 8-4. Executive Dashboard Template
Figure 8-5. Three-Slide PowerPoint Program Evaluation Report
Figure 8-6. Sample PowerPoint Custom Analysis Report
Figure 9-1. TDRp Management Reporting Framework
Figure 9-2. Eight Steps to Create a Strategic Program Report
Figure 9-3. Steps to Create a Program Report for Non-Strategic Programs
Figure 9-4. Steps to Create the Operations Report
Figure 9-5. Steps to Create a Summary Report
Figure 11-1. Cycle of Creating Plans, Reporting Results, and Forecasting Year-End
Figure 11-2. Phillips “V” Diagram for Planning
Figure 11-3. Case Study 1: Level 1 History for Last Five Years
Figure 11-4. Case Study 2: Level 1 History for the Last Five Years
Figure 13-1. Shift #1 From Monitor to Evaluate and Analyze
Figure 13-2. Shift #2 From Evaluate and Analyze to Manage
Figure 13-3. Three Dimensions of Change
Figure 13-4. People Changes
Figure 13-5. Process Changes
Figure 13-6. Technology Changes
Figure 13-7. High-Level Implementation Approach
Figure 13-8. Anatomy of Change
Figure 13-9. Managing the Change
Figure 13-10. Structure of a Project Charter Document
Figure 14-1. TDRp Framework for Measurement and Reporting
Figure A-1. Extension of TDRp Beyond Learning
Appendix C
Figure 1. Benefits of a Measurement and Reporting Strategy
Figure 2. TDRp Framework for Measurement and Reporting
Appendix Figure 1. Sample Report for a Strategic Plan
Appendix Figure 2. Sample Report for a Non-Strategic Program
Appendix Figure 3. Sample Operations Report
Appendix Figure 4. Sample Summary Report
Tables
Table 1-1. Measurement Requirements at Each Maturity Level
Table 1-2. The Role of Reporting and Analytics in the Measurement Hierarchy
Table 1-3. The Three Types of TDRp Measures
Table 1-4. Five Types of TDRp Reports
Table 1-5. Complete Measurement Requirements at Each Maturity Level
Table 1-6. Distribution and Recommended Reporting for ISO30414 Metrics
Table 1-7. The Eight Training-Related ISO-Recommended Measures
Table 1-8. Mapping: ISO Measurement Categories to TDRp Measurement Categories
Table 2-1. Guidelines on Choosing Measures
Table 3-1. Categorization of ISO Efficiency Metrics
Table 3-2. Calculation of Total Unique Participants and Total Participants
Table 3-3. Most Common L&D Efficiency Measures
Table 4-1. Measurement Levels of Kirkpatrick and Phillips
Table 4-2. Calculation Methods
Table 4-3. Results When All Questions Are Not Answered
Table 4-4. Participant Estimation Method Calculation
Table 4-5. Most Common L&D Effectiveness Measures
Table 6-1. Steps to Create a Measurement Strategy
Table 6-2. Measurement Requirements for Each Level of Maturity
Table 6-3. User Needs Analysis
Table 6-4. Summary of Measures to Use
Table 6-5. Two Approaches to Listing Recommended Measures
Table 6-6. Measurement Strategy Matrix
Table 6-7. Sample Data Sources
Table 6-8. Sample Size and Error Margins
Table 6-9. Subjective Confidence Levels for Measures From Small Populations
Table 6-10. Column Headings for a Measures Library
Table 6-11. Simple Measure Library
Table 6-12. Column Headings in the CTR Measure Library
Table 7-1. Guidance on Measurement Selection by Purpose for Measuring
Table 7-2. Plan for Measuring Programs, General Studies Courses, and Department Initiatives
Table 7-3. Recommended Measures for Programs Directly Aligned to Organizational Goals
Table 7-4. Measures of Informal Learning for Strategic Programs
Table 7-5. Recommended Measures for Sales Training Programs
Table 7-6. Recommended Measures for Quality, Efficiency, and Other Productivity Training Programs
Table 7-7. Recommended Measures for Safety Training Programs
Table 7-8. Recommended Measures for Leadership Training Programs
Table 7-9. Recommended Measures for Programs Not Directly Aligned to Organizational Goals
Table 7-10. Recommended Measures for Compliance Programs
Table 7-11. Recommended Measures for Process-Improvement Training Programs
Table 7-12. Recommended Measures for Basic Skills Training Programs
Table 7-13. Recommended Measures for Reskilling Progr