Search Quality Rating Guidelines

Search Quality Rating Guidelines Version 1.0 November 2, 2012 1 General Guidelines November 2, 2012 Preface ....................................................................................................................... 4 Part 1: Rating Guidelines ........................ 5 1.0 Welcome to the Search Quality Rating Program! ........................................................................................... 5 1.1 URL Rating Overview ................................................................. 5 1.2 Important Rating Definitions and Ideas ... 5 1.3 The Purpose of Search Quality Rating ..................................................................... 6 1.4 Raters Must Represent the User ............................................... 6 1.5 Internet Safety Information ....................................................................................... 6 2.0 Understanding the Query ................................................................. 7 2.1 Understanding User Intent ........................ 7 2.2 Task Language and Task Location .......................................... 8 2.3 Queries with Multiple Meanings ............................................................................... 8 2.4 Classification of User Intent: Action, Information, and Navigation – “Do-Know-Go” .....