Pfeiffer Client: Adobe Systems, Inc. Benchmark Report Consulting The Adobe InD ark o ect 01001011 esign CS2 Benchm Pr j
Table of Contents About the Benchmark Project ..................................................................... 3 About this Report ................................................................................................................... 4 About the Benchmark Project ................................................................................................. 4 Productivity Measures: Methodology Overview ...................................................................... 4 Overview ...................................................................................................................... ................... 4 About the execution of the productivity benchmark ....................................................................... 4 Scripting.........................................................................................................................................5 Keyboard shortcuts ......................................................................................................................... 5 Hardware Overview ................................................................................................................ 5 Hardware platform ......................................................................................................................... 5 Hardware configurations used ........................................................................................................ 5 System software .............................................................................................................................. 5 Configuration — Overview ...................................................................................................... 5 System setup ................................................................................................................................... 5 Application Software .............................................................................................................. 5 Benchmarks and Productivity Measures: Detail ......................................... 6 Application Integration Benchmarks ...................................................................................... 7 Assignment Based Benchmarks ............................................................................................. 7 Overview ...................................................................................................................... ................... 7 Magazine publishing productivity measures ................................................................................... 7 Productivity in Everyday Design Operations ........................................................................... 8 Overview ...................................................................................................................... ................... 8 Productivity in everyday design operations: complete assignment .................................................. 8 Placing picture files ......................................................................................................................... 8 Importing formatted tables ............................................................................................................. 8 Productivity Gains from Built-in Functionality ........................................................................ 9 Overview ...................................................................................................................... ................... 9 Drop shadow .................................................................................................................................. 9 Creating a simple transparency effect ............................................................................................. 9 Formatting of text with nested style sheets ..................................................................................... 9 Formatting multiple paragraphs with “Apply Next Style” .............................................................. 9 Formatting multiple objects with Object Styles .............................................................................. 9 Sharing parts of a page with Snippets ............................................................................................. 9 Generating a PDF file .................................................................................................................... 10 Place multi-page PDF file .............................................................................................................. 10
Section: Table of Contents For further information contact: research@pfeifferreport.com
October 14, 2005
1
Pfeiffer Client: Adobe Systems, Inc. Benchmark Report 01001 Co 0 n 1 s 1 ulting The Adobe InDesign CS2 Benchmark Project
Results and Charts ..................................................................................... 11 Application Integration Benchmarks ...................................................................................... 12 Assignment Based Benchmarks: Magazine Publishing Productivity Measures ....................... 15 Productivity in Everyday Design Operations ........................................................................... 18 Productivity Gains from Built-in Functionality ........................................................................ 23
Section: Table of Contents For further information contact: research@pfeifferreport.com
October 14, 2005
2
Pfeiffer Consulting 01001011
Client: Adobe Systems, Inc. The Adobe InDesign CS2 Benchmark Project
About the Benchmark Project
Section: About the Benchmark Project For further information contact: research@pfeifferreport.com
Benchmark Report
October 14, 2005
3
Pfeiffer Client: Adobe Systems, Inc. Benchmark Report Consulting The Adobe nchmark Pro ect 01001011 InDesign CS2 Be j
1 About this Report This report presents the results of the benchmarks conducted for the Adobe InDesign CS2 Productivity Benchmark Project. 2 About the Benchmark Project This benchmark project was conceived and conducted to document differences in productivity between design and publishing workflows based on Adobe InDesign CS2 and QuarkXPress 6.5, respectively. Additional applications common in these workflows, such as Adobe Photoshop and Adobe Illustrator, were used wherever necessary. 3 Productivity Measures: Methodology Overview 3.1 Overview The creative workflow benchmarks were defined as complete publishing/design assign-ments , covering everyday design operations and magazine publishing. For every assignment, a real-world publishing workflow example was defined in detail. Every aspect of the assignments was covered. Additional benchmarks were conducted to measure specific aspects such as productivity in everyday work situations as well as the impact of integration with native file formats on overall productivity. (See also “Benchmarks and Productivity Measures: Detail” on page 6) 3.2 About the execution of the productivity benchmarks Productivity Benchmarks were composed as a number of phases. Every phase of the benchmark was then defined as several sets of clearly defined, repeatable steps. These steps were then executed in a strictly identical way by trained professionals. Each set of steps was executed three times; the average of all three results was used in the charts. The total times for each benchmark were obtained by cumulating the average mea-sures obtained for each individual set of steps.
Section: About this Report For further information contact: research@pfeifferreport.com
4 October 14, 2005
Pfeiffer Client: Adobe Systems, Inc. Benchmark Report 01001 Co 0 n 1 s 1 ulting The Adobe InDesign CS2 Benchmark Project
3.3 Scripting No scripting was used in the execution of the benchmark: the main aim of these measures was to show real-world productivity, and had to take into account the time necessary for a trained operator to perform all the steps required in a project. 3.4 Keyboard shortcuts Commonly used keyboard shortcuts were authorized in certain sets of benchmarks, and used in an identical way in all programs. 4 Hardware Overview 4.1 Hardware platform All benchmarks and productivity measures were conducted on the Macintosh platform. 4.2 Hardware configurations used • 2.5 GHz Power Mac G5 4.3 System software • Mac OS 10.4 5 Configuration — Overview 5.1 System setup • All tests were performed using a standard system installation and configuration. • All computers were completely re-initialized prior to tests, using the default values for installation. • All hard drives were re-formatted using a single partition. • All software was installed from scratch, using default settings. • The only software installed on the systems were the applications necessary for the benchmarks. • Noperipherals were connected to the systems during performance benchmarks. 6 Application Software All application software was used in its most recent officially available release: • Adobe InDesign CS2 • QuarkXPress 6.5 • Adobe Photoshop CS2 • Adobe Illustrator CS2
Section: About the Benchmark Project For further information contact: research@pfeifferreport.com
October 14, 2005
5
Pfeiffer Consulting 01001011
Client: Adobe Systems, Inc. The Adobe InDesign CS2 Benchmark Project
Benchmark Report
Benchmarks and Productivity Measures: Detail
Section: Benchmarks and Productivity Measures: Detail For further information contact: research@pfeifferreport.com
October 14, 2005
6
Pfeiffer Client: Adobe Systems, Inc. Benchmark Report 0100 C 1 o 0 n 1 s 1 ulting The Adobe InDesign CS2 Benchmark Project
7 Application Integration Benchmarks These benchmarks measured the productivity linked to integration of the page layout applications with Adobe Illustrator and Adobe Photoshop. Application integration Benchmarks were comprised of: • Photoshop Round-trip (50MB) • Photoshop Round-trip (100MB) • Photoshop Round-trip (200MB) • Illustrator Round-trip For QuarkXPress 6.5, Photoshop files were accessed though the PSD Import XTension. PSD Import is not directly included with QuarkXPress 6.5, but can be downloaded at no charge from the Quark website. (Without PSD Import, Photoshop files need to be converted to a standard format in order to be used in a QuarkXPress page layout) 8 Assignment Based Benchmark 8.1 Overview The assignment based benchmark consisted in a complete publishing project, a double-page spread for a magazine, which was executed from the start to finish in a clearly defined and completely monitored way . 8.2 Magazine publishing productivity measures The project for the magazine publishing productivity benchmark consisted in the creation of an opening spread for a magazine feature. Work included creating the basic layout, importing pictures and text, formatting text, creating a headline with a drop shadow as well as other image work in Photoshop, importing and placing a graphic element from Illustrator and fine-tuning the final page layout. Project Phases: • Phase 1: Create basic layout • Phase 2: Import and format text • Phase 3: Image-related work (Create and adjust picture and drop-shadow, add and position Illustrator graphic.)
Section: Application Integration Benchmarks For further information contact: research@pfeifferreport.com
7 October 14, 2005
Pfeiffer Client: Adobe Systems, Inc. Benchmark Report 0100 C 1 o 0 n 1 s 1 ulting The Adobe InDesign CS2 Benchmark Project
9 Productivity in Everyday Design Operations 9.1 Overview Several Benchmarks were defined to assess the real-world productivity of QuarkXPress and InDesign in everyday work situations. How do the programs perform when they are faced with the task of repeated reformatting of the same page? How fast can a designer try out different sizes for a same illustratio n, change column arrangements or experiment with different typefaces? 9.2 Productivity in everyday design operations: complete assignment In order to measure fluidity in common design and page layout operations, Pfeiffer Consulting created a special project file: a 70 page, multi-column document. All columns in the document were linked; the complete text-chain contained a 55 000 word (328 000 characters) text; in addition, every page contained several pictures. The benchmark project consisted in repeated modifications of this document: switching to a specific spread in the middle of the document, reformatting the text and picture boxes, switching to another page, deleting one picture box and scaling up another one, and so forth. 9.3 Placing picture files Importing images is one of the most frequent tasks in building page layouts. This benchmark measured the time necessary to place several image files in a page layout, in order to assess the throughput which can be expected from both programs for this operation. 9.4 Importing formatted tables This benchmark measured the time necessary to import a formatted Excel spreadsheet fitting into a single A4 page. The time measured was the time required to display the imported table in the page layout document.
Section: Benchmarks and Productivity Measures: Detail For further information contact: research@pfeifferreport.com
October 14, 2005
8
Pfeiffer Client: Adobe Systems, Inc. Benchmark Report 0100 C 1 o 0 n 1 s 1 ulting The Adobe InDesign CS2 Benchmark Project
10 Productivity Gains from Built-in Functionality 10.1 Overview Adobe InDesign CS2 incorporates a number of original functions which are not currently available in QuarkXPress, such as creation of drop shadows, transparency effects, among several others. The following benchmarks were defined in order to measure the impact of these functions on productivity, when compared to workflows based on QuarkXPress. 10.2 Drop shadow This benchmark measured the time necessary for creating a headline with a drop-shadow. InDesign CS2 integrates this possibility; QuarkXPress based workflows require the use of a separate program (usually Photoshop or Illustrator) for achieving this effect. 10.3 Creating a simple transparency effect This benchmark measured the time necessary to create a simple transparency effect over an image in a page layout document. For QuarkXPress the effect was created using Adobe Photoshop. 10.4 Formattingof text with nested style sheets This test compared the time necessary to apply rich formatting by using the Nested Styles option in InDesign CS2. The benchmark measured the time necessary to apply character style sheets individually for portions of a paragraph, as compared to the time required to apply the nested style sheet. 10.5 Formatting multiple paragraphs with “Apply Next Style” The benchmark measured productivity gains linked to the use of the “Apply Next Style” feature introduced with InDesign CS2, compared with formatting the same pragarphs individually. 10.6 Formatting multiple objects with Object Styles This benchmark measured the productivity impact of InDesign CS2’s “Object Styles” feature, compared to the time necessary for formatting several objects individually. 10.7 Sharing parts of a page with Snippets The benchmark measured the time necessary to share parts of a page with a co-worker on the local area network, in one case using traditional methods such as cut and paste into a different document, in the other by using the “Snippets” feature introduced with InDesign CS2.
Section: Benchmarks and Productivity Measures: Detail For further information contact: research@pfeifferreport.com
9 October 14, 2005
Pfeiffer Client: Adobe Systems, Inc. Benchmark Report Consulting The Adobe InDesign CS2 Benchmark Project 01001011
10.8 Generating a PDF file This benchmark measured the time necessary to create a PDF file from a page layout document. The benchmark consisted in creating PDF files of different versions: • PDF 1.3 • PDF 1.5 • PDF-X1a (QuarkXPress 6.5 can only export PDF 1.3 files. For the other versions of PDF files, automatic conversion using Acrobat Distiller was used.) 10.9 Place multi-page PDF file This benchmark measured the time to place a 5-page PDF document inside an exisiting page layout document.
Section: Benchmarks and Productivity Measures: Detail For further information contact: research@pfeifferreport.com