The Crowdsourcing Handbook - THE How To on Crowdsourcing, Complete Expert's hints and tips Guide by the leading experts, everything you need to know about Crowdsourcing , livre ebook

Emereo Publishing - Dan Bell

Découvre YouScribe en t'inscrivant gratuitement

Je m'inscris

Obtenez un accès à la bibliothèque pour le consulter en ligne
En savoir plus

155 pages

English

Obtenez un accès à la bibliothèque pour le consulter en ligne
En savoir plus

A propos
Informations
Extrait

Description

This most comprehensive and complete book for Crowdsourcing serves as a Practical Guide to getting into and understanding Crowdsourcing. This well organized, large Guide to Crowdsourcing is an excellent Reference and your must have Crowdsourcing Toolbox containing great info for those who hunger for more!

Tap into the power of the Social Web through connected networks and consumer-oriented media through connected networks and consumer-oriented media, and get this book filled with Tactics, Tools, and Strategies for Business Success.

Want to (start) using Crowdsourcing as Powerful Business Tools? Do you want to learn how to use the Technology to share information better and make users More Powerful? This book is your guide on Crowdsourcing and Everything You Want to Know but Are Afraid to Ask. This book clarifies how to use Crowdsourcing for Online Collaboration and Leverage it to Grow Your Business.

In easy to read chapters, with extensive examples, references and links to get you started right away this book covers: Crowdsourcing, Participatory design, Human-based computation, Citizen science, LazyWeb, Utest, Netflix Prize, Dolores Labs, Galaxy Zoo, Smartsheet, FamilySearch Indexing, InnoCentive, Emporis, ESP game, ReCAPTCHA, MoveOn.org, Oxfam Novib, Amazon Mechanical Turk, Stardust@home, Innovation Exchange, Goldcorp, Foldit, Distributed Proofreaders, OpenStreetMap, Leblanc process, Longitude prize, Benoît Fourneyron, Montyon Prizes, Nicolas Appert, Loebner Prize, Millennium Prize Problems, Clickworkers, Co-creation, Collective intelligence, Mass customization, Crowdcasting, Crowd funding, Distributed computing, Distributed thinking, The Long Tail, Mass collaboration, Urtak, Micro-revenue, Open innovation, Social commerce, Toolkits for User Innovation, Tuangou, Wikinomics, The Wisdom of Crowds

Topic relevant selected content from the highest rated Wiki entries, typeset, printed and shipped, combine the advantages of up-to-date and in-depth knowledge with the convenience of printed books. A portion of the proceeds of each book will be donated to the WikiMedia Foundation to support their mission.

Sujets

Computers

General officer

General

Internet

Informations

Publié par	Emereo Publishing
Date de parution	24 octobre 2012
Nombre de lectures	0
EAN13	9781486431731
Langue	English
Poids de l'ouvrage	4 Mo

Informations légales : prix de location à la page 0,0798€. Cette information est donnée uniquement à titre indicatif conformément à la législation en vigueur.

Extrait

CrowdsourcingTopic relevant selected content from the highest rated wiki entries, typeset, printed and shipped. Combine the advantages of up-to-date and in-depth knowledge with the convenience of printed books. A portion of the proceeds of each book will be donated to the Wikimedia Foundation to support their mission: to empower and engage people around the world to collect and develop educational content under a free license or in the public domain, and to disseminate it effectively and globally. The content within this book was generated collaboratively by volunteers. Please be advised that nothing found here has necessarily been reviewed by people with the expertise required to provide you with complete, accurate or reliable information. Some information in this book maybe misleading or simply wrong. The publisher does not guarantee the validity of the information found here. If you need specific advice (for example, medical, legal, financial, or risk management) please seek a professional who is licensed or knowledgeable in that area. Sources, licenses and contributors of the articles and images are listed in the section entitled "References". Parts of the books may be licensed under the GNU Free Documentation License. A copy of this license is included in the section entitled "GNU Free Documentation

Contents Articles CrowdsourcingParticipatory designHuman-based computationCitizen scienceLazyWebUtestNetflix PrizeDolores LabsGalaxy ZooSmartsheetFamilySearch IndexingInnoCentiveEmporisESP gameReCAPTCHAMoveOn.orgOxfam NovibAmazon Mechanical TurkStardust@homeInnovation ExchangeGoldcorpFolditDistributed ProofreadersOpenStreetMapLeblanc processLongitude prizeBenoît FourneyronMontyon PrizesNicolas AppertLoebner PrizeMillennium Prize ProblemsClickworkersCo-creationCollective intelligence

191420222325293136373840414345525356585962646877808384858791939597

Mass customizationCrowdcastingCrowd fundingDistributed computingDistributed thinkingThe Long TailMass collaborationUrtakMicro-revenueOpen innovationSocial commerceToolkits for User InnovationTuangouWikinomicsThe Wisdom of CrowdsReferences Article Sources and Contributors Image Sources, Licenses and Contributors Article Licenses License

106108110112120121129132133133136137139140143

148 151

152

Crowdsourcing CrowdsourcingCrowdsourcingis a neologism for the act of taking tasks traditionally performed by an employee or contractor, and outsourcing it to an undefined, generally large group of people or community in the form of an open call. For example, the public may be invited to develop a new technology, carry out a design task (also known as [1] community-baseddistributed participatory design), refine or carry out the steps of an algorithm (seedesign and → Human-based computation), or help capture, systematize or analyze large amounts of data (see also→ citizen science). The term has become popular with business authors and journalists as shorthand for the trend of leveraging the mass collaboration enabled by Web 2.0 technologies to achieve business goals. However, both the term and its underlying business models have attracted controversy and criticisms. History[2] The word was coined by Jeff Howe in a June 2006WiredProjects which make use of groupmagazine article. intelligence such as the→LazyWeb predate that word coinage by several years. Recently, the Internet has been used to publicize and manage crowdsourcing projects. OverviewCrowdsourcing is a distributed problem-solvingand production model. Problems are broadcast to an unknown group of solvers in the form of an opencall for solutions. Users--also known as the crowd--typically forminto online communities, and the crowd submits solutions. The crowd also sorts through the solutions, finding the best ones. These best solutions are then owned by the entity that broadcast the problem in the first place--the crowdsourcer--and the winning individuals in the crowd are sometimes rewarded. In some cases, this labor is well compensated, either monetarily, with prizes, or withThe crowdsourcing process in eight steps. recognition. In other cases, the only rewards may be kudos or intellectual satisfaction. Crowdsourcing may produce solutions from amateurs or volunteers working in their spare time, or from experts or small businesses which were unknown to the initiating [3] organization.Perceived benefits of crowdsourcing include: •can be explored at comparatively little cost, and often very quickly. Problems •is by results or even omitted (See Twinpage of the German Wikipedia http://de.wikipedia.org/wiki/ Payment Crowdsourcing). [4] • The organization can tap a wider range of talent than might be present in its own organization.

Crowdsourcing •listening to the crowd, organizations gain first-hand insight on customer desires. By •community may feel a brand-building kinship with the crowdsourcing organization, which is result of an The earned sense of ownership through contribution and collaboration. The difference between crowdsourcing and ordinary outsourcing is that a task or problem is outsourced to an undefined public rather than a specific other body. The difference between crowdsourcing and open source is that open source production is a cooperative activity initiated and voluntarily undertaken by members of the public. In crowdsourcing the activity is initiated by a client and the work may be undertaken on an individual, as well as a [5] group, basis. Other differences between open source and crowdsourced production relate to the motivations of [6] [7] individuals to participate.[8] Crowdsourcing also has potential to be a problem-solving mechanism for government and non-profit use. Urban [9] and transit planning are prime areas for crowdsourcing, with a project to test crowdsourcing the public participation process for transit planning in Salt Lake City underway in 2008-2009 funded by a U.S. Federal Transit [10] Administration grant. Another notable application of crowdsourcing to government problem solving is the Peer to [11] Patent Community Patent Review project for the U.S. Patent and Trademark Office.EarlyexamplesThe Internettunnel in Leidschendam/Netherlands by Zwarts & Jansma Architects and artist Hans Muller is an early example of crowdsourcing. Opened in 1998, people could feed the LED-display via internet with their own texts. Also, words could be blocked for a certain time. The public became its own dynamic filter, preventing for example racist remarks. Recentexamples•→uTest Bug Battle, is a quarterly software testing competition, where thousands of software testers from around the world compete to find bugs in today's most popular web, mobile, desktop and gaming applications.The company's first Bug Battle occurred in November 2008; the 1,331 software testers who participated found more than 700 bugs in Google Chrome, Internet Explorer and Mozilla Firefox. The second Bug Battle took place in March 2009; the 1,119 software testers who participated found bugs in Facebook, MySpace and LinkedIn. Twitter applications were the subject of the third Bug Battle in June 2009 and nearly $4,000 in prize money was awarded to those reporting best bugs and best feedback. uTest‘s business model is based on the idea that crowdsourcing is better suited to web and mobile app testing than other outsourcing models. With crowdsourced testing, the crowd reflects the diversity (e.g. multiple geographic locations, languages spoken) of the apps and users themselves. •Prize, is an ongoing open competition for the best collaborative filtering algorithm that predicts user Netflix ratings for films, based on previous ratings. The competition is held by Netflix, an online DVD-rental service, and is opened for anyone (with some exceptions). The grand prize of $1,000,000 is reserved for the entry which bests Netflix's own algorithm for predicting ratings by 10%. Netflix provided a training data set of over 100 million ratings that more than 480,000 users gave to nearly 18,000 movies, which is one of the largest real real-life data sets available for research. The related forum maintained by Netflix has seen lively discussions and contributed a lot to the success of this competition. A very relevant fact to the power of crowdsourcing is that among the top teams are not only academic researchers, but laymen with no prior exposure to collaborative filtering (virtually learning the problem space from scratch). •→Dolores Labs provides a crowdsourcing service that enables businesses to process high volumes of simple tasks that are difficult to automate. DL has various sources of people who participate in processing the work including Amazon's Mechanical Turk. The company's key innovation and contribution to the emerging crowdsourcing practice is in the realm of quality standards using statistical and related technical algorithms and methods.

Crowdsourcing •→Galaxy Zoo, a →citizen science project that lets members of the public classify a million galaxies from the Sloan Digital Sky Survey. The project has led to numerous scientific papers and citizen scientist-led discoveries such as Hanny's Voorwerp. •→Smartsheet is an online software service and consultancy that enables businesses to track and manage work [12] through online sharing and crowdsourcing methods. The company's Smartsourcing service enables people to anonymously submit and manage all phases of crowdsourced work processing. Amazon's Mechanical Turk is one of the work exchange platforms with which Smartsheet is integrated.

•The Guardian's investigation into the MP Expense Scandal in the UK. The newspaper created a system to allow the public to search methodically through 700,000 expense claim documents. Over 20,000 people participated in [13] finding erroneous and remarkable expense claims by Members of Parliament.•→FamilySearch Indexing, is a volunteer project which aims to create searchable digital indexes for scanned images of historical documents. The documents are drawn primarily from a collection of 2.4 million microfilms made of historical documents from 110 countries and principalities. Volunteers install free software on their home computers, download images from the site, type the data they read from the image into the software, and submit their work back to the site. The data is eventually made publicly and freely available at Family History Centers on one of the FamilySearch web sites for use in genealogical research. Over 250 million historical records have been transcribed to date. •→InnoCentive, started in 2002, crowdsources research and development for biomedical and pharmaceutical companies, among other companies in other industries. InnoCentive provides connection and relationship management services between "Seekers" and "Solvers." Seekers are the companies searching for solutions to critical challenges. Solvers are the 125,000 registered members of the InnoCentive crowd who volunteer their solutions to the Seekers. Anyone with interest and Internet access can become an InnoCentive Solver. Solvers whose solutions are selected by the Seekers are compensated for their ideas by InnoCentive, which acts as broker of the process. InnoCentive recently partnered with the Rockefeller Foundation to target solutions from [14] InnoCentive's Solver crowd for orphan diseases and other philanthropic social initiatives.• Philoptima, started in 2008, crowdsources research and development on social causes among philanthropists and grant makers. Philoptima provides connection and relationship management services between "Prize Makers" and "Faculty." Prize Makers are the philanthropists and grant makers searching for solutions to critical social challenges. The underlying use of open innovation philanthropy as a universal theory of practice is gaining national and international recognition as a successful way to emply mass collaboration. The Philoptima faculty are the hundreds of registered Philoptima researchers, experts, and specialists who provide their solutions to the prize makers and philanthropists in response to problems posted by prizemakers along with an attendant cash prize and deadline. Anyone who is smart and intuitive can become a member of the Philoptima faculty. Members whose solutions are selected by the grant makers and philanthropists are compensated for their ideas by [15] Philoptima, which acts as manager of the problem>solution>prize process.•a crowdsourcing marketplace for graphic design and creative services, launched in February 2008 and DesignBay, helped run a contest for global footwear company HI-TEC. HI-TEC "estimated that using DesignBay.com [and [16] crowdsourcing] for the project saved HI-TEC up to half the costs of going down the usual design route"

• 99designs, the first marketplace for crowdsourced graphic design spun out of SitePoint.com in February 2008 and connects clients in need of design work such as logos, business cards, websites and other graphical elements to a community of graphic designers. Designers from all over the world compete for design projects listed on the [17] site.•→Emporis, a provider of building data, has run the Emporis Community (a website where members can submit building information) since May 2000. Today, more than 1,000 members contribute building data throughout the world.

Crowdsourcing • The ESP Game by Luis von Ahn (later acquired by Google and renamed Google Image Labeler) was launched in 2004 and gets people to label images as a side-effect of playing a game. The image labels can be used to improve image search on the Web. This game led to the concept of Games with a purpose. •→reCAPTCHA is used for digitizing old texts, by providing the text (that can't be deciphered properly by OCR software) to be read by end users of a CAPTCHA spam filter.→reCAPTCHA is helping to digitize over 30 million words per day from the Internet Archive and the New York Times archive. Over 200 million people have [18] helped digitize at least one word using this system.•Since 2004, →MoveOn.org has applied crowdsourcing to a variety of challenges related to organizing a political movement including phonebanking, field organizing via house parties, and the creation of ads against opponents. •→Oxfam_Novib (Netherlands) mid 2008 launched a crowdsourcing initiative named Doeners.net, meant for people to support the organisation's campaigning activities.

•In 2005, Amazon.com launched the →Amazon Mechanical Turk, a platform on which crowdsourcing tasks called "HITs" (Human Intelligence Tasks") can be created and publicized and people can execute the tasks and be paid for doing so. Dubbed "Artificial Artificial Intelligence", it was named after The Turk, an 18th century chess-playing "machine". •Stardust@Home is an ongoing →citizen science project, begun in 2006, utilizing internet volunteer "clickworkers" to find interstellar dust samples by inspecting 3D images from the Stardust spacecraft. •→Innovation Exchange is an →open innovation vendor which emphasizes community diversity; it sources solutions to business problems from both experts and novices. Companies sponsor challenges which are responded to by individuals, people working in ad-hoc teams, or by small and midsize businesses. In contrast to sites focused primarily on innovation in the physical sciences, Innovation Exchange fosters product, service, process, and business model innovation. • The Democratic National Committee launched FlipperTV in November 2007 and McCainpedia in May 2008 to crowdsource video gathered by Democratic trackers and research compiled by DNC staff in the hands of the [19] [20] public to do with as they choose—whether for a blog post, to create a YouTube video, etc.•The Canadian gold mining group →Goldcorp made 400 megabytes of geological survey data on its Red Lake, Ontario, property available to the public over the Internet. They offered a $575,000 prize to anyone who could analyze the data and suggest places where gold could be found. The company claims that the contest produced 110 targets, over 80% of which proved productive; yielding 8 million ounces of gold, worth more than $3 billion. The prize was won by a small consultancy in Perth, Western Australia, called Fractal Graphics.

• In January 2008, the State of Texas announced it would install 200 mobile cameras along the Texas-Mexico border, to enable anyone with an Internet connection to watch the border and report sightings of alleged illegal [21] immigrants to border patrol agents.[22] •despite objections by co-founder Jimmyis often cited as a successful example of crowdsourcing, Wikipedia [23] Wales to the term.• The search for aviator Steve Fossett, whose plane went missing in Nevada in 2007, in which up to 50,000 people examined high-resolution satellite imagery from DigitalGlobe that was made available via Amazon Mechanical [24] [25] Turk. The search was ultimately unsuccessful. Fosset's remains were eventually located by more [26] traditional means . • Cisco Systems Inc. held an I-Prize contest in which teams using collaborative technologies created innovative business plans. The winners in 2008 was a three-person team, Anna Gossen from Munich, her husband Niels Gossen, and her brother, Sergey Bessonnitsyn, that created a business plan demonstrating how IP technology could be used to increase energy efficiency. More than 2,500 people from 104 countries entered the competition. [27] [28] The winning team won US$250,000.•→Foldit invites the general public to play protein folding games to discover folding strategies.

Crowdsourcing •→Distributed Proofreaders (commonly abbreviated as DP or PGDP) is a web-based project launched by Project Gutenberg that supports the development of e-texts for Project Gutenberg by allowing many people to work together in proofreading drafts of e-texts for errors. •→OpenStreetMap is a free editable map of the world, which has over 100,000 signed up contributors in mid 2009. Creation and maintenance of geospatial data is a labor intensive task which is expensive using traditional approaches, and crowdsourcing is also being used by commercial companies in this area including Google and TomTom. [29] • The is a community research project to aggregate published measurments ofOpen Dinosaur Project ornithischian dinosaur limb bones for many different taxa in order to study the multiple evolutionary transitions from bipedality to quadrupedality in this group of dinosaurs. The measurements gathered by the community participants will be analyzed by the project leaders and results will be published in an open access peer-reviewed scientific journal. All contributors will be listed as co-authors on the eventual publication. ControversyThe ethical, social, and economic implications of crowdsourcing are subject to wide debate. For example, author and media critic Douglas Rushkoff, in an interview published in Wired News, expressed ambivalence about the term and [30] [31] its implications. Wikipedia co-founder Jimmy Wales is also a vocal critic of the term.Some reports have focused on the negative effects of crowdsourcing on business owners, particularly in regard to how a crowdsourced project can sometimes end up costing a business more than a traditionally outsourced project. Some possible pitfalls of crowdsourcing include: •costs to bring a project to an acceptable conclusion. Added •likelihood that a crowdsourced project will fail due to lack of monetary motivation, too few Increased participants, lower quality of work, lack of personal interest in the project, global language barriers, or difficulty managing a large-scale, crowdsourced project. [32] •or no wages at all. Barter agreements are often associated with crowdsourcing. Below-market wages. , • No written contracts, non-disclosure agreements, or employee agreements or agreeable terms with crowdsourced employees. • Difficulties maintaining a working relationship with crowdsourced workers throughout the duration of a project. •to faulty results caused by targeted, malicious work efforts. Susceptibility Though some critics believe crowdsourcing exploits or abuses individuals for their labor, studies into the motivations of crowds have not yet shown that crowds feel exploited. On the contrary, many individuals in the crowd experience [33] [34] [35] [36] significant benefits from their participation in crowdsourcing applications.Historicalexamples•→The Alkali Prize •→The Longitude Prize •→Fourneyron's Turbine •→Montyon Prizes •→Nicolas Appert and food preservation •→Loebner Prize •→Millennium Prize Problems

Crowdsourcing Seealso• Buzzwords •→Citizen science •→Clickworkers •→Co-creation •→Collective intelligence • Configuration system •→Crowdcasting •→Crowd funding • Distributed Computing •→Distributed thinking •→Human Computation •→The Long Tail • Mass Collaboration • Mass Customization •→Micro-revenue •Innovation Open •→Social commerce •→Toolkits for User Innovation •→Tuangou • Wikinomics • Wisdom of Crowds •→Urtak References• Noveck, Beth Simone. (2009).Wiki Government: How Technology Can Make Government Better, Democracy[37] Stronger, and Citizens More Powerful.Washington, D.C.: Brookings Institution Press. 10-ISBN 0-815-70275-2; 13-ISBN 978-0-815-70275-7 External links[38] •, by Andrew Muns, "Software Testing & Performance Magazine",Pioneer: Doron Reuveni Crowdsourcing September 1, 2009. [39] • Crowdsourcing: What It Means for Innovation , by John Winsor, "Business Week", June 15, 2009. [40] •, by Jeff Howe, "Wired Magazine", December 2, 2008.Now With a Real Business Model! Crowdsourcing: [41] •ideas to improve public services in the UK Contribute [42] • Internettunnel Leidschendam, Zwarts & Jansma Architects[43] •- An article discussing concepts from Jeff Howe's bookA People Business Crowdsourcing: CrowdsourcingfromThe Economistprint edition, September 25, 2008. [44] • Crowdsourcing: - crowdsourcing blog by Jeff Howetracking the rise of the amateur • Moving the Crowd at iStockphoto: The Composition of the Crowd and Motivations for Participation in a [45] Crowdsourcing Application , by Daren C. Brabham,First Monday, June 2, 2008. [46] •, by Paul Boutin, Crowdsourcing: consumers as creators Business Week, July 13, 2006. [47] •by Craig Gentry, Zulfikar Ramzan, and Stuart Stubblebine.Distributed Human Computation Secure Proceedings of the 6th ACM Conference on Electronic Commerce, 2005. [48] • Innovation in the Age of Mass Collaboration , by Don Tapscott and Anthony D. Williams,Business Week, February 1, 2007.

Crowdsourcing [49] •, Randy Burge: Internet allows us to resource the crowd Albuquerque Tribune, April 9, 2007. [50] •, by Michael Ho forZero First Take: Wiki Innovators Rethink Openness: Citizendium Assignment AssignmentZeroandWired, May 3, 2007. [51] • InnoCentive: , RandyCrowdsourcing Diversity: What starts with the crowd ends in research and development Burge interviews Alph Bingham, cofounder of →InnoCentive, forAssignment ZeroandWired (magazine),May 18, 2007. [52] • The - interview with Jeff Howe on his bookHopkinson Report, Episode 19 Crowdsourcing[53] • DoNanza: Crowdsourcing and freelance jobs search engine[54] • Four crowdsourcing lessons from the Guardian‘from Niemans (spectacular) expenses-scandal experiment Journalism Lab References[1] Crowd Sourcing Turns Business On Its Head (http://www.npr.org/templates/story/story.php?storyId=93495217) [2] David Whitford (2007-03-22). " Hired Guns on the Cheap (http://money.cnn.com/magazines/fsb/fsb_archive/2007/03/01/8402019/ index.htm)".Fortune Small Business(http://money.cnn.com/magazines/fsb/). . Retrieved 2007-08-07. [3] Jeff Howe (June 2006). " The Rise of Crowdsourcing (http://www.wired.com/wired/archive/14.06/crowds.html)".Wired. . Retrieved 2007-03-17. [4] Noveck, Simone. (2009).Wiki Government: How Technology Can Make Government Better, Democracy Stronger, and Citizens MorePowerful,p. 63. (http://books.google.com/books?id=bmSmcDo3kPoC&pg=PT14&dq=wikigovernment&client=) [5] Daren C. Brabham. (2008). "Crowdsourcing as a Model for Problem Solving: An Introduction and Cases",Convergence: The InternationalJournal of Research into New Media Technologies, 14(1), pp. 75-90. [6] Daren C. Brabham. (2008). "Crowdsourcing as a Model for Problem Solving: An Introduction and Cases",Convergence: The InternationalJournal of Research into New Media Technologies, 14(1), pp. 75-90. [7] Daren C. Brabham. (2008). "Moving the Crowd at iStockphoto: The Composition of the Crowd and Motivations for Participation in a Crowdsourcing Application",First Monday, 13(6), available online at http://www.uic.edu/htbin/cgiwrap/bin/ojs/index.php/fm/article/ view/2159/1969. [8] Daren C. Brabham. (2008). "Crowdsourcing as a Model for Problem Solving: An Introduction and Cases",Convergence: The InternationalJournal of Research into New Media Technologies, 14(1), pp. 75-90. [9] Daren C. Brabham. (2009). "Crowdsourcing the Public Participation Process for Planning Projects",PlanningTheory, 8(3), pp. 242-262. [10] U.S. Department of Transportation Federal Transit Administration Public Transportation Participation Pilot Program. "PTP-3 FY 2008 Projects: Crowdsourcing Public Participation in Transit Planning", available online at http://www.fta.dot.gov/planning/programs/ planning_environment_8711.html. [11] Peer to Patent Community Patent Review Project. "Peer to Patent Community Patent Review", at http://www.peertopatent.org/. [12] Marshall Kirkpatrick (2009). "―Project Management + Mechanical Turk? Smartsheet Looks Awesome.‖(http://www.readwriteweb.com/ archives/project_management_mechanical_turk_smartsheet_looks_awesome.php/)".. [13] " Crowdsourcing News: The Guardian and MP expenses (http://platform.idiomag.com/2009/06/ crowdsourcing-news-the-guardian-and-mp-expenses/)". 2009. . Retrieved 2009-07-13. [14] " The Rockefeller-InnoCentive Partnership (http://www.rockfound.org/initiatives/innovation/innocentive.shtml)".2007. . Retrieved 2007-11-17. The Rockefeller Foundation-InnoCentive partnership brings the benefits of InnoCentive model to those working on innovation challenges faced by poor or vulnerable people. The Rockefeller Foundation will pay access, posting and service fees on behalf of these new class of―seekers‖to InnoCentive, as well as funding the awards to "problem solvers." [15] Harrell, B. (2009). " Open Innovation in the Social Sciences-Size Matters-Supercharged Giving (http://www.philoptima.org)". . Retrieved 2009-08-20. [16] Sophocleous, Andrea (2009-04-09). " New business tool that's pulling the crowds and saving money (http://business.smh.com.au/ business/new-business-tool-thats-pulling-the-crowds-and-saving-money-20090408-a0vl.html)".Sydney Morning Herald. . [17] Johnson, Tory (2009-05-26). " 5 Ways to Freelance for More Cash (http://abcnews.go.com/GMA/JobClub/story?id=7673517& page=1)". Good Morning America. . [18] The reCAPTCHA Website (http://recaptcha.net/) [19] DNC. " McCainPedia (http://www.mccainpedia.org)".DNC. . Retrieved 2008-05-19. [20] Howe, Jeff (2006-06-01). " Wired 6.06 (http://www.wired.com/wired/archive/14.06/crowds.html)".Wired. . Retrieved 2009-02-02. [21] " Texas Governor finds $3 million for border cameras (http://www.khou.com/news/state/stories/khou071119_rm_bordercameras. 1b1f3f6b.html)". 2007. . Retrieved 2007-11-27. [22] Libert, Barry; Jon Spector (2008).We are Smarter than Me. Upper Saddle River, New Jersey: Wharton School Publishing. p. 3. ISBN 978-0-13-24479-4. [23] Lee, Ellen (2007-11-30). " As Wikipedia moves to S.F., founder discusses planned changes (http://www.sfgate.com/cgi-bin/article. cgi?f=/c/a/2007/11/30/BUOMTKNJA.DTL&hw=jimmy+wales&sn=001&sc=1000)". San Francisco Chronicle. . Retrieved