Related Links

• Science Fair Project Guide

Project Summary

Difficulty	7  –  10
Time required	Long (a couple of weeks)
Prerequisites	An understanding of the material covered in "Paragraph Stats: Writing a JavaScript Program to 'Measure' Text"
Material Availability	Readily available
Cost	Very Low (under $20)
Safety	No issues

Share this Project Idea! |

Donate to Science Buddies

Sponsor

Sponsored by a generous grant from Symantec Corporation

Internet Safety Tips

Get educated about online safety with help from Symantec.

symantec.com/norton/familyresources

Abstract

Objective

The goal of this project is to write a computer program to make some simple measurements on a block of text, and then to see if this information can be used to identify the author of the text.

Introduction

Your English teacher has probably told you that every author has an individual writing style—their own unique 'voice' on the page. Is it possible to find ways to identify that voice through computer analysis of written text?

A familiar case from history argues that it is indeed possible. When our forefathers, newly independent from Great Britain, were debating whether to do away with the Articles of Confederation and adopt the new Constitution written by a convention in Philadelphia, a series of essays was written to argue in favor of adopting the new government. These essays, now called The Federalist Papers, were signed "Publius," but are now attributed to Alexander Hamilton, James Madison, and John Jay. The authorship of 12 of the essays was claimed by both Hamilton and Madison. As Julie Rehmeyer writes in a recent Science News article (Rehmeyer, 2007): "Altogether, researchers have considered more than 1,000 features of writing style. Nearly all the analyses have vindicated Madison."

Relax, you won't need to analyze 1,000 different features for your science fair project. The Science Buddies project, Paragraph Stats: Writing a JavaScript Program to 'Measure' Text, shows you how to write a simple program to measure:

1. the number of sentences contained in the text,
2. the number of words in each sentence,
3. the number of letters in each word,
4. the average number of words per sentence, and
5. the average word length.

Terms, Concepts and Questions to Start Background Research

To do this project, you should do research that enables you to understand the following terms and concepts:

• frequency,
• frequency histogram.

Questions

• How would you calculate the frequency of five-letter words in a given block of text?

Bibliography

• For two articles on using text to identify authors see:
  
  • Klarreich, E., 2003. "Bookish Math: Statistical Tests Are Unraveling Knotty Literary Mysteries," Science News 164 (December 20): 392, available online at [accessed February 16, 2007] http://www.sciencenews.org/articles/20031220/bob8.asp.
  • Rehmeyer, J., 2007. "Digital Fingerprints: Tiny Behavioral Differences Can Reveal Your Identity Online," Science News 171 (January 13): 26–28, available online at [accessed February 14, 2007] http://www.sciencenews.org/articles/20070113/bob9.asp.
• You can find a step-by-step JavaScript tutorial at the link below.
  Webteacher Software, 2007. "JavaScript Tutorial for the Total Non-Programmer,"Webteacher.com [accessed February 14, 2007] http://www.webteacher.com/javascript/index.html.
• For information on HTML FORMS, here is the official reference:
  Ragget, D., A. Le Hors, I. Jacobs, (eds.), 1999. "HTML 4.01 Specification: 17. Forms," W3C Worldwide Web Consortium [accessed February 14, 2007] http://www.w3.org/TR/REC-html40/interact/forms.html.
• This is a list of reserved words in JavaScript (you cannot use these words for function or variable names in your program, because they are reserved for the programming language itself):
  JavaScript Kit, 2004. "Reserved Words," JavaScriptKit.com [accessed February 14, 2007] http://www.javascriptkit.com/jsref/reserved.shtml.
• Here is a JavaScript reference:
  Netscape Communications Corp., 1996. "JavaScript 1.1 Guide," [accessed February 14, 2007] http://wp.netscape.com/eng/mozilla/3.0/handbook/javascript/.
• If you get interested and start doing a lot of programming, you may want to try using a text editor that is a little more sophisticated than Notepad. An editor designed for programming can help with formatting, so that your code is more readable, but still produce plain text files. This type of editor can also do "syntax highlighting" (e.g., automatic color-coding of HTML) which can help you to find errors. Here is a free programmer's editor that you can try:
  http://www.crimsoneditor.com/
• This 19th century article used a plot of word length vs. frequency to distinguish texts by different authors:
  Mendenhall, T.C., 1887. "The Characteristic Curves of Composition," Science 9 (11 March): 237–246.
• For an online version of The Federalist Papers, see:
  Whitten, C., 2004. "The Federalist Papers," Founding Fathers Info [accessed February 14, 2007] http://www.foundingfathers.info/federalistpapers/.

Materials and Equipment

To do this experiment you will need the following materials and equipment:

• computer with web browser (e.g., Internet Explorer, Firefox),
• text editing program (e.g., Notepad),
• several samples of text by each of three (or more) authors, for example:
  • sample paragraphs from books by different authors,
  • e-mail or instant messages from friends.
• spreadsheet program (e.g., Excel or QuattroPro),
• graph paper or graphing software,
• a helper.

Experimental Procedure

1. Write the program to analyze text.
   1. For help on writing the JavaScript program to analyze blocks of text, see the Science Buddies project Paragraph Stats: Writing a JavaScript Program to 'Measure' Text.
   2. You may decide that you want to improve the program so that you can make additional measurements. The Variations section has some suggestions for additional measurements, and you will probably come up with others on your own.
2. Chosse three or more authors and select representative samples of text by each (it's best to use at least 1000 words).
3. Analyze each text sample with your program.
4. Experiment with methods of graphing the results to create your own 'writeprint' (Rehmeyer, 2007) for each author.
   1. So that you can make fair comparisons between samples, all of your graphs should share the same scales (i.e., the same range for the x- and y-axes of each graph should be the same). So think carefully when you design your 'writeprint' and make sure that your x- and y-axes are designed to accommodate the full range of possible measurements.
   2. The key is to identify measurements that consistently reveal a difference between authors.
   3. For starters, you may want to try plotting the word length vs. frequency for each author (Mendenhall, 1887).
5. Have your helper select additional paragraphs from each author. Your helper should also run the analysis on each additional sample, and give you the results, without identifying the authors. Can you determine the author of each unknown sample?

Variations

• Here are some ideas for functions that you might want to add to your text measurement program:
  • count the frequency of different sentence lengths,
  • frequency of function words, such as prepositions (e.g., of, from, in) and conjunctions (e.g., and, but, or).
• Let's say that one of your authors was J.K. Rowling, and all of your text samples came from the first Harry Potter book (Harry Potter and the Sorcerer's Stone). What happens if you use a text sample from a later book in the series, like Harry Potter and the Order of the Phoenix? Do your measurements still point to J.K. Rowling as the author?
• How much text do you need to get an accurate 'writeprint' for an author? Design an experiment to find out.
• Super-advanced students could explore representing the text analysis data as multidimensional vectors and using principal components analysis to differentiate between authors.

• For more science project ideas in this area of science, see Computer Science Project Ideas.

Credits

Andrew Olson, Ph.D., Science Buddies

Last edit date: 2007-03-23 12:00:00

Career Focus

If you like this project, you might enjoy exploring careers in Computer Science.

	Computer Programmer Computers are essential tools in the modern world, handling everything from traffic control, car welding, movie animation, shipping, aircraft design, and social networking to book publishing, business management, music mixing, health care, agriculture, and online shopping. Computer programmers are the people who write the instructions that tell computers what to do.			Computer Software Engineer Are you interested in developing cool video game software for computers? Would you like to learn how to make software run faster and more reliably on different kinds of computers and operating systems? Do you like to apply your computer science skills to solve problems? If so, then you might be interested in the career of a computer software engineer.
	Network Systems and Data Communications Analyst Computers are an important part of our lives. We use computers to hold and process data, to control manufacturing factories, and to surf the Internet. We are all part of many different kinds of computer networks that are continually sharing information. The role of the network systems and data communications analyst is to design, model, and evaluate computer networks so that they can share information seamlessly. This is an exciting career for those people who enjoy working with rapidly changing technology.			Software Quality Assurance Engineer and Tester Software quality assurance engineers and testers oversee the quality of a piece of software's development over its entire life cycle. Their goal is to see to it that the final product meets the customer's requirements and expectations in both performance and value. During the software life cycle, they verify (officially state) that it is possible for the software to accomplish certain tasks. They detect problems that exist in the process of developing the software, or in the product itself. They try and make things not work (try to "break" the software) by creating errors or combinations of errors that a user might make. For example, if a user enters a period or a pound sign for a password, will that break the software? They seek to anticipate potential issues with the software before they become visible. At the end of the life cycle, they reflect upon how problems or bugs arose, and figure out ways to make the software development process better in the future.
	Computer Hardware Engineer Whether you are playing video games, surfing the Internet, or writing a term paper, computers are an integral part of our daily lives. Computer hardware engineers work to make computers faster, more robust, and more cost-effective. They design the microprocessor chips that make your computer function, along with the equipment that makes computing easy and fun to do.			Database Administrator Databases are collections of similar records, like the products a company sells, information on all people with a driver's license for a state, or the medical records in a hospital. Database administrators have the important job of figuring out how to organize, access, store, search, cross-reference, and protect all those records. Their services are needed by law enforcement, government agencies, and every type of business imaginable. Management of large databases is also critical for scientific research, including understanding and developing cures for diseases.

Join Science Buddies Become a Science Buddies member! It's free! As a member you will be the first to receive our new and innovative project ideas, news about upcoming science competitions, science fair tips, and information on other science related initiatives. Support Science Buddies If this website has helped you, won't you consider a small gift so we may continue developing resources to help teachers and students?