Graduate Record Examinations

From Wikipedia, the free encyclopedia - View original article

 
Jump to: navigation, search

The Graduate Record Examinations (GRE) is a standardized test that is an admissions requirement for many graduate schools in the United States,[1] in other English-speaking countries and for English-taught graduate and business programs world-wide. Created and administered by Educational Testing Service (ETS) in 1949,[2] the exam aims to measure verbal reasoning, quantitative reasoning, analytical writing and critical thinking skills that have been acquired over a long period of time and that are not related to any specific field of study. The GRE General Test is offered as a computer-based exam administered by selected qualified testing centers.

In the graduate school admissions process, the level of emphasis that is placed upon GRE scores varies widely between schools and between departments within schools. The importance of a GRE score can range from being a mere admission formality to an important selection factor.

The GRE was completely overhauled in August 2011, creating an exam that is not adaptive on a question-by-question basis, but rather by section, so that the performance on the first verbal and math sections determine the difficulty of the second sections shown. Overall, the test retained the sections and question types from its predecessor, but the scores were changed to a 130 to 170 scale.

The cost to take the test varies between US$130 and $210, depending on the country in which it is taken, although ETS will reduce the fee under certain circumstances. They are promoting financial aid to those GRE applicants who prove economic hardship.[3] ETS erases all test records that are older than 5 years, although graduate program policies on the admittance of scores older than 5 years will vary.

Contents

Structure

The computer-based GRE General Test consists of six sections. The first section is always the analytical writing section involving separately timed issue and argument tasks. The next five sections consist of two verbal reasoning sections, two quantitative reasoning sections, and either an experimental or research section. These five sections may occur in any order. The experimental section does not count towards the final score but is not distinguished from the scored sections. Unlike on the computer adaptive test prior to August 2011, the examinee is free to skip back and forth within sections. The entire testing procedure lasts about 3 hours 45 minutes. [4] One-minute breaks are offered after each section and a 10-minute break after the third section.

The paper-based GRE General Test consists of six sections and is only available in areas where computer-based testing is unavailable. The analytical writing is split up into two sections, one section for each issue and argument task. The next four sections consist of two verbal and two quantitative sections in varying order. There is no experimental section on the paper-based test.

Verbal section

The computer-based verbal sections assess reading comprehension, critical reasoning and vocabulary usage. The verbal test is scored on a scale of 130-170, in 1-point increments (Before August 2011 the scale was 200–800, in 10-point increments). In a typical examination, each verbal section consists of 20 questions to be completed in 30 minutes. [5] Each verbal section consists of about 6 text completion, 4 sentence equivalence, and 10 critical reading questions. The changes in 2011 include a reduced emphasis on rote vocabulary knowledge and the elimination of antonyms and analogies. Text completion items have replaced sentence completions and new reading question types allowing for the selection of multiple answers were added.

Quantitative section

The computer-based quantitative sections assess basic high school level mathematical knowledge and reasoning skills. The quantitative test is scored on a scale of 130–170, in 1-point increments (Before August 2011 the scale was 200–800, in 10-point increments). In a typical examination, each quantitative section consists of 20 questions to be completed in 35 minutes.[6] Each quantitative section consists of about 8 quantitative comparisons, 9 problem solving items, and 3 data interpretation questions. The changes in 2011 include the addition of numeric entry items requiring the examinee to fill in a blank and multiple-choice items requiring the examinee to select multiple correct responses. [7]

Analytical writing section

The analytical writing section consists of two different essays, an "issue task" and an "argument task". The writing section is graded on a scale of 0-6, in half-point increments. The essays are written on a computer using a word processing program specifically designed by ETS. The program allows only basic computer functions and does not contain a spell-checker or other advanced features. Each essay is scored by at least two readers on a six-point holist scale. If the two scores are within one point, the average of the scores is taken. If the two scores differ by more than a point, a third reader examines the response.

Issue task

The test taker is given 30 minutes to write an essay about a selected topic. [8] Issue topics are selected from a pool of questions.[9]

Argument task

The test taker will be given an "argument" and will be asked to write an essay that critiques the argument. Test takers are asked to consider the argument's logic and to make suggestions about how to improve the logic of the argument. Test takers are expected to address the logical flaws of the argument, not to provide a personal opinion on the subject. The time allotted for this essay is 30 minutes.[10] Arguments are selected from a pool of topics.[11]

Experimental section

The experimental section, which can be either a verbal, quantitative, or analytical writing task, contains new questions ETS is considering for future use. Although the experimental section does not count towards the test-taker's score, it is unidentified and appears identical to the scored sections. Because test takers have no definite way of knowing which section is experimental, it is typically advised that test takers try their best on every section. Sometimes an identified research section at the end of the test is given instead of the experimental section. [12] There is no experimental section on the paper-based GRE.

Scoring

An examinee can miss one or more questions on a multiple-choice section and still receive a perfect score of 170. Likewise, even if no question is answered correctly, 130 is the lowest possible score.[13]

Scaled score percentiles

The percentiles for the current revised General test and the concordance with the prior format[14] are as follows. Means and standard deviations for the measures on the new score scale are not yet available:[15]

Scaled scoreVerbal Reasoning PercentileVerbal Prior ScaleQuantitative Reasoning PercentileQuantitative Prior Scale
17099760–80099800
16999740–75098800
16898720–73096800
1679771095800
1669670094800
16595680–69093790
16493660–67090790
1639165088780
16289630–64087770
1618662083770
16083600–61081760
1598059077750
15877570–58074740
1577356071730
15669540–55068720
1556553064700–710
15461510–52060690
1535750056680
15253480–49052660–670
15149460–47048640–650
1504445043630
14940430–44039610–620
1483642035590–600
1473241031570–580
14628390–40027550–560
1452438023530–540
1442137020500–520
14318350–36017480–490
1421534014460–470
1411233011430–450
140103209400–420
13983107380–390
13863005350–370
13752904330–340
13632803300–320
13532802280–290
13422701260–270
13312601240–250
13212501220–230
13112401200–210
130<1200–2301200
Field-wise distribution of takers of GRE revised General Test.[16]
Analytical Writing scoreWriting % Below
699
5.596
587
4.572
448
3.529
318
2.510
28
1.55
11
0.51


Comparisons for "Intended Graduate Major" are "limited to those who earned their college degrees up to two years prior to the test date." ETS provides no score data for "non-traditional" students who have been out of school more than two years, although its own report "RR-99-16" indicated that 22% of all test takers in 1996 were over the age of 30.

Use in admissions

Many graduate schools in English-speaking countries (especially in the United States) require GRE results as part of the admissions process. The GRE is a standardized test intended to measure the abilities of all graduates in tasks of general academic nature, regardless of their fields of specialization. The GRE is supposed to measure the extent to which undergraduate education has developed an individual's verbal and quantitative skills in abstract thinking.

Unlike other standardized admissions tests (such as the SAT, LSAT, and MCAT), the use and weight of GRE scores vary considerably not only from school to school, but from department to department, and from program to program also. Programs in liberal arts topics may only consider the applicant's verbal score to be of interest, while mathematics and science programs may only consider quantitative ability; however, since most applicants to mathematics, science, or engineering graduate programs all have high quantitative scores, the verbal score can become a deciding factor even in these programs. Admission to graduate schools depends on a complex mix of several different factors. Schools see letters of recommendation, statement of purpose, GPA, GRE score etc. Some schools use the GRE in admissions decisions, but not in funding decisions; others use the GRE for the selection of scholarship and fellowship candidates, but not for admissions. In some cases, the GRE may be a general requirement for graduate admissions imposed by the university, while particular departments may not consider the scores at all. Graduate schools will typically provide information about how the GRE is considered in admissions and funding decisions, and the average scores of previously admitted students. The best way to find out how a particular school or program evaluates a GRE score in the admissions process is to contact the person in charge of graduate admissions for the specific program in question (and not the graduate school in general).

GRE Subject Tests

In addition to the General Test, there are also eight GRE Subject Tests testing knowledge in the specific areas of Biochemistry, Cell and Molecular Biology; Biology; Chemistry; Computer Science; Literature in English; Mathematics; Physics; and Psychology. The length of each exam is 170 minutes.

In the past, subject tests were also offered in the areas of Economics, Revised Education, Engineering, Geology, History, Music, Political Science, and Sociology. In April 1998, the Revised Education and Political Science exams were discontinued. In April 2000, the History and Sociology exams were discontinued, and the other four were discontinued in April 2001.[17]

GRE and GMAT

The GMAT (Graduate Management Admission Test) is a computer adaptive standardized test in mathematics and the English language for measuring aptitude to succeed academically in graduate business studies. Business schools commonly use the test as one of many selection criteria for admission into an MBA program. However, there are many business schools that also accept GRE scores.

The following are criteria of certain business schools:

In comparison with GMAT's emphasis on logic, GRE measures the test-takers' ability more in vocabulary. This difference is reflected in the structure of each test. Despite the Analytical Writing section in common, GRE has analogies, antonyms, sentence completions, and reading comprehension passages in Verbal section, while GMAT has sentence correction, critical reasoning and reading comprehension.

Preparation

A variety of resources are available for those wishing to prepare for the GRE. ETS provides preparation software called PowerPrep, which contains two practice tests of retired questions, as well as further practice questions and review material. Since the software replicates both the test format and the questions used, it can be useful to predict the actual GRE scores. ETS does not license their past questions to any other company, making them the only source for official retired material. ETS used to publish the "BIG BOOK" which contained a number of actual GRE questions; however, this publishing was abandoned. Several companies provide courses, books, and other unofficial preparation materials.

Test preparation companies such as Kaplan and Princeton Review claim that the test format is so rigid that familiarizing oneself with the test's organization, timing, specific foci, and the use of process of elimination is the best way to increase a GRE score.[23]

Testing locations

While the general and subject tests are held at many undergraduate institutions, the computer-based general test is only held at test centers with appropriate technological accommodations. Students in major cities in the United States, or those attending large U.S. universities, will usually find a nearby test center, while those in more isolated areas may have to travel a few hours to an urban or university location. Many industrialized countries also have test centers, but at times test-takers must cross country borders.

Validity

An analysis of the GRE's validity in predicting graduate school success found a correlation of .30 to .45 between the GRE and both first year and overall graduate GPA. The correlation between GRE score and graduate school completion rates ranged from .11 (for the now defunct analytical section) to .39 (for the GRE subject test). Correlations with faculty ratings ranged from .35 to .50.[24]

Criticism

Bias

Critics have claimed that the computer-adaptive methodology may discourage some test takers, because the question difficulty changes with performance.[citation needed] For example, if the test-taker is presented with remarkably easy questions half way into the exam, they may infer that they are not performing well, which will influence their abilities as the exam continues, even though question difficulty is subjective. By contrast standard testing methods may discourage students by giving them more difficult items earlier on.

Critics have also stated that the computer-adaptive method of placing more weight on the first several questions is biased against test takers who typically perform poorly at the beginning of a test due to stress or confusion before becoming more comfortable as the exam continues.[25] On the other hand, standard fixed-form tests could equally be said to be "biased" against students with less testing stamina since they would need to be approximately twice the length of an equivalent computer adaptive test to obtain a similar level of precision.[26]

The GRE has also been subjected to the same racial bias criticisms that have been lodged against other admissions tests. In 1998, the Journal of Blacks in Higher Education noted that the mean score for black test-takers in 1996 was 389 on the verbal section, 409 on the quantitative section, and 423 on the analytic, while white test-takers averaged 496, 538, and 564, respectively.[27] The National Association of Test Directors Symposia in 2004 stated a belief that simple mean score differences may not constitute evidence of bias unless the populations are known to be equal in ability.[28] A more effective, accepted, and empirical approach is the analysis of differential test functioning, which examines the differences in item response theory curves for subgroups; the best approach for this is the DFIT framework.[29]

Weak predictor of graduate school performance

The GREs are criticized for not being a true measure of whether a student will be successful in graduate school. Robert Sternberg (now of Oklahoma State University–Stillwater; working at Yale University at the time of the study), a long-time critic of modern intelligence testing in general, found the GRE general test was weakly predictive of success in graduate studies in psychology.[30] The strongest relationship was found for the now-defunct analytical portion of the exam.

The ETS published a report ("What is the Value of the GRE?") that points out the predictive value of the GRE on a student's index of success at the graduate level.[31] The problem with earlier studies is the statistical phenomena of restriction of range. A correlation coefficient is sensitive to the range sampled for the test. Specifically, if only students accepted to graduate programs are studied (in Sternberg & Williams and other research), the relationship is occluded. Validity coefficients range from .30 to .45 between the GRE and both first year and overall graduate GPA in ETS' study.[24]

Historical susceptibility to cheating

In May 1994, Kaplan, Inc warned ETS, in hearings before a New York legislative committee, that the small question pool available to the computer-adaptive test made it vulnerable to cheating. ETS assured investigators that it was using multiple sets of questions and that the test was secure. This was later discovered to be incorrect.[32]

In December 1994, prompted by student reports of recycled questions, then Director of GRE Programs for Kaplan, Inc and current CEO of Knewton, Jose Ferreira led a team of 22 staff members deployed to 9 U.S. cities to take the exam. Kaplan, Inc then presented ETS with 150 questions, representing 70-80% of the GRE.[33] According to early news releases, ETS appeared grateful to Stanley H. Kaplan, Inc for identifying the security problem. However, on December 31, ETS sued Kaplan, Inc for violation of a federal electronic communications privacy act, copyright laws, breach of contract, fraud, and a confidentiality agreement signed by test-takers on test day.[34] On January 2, 1995, an agreement was reached out of court.

Additionally, in 1994, the scoring algorithm for the computer-adaptive form of the GRE was discovered to be insecure. ETS acknowledged that Kaplan, Inc employees, led by Jose Ferreira, reverse-engineered key features of the GRE scoring algorithms. The researchers found that a test taker’s performance on the first few questions of the exam had a disproportionate effect on the test taker’s final score. To preserve the integrity of scores, ETS revised its scoring and uses a more sophisticated scoring algorithm.

2011 Revision of the GRE

In 2006, ETS announced plans to enact significant changes in the format of the GRE. Planned changes for the revised GRE included a longer testing time, a departure from computer-adaptive testing, a new grading scale, and an enhanced focus on reasoning skills and critical thinking for both the quantitative and qualitative sections.[35]

On April 2, 2007, ETS announced the decision to cancel plans for revising the GRE.[36] The announcement cited concerns over the ability to provide clear and equal access to the new test after the planned changes as an explanation for the cancellation. The ETS stated, however, that they do plan "to implement many of the planned test content improvements in the future", although specific details regarding those changes have not yet been announced.

Changes to the GRE took effect on November 1, 2007, as ETS started to include new types of questions in the exam. The changes mostly center on "fill in the blank" type answers for the mathematics section that requires the test-taker to fill in the blank directly, without being able to choose from a multiple choice list of answers. ETS currently plans to introduce two of these new types of questions in each quantitative section, while the majority of questions will be presented in the regular format.[37]

Since January 2008, the Reading Comprehension within the verbal sections has been reformatted, passages' "line numbers will be replaced with highlighting when necessary in order to focus the test taker on specific information in the passage" to "help students more easily find the pertinent information in reading passages."[38]

In December 2009, ETS announced plans to move forward with significant revisions to the GRE in 2011.[39] Changes include a new 130-170 scoring scale, the elimination of certain question types such as antonyms and analogies, the addition of an online calculator, and the elimination of the CAT format of question-by-question adjustment, in favor of a section by section adjustment.[40] The Revised GRE General test replaced General GRE test on August 1, 2011. The revised GRE is said to be better by design and gives better test taking experience. The new types of questions in the revised pattern are supposed to test the skills needed in graduate and business schools programs.[41]From July 2012 onwards GRE announced an option for users to customize their scores called as score select.[42]

GRE prior to October 2002

The earliest versions of the GRE tested only for verbal and quantitative ability. For a number of years prior to October 2002, the GRE had a separate Analytical Ability section which tested candidates on logical and analytical reasoning abilities. This section was replaced by the Analytical Writing Assessment.

See also


  1. ^ GRE Registration and Information Bulletin
  2. ^ Alternative Admissions and Scholarship Selection Measures in Higher Education.
  3. ^ MBA Channel: "GRE:Wharton joins the club" 31 July 2009
  4. ^ GRE Test Content
  5. ^ GRE Test Content
  6. ^ GRE Test Content
  7. ^ Weiner-Green, Sharon; Wolf, Ira K (2009), Barron's How to Prepare for the GRE (17 ed.), Barron's Educational Series, p. 9, ISBN 0-7641-7471-1 
  8. ^ GRE Revised Analytical Writing
  9. ^ The Pool of Issue Topics
  10. ^ GRE Test Content
  11. ^ The Pool of Argument Topics
  12. ^ GRE Test Content
  13. ^ http://www.ets.org/gre/revised_general/scores/
  14. ^ http://www.ets.org/s/gre/pdf/concordance_information.pdf
  15. ^ http://www.ets.org/s/gre/pdf/gre_guide.pdf Guide to the Use of Scores 2011–2012
  16. ^ http://www.ets.org/s/gre/pdf/gre_guide_table4.pdf
  17. ^ http://www.physicsgre.com/engineering-gre.shtml
  18. ^ HBS: "Admissions Requirements" 29 December 2010
  19. ^ Darden: " Application Requirements" 29 December 2010
  20. ^ Sloan: "Application Instructions" 29 December 2010
  21. ^ "Aptitude and English Tests: MBA Program: Stanford GSB". Stanford Graduate School of Business. http://www.gsb.stanford.edu/mba/admission/test_scores.html#gmat_gre. 
  22. ^ GRE: [1]
  23. ^ Princeton Review, Cracking the GRE, 2007 edition p. 19 # ISBN 0-375-76551-4, ISBN 978-0-375-76551-3. 2006
  24. ^ a b Kuncel, N. R.; Hezlett, S. A.; Ones, D. S. (2001). "A comprehensive meta-analysis of the predictive validity of the Graduate Record Examinations: Implications for graduate student selection and performance". Psychological Bulletin 127 (1): 162–181. http://web.uvic.ca/psyc/lindsay/teaching/499/readings/kuncel.pdf. 
  25. ^ "Testing service cancels February GRE". http://www.dailybruin.ucla.edu/archives/id/4597/. 
  26. ^ Weiss, D. J.; Kingsbury, G. G. (1984). "Application of computerized adaptive testing to educational problems". Journal of Educational Measurement 21 (4): 361–375. doi:10.1111/j.1745-3984.1984.tb01040.x. 
  27. ^ "Estimating the Effect a Ban on Racial Preferences Would Have on African- American Admissions to the Nation's Leading Graduate Schools". The Journal of Blacks in Higher Education 19: 80–82. 1998. JSTOR 2998926. 
  28. ^ The Achievement Gap: Test Bias or School Structures? National Association of Test Directors 2004 Symposia [2]
  29. ^ Oshima, T. C.; Morris, S. B. (2008). "Raju's Differential Functioning of Items and Tests (DFIT)". Educational Measurement: Issues and Practice 27 (3): 43–50. 
  30. ^ Sternberg, R. J.; Williams, W. M. (1997). "Does the Graduate Record Examinations predict meaningful success in the graduate training of psychology? A case study". American Psychologist 52: 630–641. http://www.news.cornell.edu/releases/Aug97/GRE.study.ssl.html. 
  31. ^ http://www.ets.org/Media/Tests/GRE/pdf/grevalue.pdf
  32. ^ Frantz, Douglas; Nordheimer, Jon (September 28, 1997). "Giant of Exam Business Keeps Quiet on Cheating". The New York Times. http://www.nytimes.com/1997/09/28/us/giant-of-exam-business-keeps-quiet-on-cheating.html?sec=&spon=&pagewanted=all. Retrieved April 2, 2010. 
  33. ^ "Computer Admissions Test Found to Be Ripe for Abuse". The New York Times. December 16, 1994. http://www.nytimes.com/1994/12/16/us/computer-admissions-test-found-to-be-ripe-for-abuse.html?scp=1&sq=Ripe%20for%20abuse&st=cse. Retrieved April 2, 2010. 
  34. ^ Boxall, Bettina (January 1, 1995). "Educational Testing Service Sues Exam-Coaching Firm". Los Angeles Times. http://articles.latimes.com/1995-01-01/news/mn-15369_1_educational-testing-service. Retrieved May 4, 2010. 
  35. ^ Comparison Chart of GRE Changes
  36. ^ Plans for the Revised GRE Cancelled
  37. ^ GRE General Test to Include New Question Types in November
  38. ^ Revisions to the Computer-based GRE General Test in 2008 at the Wayback Machine (archived August 22, 2008)
  39. ^ Revised General Test
  40. ^ A New Look for Graduate Entrance Test
  41. ^ Revised GRE FAQs
  42. ^ "GRE Score Select". http://gre.learnhub.com/lesson/21133-gre-announces-scoreselect-option-july-2012-onwards. 

External links