Hostname: page-component-8448b6f56d-m8qmq Total loading time: 0 Render date: 2024-04-23T06:01:53.068Z Has data issue: false hasContentIssue false
  • English
  • Français

TIMED AND UNTIMED GRAMMATICALITY JUDGMENTS MEASURE DISTINCT TYPES OF KNOWLEDGE

Evidence from Eye-Movement Patterns

Published online by Cambridge University Press:  20 May 2015

Aline Godfroid ,
Shawn Loewen ,
Sehoon Jung ,
Ji-Hyun Park ,
Susan Gass  and
Rod Ellis
Aline Godfroid*
Affiliation:
Michigan State University
Shawn Loewen
Affiliation:
Michigan State University
Sehoon Jung
Affiliation:
Michigan State University
Ji-Hyun Park
Affiliation:
Michigan State University
Susan Gass
Affiliation:
Michigan State University
Rod Ellis
Affiliation:
University of Auckland
*
*Correspondence concerning this article should be addressed to Dr. Aline Godfroid, Second Language Studies Program, Michigan State University, B253 Wells Hall, 619 Red Cedar Road, East Lansing, MI, 48824. E-mail: godfroid@msu.edu
Get access Rights & Permissions [Opens in a new window]

Abstract

Grammaticality judgment tests (GJTs) have been used to elicit data reflecting second language (L2) speakers’ knowledge of L2 grammar. However, the exact constructs measured by GJTs, whether primarily implicit or explicit knowledge, are disputed and have been argued to differ depending on test-related variables (i.e., time pressure and item grammaticality).

Using eye-tracking, this study replicates the GJT results in R. Ellis (2005). Twenty native and 40 nonnative English speakers judged sentences with and without time pressure. Analyses revealed that time pressure suppressed regressions (right-to-left eye movements) in nonnative speakers only. Conversely, both groups regressed more on untimed, grammatical items. These findings suggest that timed and untimed GJTs measure different constructs, which could correspond to implicit and explicit knowledge, respectively. In particular, they point to a difference in the levels of automatic and controlled processing involved in responding to the timed and untimed tests. Furthermore, untimed grammatical items may induce GJT-specific task effects.

Type
Articles
Information
Studies in Second Language Acquisition , Volume 37 , Special Issue 2: New Directions in the Study of Implicit and Explicit Learning , June 2015 , pp. 269 - 297
Copyright
Copyright © Cambridge University Press 2015 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

REFERENCES

Agresti, A. (2013). Categorical data analysis (3rd ed.). New York, NY: Wiley.Google Scholar
Bialystok, E. (1979). Explicit and implicit judgments of L2 grammaticality. Language Learning, 29, 81–103.CrossRefGoogle Scholar
Bialystok, E. (1982). On the relationship between knowing and using linguistic forms. Applied Linguistics, 3, 181–206.CrossRefGoogle Scholar
Bialystok, E. (1994). Analysis and control in the development of second language proficiency. Studies in Second Language Acquisition, 16, 157–168.CrossRefGoogle Scholar
Bley-Vroman, R. (1983). The comparative fallacy in interlanguage studies: The case of systematicity. Language Learning, 33, 1–17.CrossRefGoogle Scholar
Bowles, M. A. (2011). Measuring implicit and explicit linguistic knowledge. Studies in Second Language Acquisition, 33, 247–271.CrossRefGoogle Scholar
Cleeremans, A., & Jiménez, L. (2002). Implicit learning and consciousness: A graded, dynamic perspective. In French, R. M. & Cleeremans, A. (Eds.), Implicit learning and consciousness (pp. 1–40). Hove, UK: Psychology Press.Google Scholar
Clifton, C. Jr., & Staub, A. (2011). Syntactic influences on eye movements in reading. In Liversedge, S. P., Gilchrist, I. D., & Everling, S. (Eds.), The Oxford handbook of eye movements (pp. 895–909). Oxford, UK: Oxford University Press.Google Scholar
Clifton, C. Jr., Staub, A., & Rayner, K. (2007). Eye movements in reading words and sentences. In van Gompel, R. P. G., Fischer, M. H., Murray, W. S., & Hill, R. L. (Eds.), Eye movements: A window on mind and brain (pp. 341–372). Oxford, UK: Elsevier.CrossRefGoogle Scholar
Coughlin, C. E., & Tremblay, A. T. (2013). Proficiency and working memory based explanations for nonnative speakers’ sensitivity to agreement in sentence processing. Applied Psycholinguistics, 34, 615–646.CrossRefGoogle Scholar
DeKeyser, R. M. (2003). Implicit and explicit learning. In Doughty, C. J. & Long, M. H. (Eds.), The handbook of second language acquisition (pp. 313–348). Oxford, UK: Blackwell.Google Scholar
DeKeyser, R. M. (2007). Situating the concept of practice. In DeKeyser, R. M. (Ed.), Practicing in a second language: Perspectives from applied linguistics and cognitive psychology (pp. 1–18). New York, NY: Cambridge University Press.CrossRefGoogle Scholar
Dienes, Z., & Perner, J. (1999). A theory of implicit and explicit knowledge. Behavioral and Brain Sciences, 22, 735–808.CrossRefGoogle ScholarPubMed
Dussias, P. E. (2010). Uses of eye-tracking data in second language sentence processing research. Annual Review of Applied Linguistics, 30, 149–166.CrossRefGoogle Scholar
Dussias, P. E., & Piñar, P. (2010). Effects of reading span and plausibility in the reanalysis of wh-gaps by Chinese-English second language speakers. Second Language Research, 26, 443–472.CrossRefGoogle Scholar
Ellis, N. C. (Ed.). (1994). Implicit and explicit learning of languages. San Diego, CA: Academic Press.Google Scholar
Ellis, N. C., Hafeez, K., Martin, K., Chen, L., & Boland, J. (2014). An eye-tracking study of learned attention in second language acquisition. Applied Psycholinguistics, 35, 547–579.CrossRefGoogle Scholar
Ellis, R. (1991). Grammaticality judgments and second language acquisition. Studies in Second Language Acquisition, 13, 161–186.CrossRefGoogle Scholar
Ellis, R. (2005). Measuring implicit and explicit knowledge of a second language: A psychometric study. Studies in Second Language Acquisition, 27, 141–172.CrossRefGoogle Scholar
Ellis, R., & Loewen, S. (2007). Confirming the operational definitions of explicit and implicit knowledge in Ellis (2005): Responding to Isemonger. Studies in Second Language Acquisition, 29, 119–126.CrossRefGoogle Scholar
Ellis, R., Loewen, S., Elder, C., Erlam, R., Philp, J., & Reinders, H. (Eds.). (2009). Implicit and explicit knowledge in second language learning, testing, and teaching. Bristol, UK: Multilingual Matters.Google Scholar
Ferguson, C. J. (2009). An effect size primer: A guide for clinicians and researchers. Professional Psychology: Research and Practice, 40, 532–538.CrossRefGoogle Scholar
Frazier, L., & Rayner, K. (1982). Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences. Cognitive Psychology, 14, 178–210.CrossRefGoogle Scholar
Frenck-Mestre, C. (2005). Eye-movement recording as a tool for studying syntactic processing in a second language: A review of methodologies and experimental findings. Second Language Research, 21, 175–198.CrossRefGoogle Scholar
Garnsey, S. M., Pearlmutter, N. J., Myers, E., & Lotocky, M. A. (1997). The contributions of verb bias and plausibility to the comprehension of temporarily ambiguous sentences. Journal of Memory and Language, 37, 58–93.CrossRefGoogle Scholar
Godfroid, A., & Winke, P. (in press). Investigating implicit and explicit processing using L2 learners’ eye-movement data. In Rebuschat, P. (Ed.), Implicit and explicit learning of languages. Amsterdam, the Netherlands: Benjamins.Google Scholar
Gutiérrez, X. (2013). The construct validity of grammaticality judgment tests as measures of implicit and explicit knowledge. Studies in Second Language Acquisition, 35, 423–449.CrossRefGoogle Scholar
Han, Y., & Ellis, R. (1998). Implicit knowledge, explicit knowledge and general language proficiency. Language Teaching Research, 2, 1–23.CrossRefGoogle Scholar
Hedgcock, J. (1993). Well-formed versus ill-formed strings in L2 metalingual tasks: Specifying features of grammaticality judgments. Second Language Research, 9, 1–21.CrossRefGoogle Scholar
Holmqvist, K., Holsanova, J., Barthelson, M., & Lundqvist, D. (2003). Reading or scanning? A study of newspaper and net paper reading. In Hyönä, J., Radach, R., & Deubel, H. (Eds.), The mind’s eye: Cognitive and applied aspects of eye movement research (pp. 657–670). Amsterdam, the Netherlands: Elsevier Science.CrossRefGoogle Scholar
Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. Oxford, UK: Oxford University Press.Google Scholar
Hopp, H. (2010). Ultimate attainment in L2 inflection: Performance similarities between non-native and native speakers. Lingua, 120, 901–931.CrossRefGoogle Scholar
Hosmer, D. W., & Lemeshow, S. (2013). Applied logistic regression (3rd ed.). Hoboken, NJ: Wiley.CrossRefGoogle Scholar
Hulstijn, J. H., & Ellis, R. (Eds.). (2005). Implicit and explicit second-language learning [Special issue]. Studies in Second Language Acquisition, 27(2).CrossRefGoogle Scholar
Hyönä, J., Lorch, R. F. Jr., & Kaakinen, J. K. (2002). Individual differences in reading to summarize expository text: Evidence from eye fixation patterns. Journal of Educational Psychology, 94, 44–55.CrossRefGoogle Scholar
Jiang, N., Novokshanova, E., Masuda, K., & Wang, X. (2011). Morphological congruency and the acquisition of L2 morphemes. Language Learning, 61, 940–967.CrossRefGoogle Scholar
Johansson, R., Wengelin, Å., Johansson, V., & Holmqvist, K. (2010). Looking at the keyboard or the monitor: Relationship with text production processes. Reading and Writing, 23, 835–851.CrossRefGoogle Scholar
Juffs, A. (2005). The influence of first language on the processing of wh-movement in English as a second language. Second Language Research, 21, 121–151.CrossRefGoogle Scholar
Kaakinen, J., & Hyönä, J. (2005). Perspective effects on expository text comprehension: Evidence from think-aloud protocols, eye-tracking, and recall. Discourse Processes, 40, 239–257.CrossRefGoogle Scholar
Kaakinen, J., & Hyönä, J. (2008). Perspective-driven text comprehension. Applied Cognitive Psychology, 22, 319–334.CrossRefGoogle Scholar
Keating, G. D. (2009). Sensitivity to violations of gender agreement in native and nonnative Spanish: An eye-movement investigation. Language Learning, 59, 503–535.CrossRefGoogle Scholar
Kliegl, R., Grabner, E., Rolfs, M., & Engbert, R. (2004). Length, frequency, and predictability effects of words on eye movements in reading. European Journal of Cognitive Psychology, 16(1/2), 262–284.CrossRefGoogle Scholar
Leeser, M. J., Brandl, A., & Weissglass, C. (2011). Task effects in second language sentence processing research. In Trofimovich, P. & McDonough, K. (Eds.), Applying priming methods to L2 learning, teaching and research: Insights from psycholinguistics (pp. 179–198). Amsterdam, the Netherlands: Benjamins.CrossRefGoogle Scholar
Liberman, A. M. (2005). How much more likely? The implications of odds ratios for probabilities. American Journal of Evaluation, 26, 253–266.CrossRefGoogle Scholar
Lim, J., & Christianson, K. (2014). Second language sensitivity to agreement errors: Evidence from eye movements during comprehension and translation. Applied Psycholinguistics. Advance online publication. doi:10.1017/S0142716414000290Google Scholar
Loewen, S. (2009). Grammaticality judgment tests and the measurement of implicit and explicit L2 knowledge. In Ellis, R., Loewen, S., Elder, C., Erlam, R., Philp, J., & Reinders, H. (Eds.), Implicit and explicit knowledge in second language learning, testing and teaching (pp. 94–112). Bristol, UK: Multilingual Matters.CrossRefGoogle Scholar
McLaughlin, B., Rossman, T., & McLeod, B. (1983). Second language learning: An information-processing perspective. Language Learning, 33, 135–158.CrossRefGoogle Scholar
Meseguer, E., Carreiras, M., & Clifton, C. (2002). Overt reanalysis strategies and eye movements during the reading of mild garden path sentences. Memory & Cognition, 30, 551–561.CrossRefGoogle ScholarPubMed
Mitchell, D. C., Shen, X., Green, M. J., & Hodgson, T. L. (2008). Accounting for regressive eye-movements in models of sentence processing: A reappraisal of the Selective Reanalysis hypothesis. Journal of Memory and Language, 59, 266–293.CrossRefGoogle Scholar
Omaki, A., & Schulz, B. (2011). Filler-gap dependencies and island constraints in second-language sentence processing. Studies in Second Language Acquisition, 33, 563–588.CrossRefGoogle Scholar
Paradis, M. (2004). A neurolinguistic theory of bilingualism. Amsterdam, the Netherlands: Benjamins.CrossRefGoogle Scholar
Phillips, C. (2006). The real-time status of island phenomena. Language, 82, 795–823.CrossRefGoogle Scholar
Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124, 372–422.CrossRefGoogle ScholarPubMed
Rayner, K. (2009). Eye-movements and attention in reading, scene perception, and visual search. The Quarterly Journal of Experimental Psychology, 62, 1457–1506.CrossRefGoogle ScholarPubMed
Reber, A. (1976). Implicit learning of synthetic languages: The role of instructional set. Journal of Experimental Psychology, Human Learning and Memory, 2, 88–94.CrossRefGoogle Scholar
Rebuschat, P. (2013). Measuring implicit and explicit knowledge in second language research. Language Learning, 63, 595–626.CrossRefGoogle Scholar
Rebuschat, P., & Williams, J. (Eds.). (2012). Statistical learning and language acquisition. Berlin, Germany: Walter de Gruyter.Google Scholar
Reichle, E. D. (2011). Serial-attention models of reading. In Liversedge, S. P., Gilchrist, I. D., & Everling, S. (Eds.), The Oxford handbook of eye movements (pp. 767–786). Oxford, UK: Oxford University Press.Google Scholar
Reichle, E. D., Pollatsek, A., & Rayner, K. (2012). Using E-Z Reader to simulate eye movements in nonreading tasks: A unified framework for understanding the eye-mind link. Psychological Review, 119, 155–185.CrossRefGoogle ScholarPubMed
Reichle, E. D., Warren, T., & McConnell, K. (2009). Using E-Z Reader to model the effects of higher level language processing on eye movements during reading. Psychonomic Bulletin & Review, 16, 1–21.CrossRefGoogle ScholarPubMed
Roberts, L., & Liszka, S. A. (2013). Processing tense/aspect-agreement violations on-line in the second language: A self-paced reading study with French and German L2 learners of English. Second Language Research, 29, 413–439.CrossRefGoogle Scholar
Roberts, L., & Siyanova-Chanturia, A. (2013). Using eye-tracking to investigate topics in L2 acquisition and L2 processing. Studies in Second Language Acquisition, 35, 213–235.CrossRefGoogle Scholar
Sagarra, N., & Ellis, N. C. (2013). From seeing adverbs to seeing verbal morphology. Studies in Second Language Acquisition, 35, 261–290.CrossRefGoogle Scholar
Sagarra, N., & Herschensohn, J. (2010). The role of proficiency and working memory in gender and number agreement processing in L1 and L2 Spanish. Lingua, 120, 2022–2039.CrossRefGoogle Scholar
Sanz, C., & Leow, R. P. (Eds.). (2011). Implicit and explicit language learning: Conditions, processes, and knowledge in SLA and bilingualism. Washington, DC: Georgetown University Press.Google Scholar
Schütze, C. T., & Sprouse, J. (2014). Judgment data. In Podesva, R. J. & Sharma, D. (Eds.), Research methods in linguistics (pp. 27–50). Cambridge, UK: Cambridge University Press.CrossRefGoogle Scholar
Shiffrin, R. M., & Schneider, W. (1977). Controlled and automatic human information processing. II. Perceptual learning, automatic attending and a general theory. Psychological Review, 84, 127–190.CrossRefGoogle Scholar
Skrondal, A., & Rabe-Hesketh, S. (2003). Multilevel logistic regression for polytomous data and rankings. Psychometrika, 68, 267–287.CrossRefGoogle Scholar
VanPatten, B., Keating, G. D., & Leeser, M. J. (2012). Missing verbal inflections as a representational problem: Evidence from self-paced reading. Linguistic Approaches to Bilingualism, 2, 109–140.CrossRefGoogle Scholar
Vitu, F., & McConkie, G. W. (2000). Regressive saccades and word perception in adult reading. In Kennedy, A., Radach, R., Heller, D., & Pynte, J. (Eds.), Reading as a perceptual process (pp. 301–326). Amsterdam, the Netherlands: Elsevier.CrossRefGoogle Scholar
Von der Malsburg, T., Kliegl, R., & Vasishth, S. (2014). Determinants of scanpath regularity in reading. Cognitive Science. Advance online publication. doi:10.1111/cogs.12208CrossRefGoogle Scholar
Von der Malsburg, T., & Vasishth, S. (2011). What is the scanpath signature of syntactic reanalysis? Journal of Memory and Language, 65, 109–127.CrossRefGoogle Scholar
Warren, T. (2011). The influence of implausibility and anomaly on eye movements during reading. In Liversedge, S. P., Gilchrist, I. D., & Everling, S. (Eds.), The Oxford handbook of eye movements (pp. 911–923). Oxford, UK: Oxford University Press.Google Scholar
Wengelin, Å., Torrance, M., Holmqvist, K., Simpson, S., Galbraith, D., Johansson, V., & Johansson, R. (2009). Combined eyetracking and keystroke-logging methods for studying cognitive processes in text production. Behavior Research Methods, 41, 337–351.CrossRefGoogle ScholarPubMed
White, L., & Juffs, A. (1998). Constraints on wh-movement in two different contexts of non-native language acquisition: Competence and processing. In Flynn, S., Martohardjono, G., & O’Neil, W. (Eds.), The generative study of second language acquisition (pp. 111–129). Hillsdale, NJ: Erlbaum.Google Scholar
Williams, J. N. (2009). Implicit learning in second language acquisition. In Ritchie, W. C. & Bhatia, T. K. (Eds.), The new handbook of second language acquisition (pp. 319–353). Bingley, UK: Emerald.Google Scholar
Wright, R. D., & Ward, L. M. (2008). Orienting of attention. New York, NY: Oxford University Press.CrossRefGoogle Scholar
Zhang, R. (2014). Measuring university-level L2 learners’ implicit and explicit linguistic knowledge. Studies in Second Language Acquisition. Advance online publication. doi:10.1017/S0272263114000370Google Scholar