Evaluation of Second Language Dialogue Fluency

Authors

  • Shiqing Peng

DOI:

https://doi.org/10.61173/81g3k816

Keywords:

dialogue fluency, measurement, within-turn fluency, between-turn fluency

Abstract

This paper provides a comprehensive review of the measures of dialogue fluency, with a focus on within-turn fluency and between-turn fluency. First, within-turn fluency includes three dimensions: speed, breakdown (pauses and prolongations), and repair, while between-turn fluency focuses on turn pause and alignment. By reviewing previous studies, this research summarizes measures for within-turn fluency, particularly the application of composite measures (e.g., frequency of filled pauses, combining pause duration) in fluency studies. The findings reveal that speed, including both pure speed measures like articulation rate and combined measures such as speech rate encompassing both speed and pause, is the most commonly used measure in within-turn fluency studies. Additionally, research on between-turn fluency has been gradually increasing in recent years. Common between-turn fluency measures, as well as other potential measures, are summarized in this paper. Overall, this paper provides a theoretical framework and practical guidance for the selection of measures in future empirical studies and to enhance the systematicity of fluency assessment frameworks in future second language assessments.

References

[1] . Boersma, P., & Weenink, D. (2018). Intra-sentence pause 195-224. https://doi.org/10.1111/lang.12345 patterns and their effects on prosody perception in speech [14]. De Jong, N.H., Pacilly, J., & Heeren, W. (2021). Praat processing. Speech Communication, 98, 76-84. https://doi. scripts to measure speed fluency and breakdown fluency in org/10.1016/j.specom.2017.09.003 speech automatically. Assessment in Education: Principles,

[2] . Bögels, S., & Krahmer, E. (2016). The role of intra- Policy & Practice, 28(4), 456-476. https://doi.org/10.1080/0969 sentence pauses in discourse processing: Evidence from 594X.2021.1951162 speech production and comprehension. Journal of Memory and [15]. Doukhan, D., Rilliard, A., Rosset, S., & D’Alessandro, Language, 91, 74-88. https://doi.org/10.1016/j.jml.2016.04.004 C. (2012). Modelling pause duration as a function of contextual

[3] . Bosker, H. R. (2014). L2 fluency: The role of speech rate length. Interspeech, 659–662. https://doi.org/10.21437/ and pauses in oral proficiency assessments. Language Testing Interspeech.2012-203 31(1), 27-49. https://doi.org/10.1177/0265532213497095 [16]. Esmaili, M., Vali, M., & Lotfi, A. (2017). A speaker

[4] . Bosker, H. R., de Jong, N. H., & van Weijen, D. (2012). Pause rate robust prolongation detection algorithm for dysfluency frequency and its relationship to fluency in L2 speech: A corpus analysis. Journal of Medical Signals & Sensors, 7(1), 31- study. Applied Psycholinguistics, 33(2), 1-20. https://doi. 37. https://doi.org/10.4103/jmss.jmss_57_16 org/10.1017/S0142716411000292. [17]. Field, J. (2008). Listening in the language

[5] . Brouwer, S., & Krahmer, E. (2018). Turn-taking and classroom. Cambridge University Press. https://doi.org/10.1017/ information structure in dialogue. Discourse Studies, 20(3), 261- CBO9780511490406 279. https://doi.org/10.1177/1461445618762537 [18]. Field, J. (2018). The interaction of listening comprehension

[6] . Choi, J. (2016). Turn-taking and pause lengths in natural and fluency in second language learners. Applied Linguistics, conversation: An analysis of a Korean corpus. Journal 39(2), 220-240. https://doi.org/10.1093/applin/amx060 o f P r a g m a t i c s , 9 3 , 2 7 - 4 3 . h t t p s : / / d o i . o rg / 1 0 . 1 0 1 6 / [19]. Foster, P., & Tavakoli, P. (2009). The effects of j.pragma.2015.12.002 speaking task and proficiency on pausing behavior in L2

[7] . De Jong, N. H., & Wempe, T. (2009). Practise makes speech. International Review of Applied Linguistics in Language perfect: The relationship between practice and fluency in second Teaching, 47(1), 23-43. https://doi.org/10.1515/iral.2009.003 language speech. Applied Linguistics, 30(1), 20-41. https://doi. [20]. Feruzabonu Temurqizi Temirova. (2020). Importance of org/10.1093/applin/amn010. paralinguistic features in communication and their theoretical

[8] . De Jong, N. H., & Perfetti, C. A. (2011). The role study. The American Journal of Social Science and Education of self-repair in fluency and comprehension. Journal of Innovations, 2(09), 111–116. https://doi.org/10.37547/tajssei/ Language and Social Psychology, 30(2), 179-199. https://doi. Volume02Issue09-15 org/10.1177/0261927X11412651 Dean&Francis ISSN 2959-6122

[21] . Ginther, A., Dimova, S., & Yang, H. (2010). The role language fluency: Exploring pause frequency and syllable of speech rate in the assessment of fluency in speaking length. Language Teaching Research, 24(5), 738-755. https:// tests. Language Testing, 27(4), 525-544. https://doi. doi.org/10.1017/S0272263120000013. org/10.1177/0265532210373740 [36]. Kahng, J. (2020). The multidimensionality of second

[22] . Gregory, S., & Webster, J. (2021). Measuring dialogue language oral fluency: Interfacing cognitive fluency and synchronization: Methodological advancements and empirical utterance fluency. Studies in Second Language Acquisition, findings. Discourse Processes, 58(1), 1-20. https://doi.org/10.10 42(4), 877-908. https://doi.org/10.1017/S0272263119000320. 80/0163853X.2021.1889907 [37]. Kahng, J. (2020). Cognitive factors influencing

[23] . Gilabert, R., & C. A. (2017). The effects of task complexity utterance fluency in L2 dialogues: Monadic and non-monadic on fluency in L2 speech. Applied Linguistics, 38(2), 185-203. perspectives. Frontiers in Psychology. https://doi.org/10.3389/ https://doi.org/10.1093/applin/amw006. fpsyg.2020.00822

[24] . Housen, A., Kuiken, F., & Vedder, I. (2012). Complexity, [38]. Kim, Y. J., & McDonough, K. (2015). Linguistic alignment accuracy, and fluency in SLA: A research agenda. Applied in second language acquisition: A review of the evidence. Studies Linguistics, 33(4), 367-384. https://doi.org/10.1093/applin/ in Second Language Acquisition, 37(4), 551–577. https://doi. ams019 org/10.1017/S0272263115000116

[25] . Heldner, M., & Edlund, J. (2010). Pauses, gaps and [39]. Kim, J.-S., & Lee, H. (2018). Analyzing pause frequency, overlaps in conversations. Journal of Phonetics, 38(4), 555-568. repair frequency, and syllable duration in fluent and disfluent https://doi.org/10.1016/j.wocn.2010.08.002 speech. Journal of Phonetics, 71, 1-16. https://doi.org/10.1016/

[26] . Healey, P. G. T., Purver, M., Howes, C., & McCabe, R. j.wocn.2018.02.002 (2014). Divergence in dialogue. PLOS ONE, 9(6), e98598. [40]. Kang, O., & Johnson, M. D. (2018). The impact https://doi.org/10.1371/journal.pone.0098598 of pause frequency on raters’ judgments of L2 oral

[27] . Kormos, J., & Dénes, M. (2004). Examining the fluency. Language Testing, 35(3), 359–380. https://doi. complexity of second language speech production: The role org/10.1177/0265532217704031 of the fluency construct. Applied Linguistics, 25(3), 333-354. [41]. Kang, O., & Johnson, K. E. (2018). The role of articulation https://doi.org/10.1093/applin/25.3.333 rate in second language speech fluency assessment. In T. Isaacs

[28] . Kormos, J., & Dénes, M. (2004). Exploring measures and & P. Trofimovich (Eds.), Second language pronunciation perceptions of fluency in second language speech. Language assessment: Interdisciplinary perspectives (pp. 85–100). Learning, 54(2), 427-463. https://doi.org/10.1111/j.0023- Multilingual Matters. https://doi.org/10.21832/9781783099440- 8333.2004.00267.x 007

[29] . Kormos, J., & Tavakoli, P. (2010). The role of fluency in [42]. Ladd, D. R. (2008). Intonational phonology. Cambridge second language learning. Language Learning, 60(4), 712–745. University Press. https://doi.org/10.1017/CBO9780511808814 https://doi.org/10.1111/j.1467-9922.2010.00565.x [43]. Levelt, W. J. M. (1983). Monitoring and self-repair in

[30] . Kormos, J. (2014). Speech production and the role of speech. Cognition, 14(1), 41-104. https://doi.org/10.1016/0010- language proficiency in the fluency of L2 learners. Studies 0277(83)90026-4 in Second Language Acquisition, 36(2), 191-215. https://doi. [44]. Louwerse, M.M., Dale, R., Bard, E.G., & Jeuniaux, P. org/10.1017/S0272263113000451 (2012). Behavior matching in multimodal communication is

[31] . Kormos, J., & Csizér, K. (2014). The role of task synchronized. Cognitive science, 36 8, 1404-26. https://doi. complexity in second language fluency. Applied Linguistics, org/10.1111/j.1551-6709.2012.01269.x 35(1), 1-22. https://doi.org/10.1093/applin/amt023 [45]. Levinson, S. C., & Torreira, F. (2015). Timing in turn-

[32] . Kormos, J., & Trebits, A. (2020). Measuring fluency: The taking and its implications for processing models of language. interaction of speech rate, pauses, and repairs. Language Testing, Frontiers in Psychology, 6, 731. https://doi.org/10.3389/ 37(2), 145-168. https://doi.org/10.1177/0265532220904902. fpsyg.2015.00731

[33] . Kahng, J. (2014). The impact of proficiency level on pause [46]. Levinson, S. C., & Torreira, F. (2015). Timing in turncharacteristics in second language speech. Language Testing, taking and its implications for the study of conversation. 31(1), 5-27. https://doi.org/10.1177/0265532213515032 Psychological Science, 26(9), 1358-1366. https://doi.

[34] . Kahng, J. (2018). The effect of pause location on perceived org/10.1177/0956797615595874 fluency. Applied Psycholinguistics, 39(3), 569–591. https://doi. [47]. Liu, X., & Wang, Y. (2021). Pause duration and its role org/10.1017/S0142716417000534 in the processing of disfluent speech in second language

[35] . Kahng, J. (2020). The role of pausing in second speakers. Language and Cognitive Processes, 36(5), 673– Dean&Francis Shiqing Peng 687. https://doi.org/10.1080/01690965.2021.1919346 4192.2010.00244.x

[48] . Miller, M. A., et al. (2022). Cognitive demands and speech [62]. Segalowitz, N., & Freed, B. F. (2020). Examining production: The role of prolongations in language processing. the role of pauses and speech rate in the development of Journal of Experimental Psychology: Learning, Memory, and L2 fluency. Journal of Second Language Studies, 5(2), 55- Cognition, 48(4), 658-675. https://doi.org/ 10.1037/xlm0001121 79. https://doi.org/10.1017/S027226312000052X

[49] . Norrick, N. R. (2018). False starts and repairs in [63]. Suzuki, S., & Kormos, J. (2020). The effect of articulation conversational fluency. Discourse Studies, 20(5), 635- rate on perceived fluency in second language speech. Applied 654. https://doi.org/10.1177/1461445618791112 Linguistics, 41(3), 487–509. https://doi.org/10.1093/applin/

[50] . O’Connell, D. C., & Kowal, S. (2017). The effect of amz002 sentence position on pause duration. Discourse Processes, 54(3), [64]. Suzuki, S., & Kormos, J. (2021). Examining the role of 211-227. https://doi.org/10.1080/0163853X.2016.1267169 pause frequency in L2 speech processing and perception. System,

[51] . Pickering, M. J., & Garrod, S. (2004). Toward a 96, 102416. https://doi.org/10.1016/j.system.2020.102416 mechanistic psychology of dialogue. Behavioral and [65]. Saito, K., Trofimovich, P., & Isaacs, T. (2017). Second Brain Sciences, 27(2), 169–190. https://doi.org/10.1017/ language speech production research: Methodological S0140525X04000056 innovations and new insights. Language Learning, 67(Suppl. 1),

[52] . Pickering, M. J., & Garrod, S. (2013). An integrated theory 1–9. Wiley. https://doi.org/10.1111/lang.12223 of language production and comprehension. Psychological [66]. Saito, K., & Lyster, R. (2018). Processing speed and its Review, 120(2), 243-283. https://doi.org/10.1037/a0031091 relationship with listening comprehension in second language

[53] . Pickering, M. J., Garrod, S., & Kelleher, J. (2021). learners. Studies in Second Language Acquisition, 40(4), 653- Semantic alignment in dialogue: The role of semantic similarity 674. https://doi.org/10.1017/S0272263118000157 and synonymy. Cognitive Science, 45(3), e12950. https://doi. [67]. Saito, K. (2019). The role of pronunciation in second org/10.1111/cogs.12950 language fluency: An exploratory study. Studies in Second

[54] . Peltonen, P., & Lintunen, P. (2016). Fluency in L2 Language Acquisition, 41(3), 543-570. https://doi.org/10.1017/ English: The effects of pause frequency and length on perceived S0272263118000340 proficiency. Applied Linguistics, 37(5), 781–804. https://doi. [68]. Saito, K., Trofimovich, P., & Isaacs, T. (2019). Second org/10.1093/applin/amu072 language speech production: Investigating linguistic correlates

[55] . Rossiter, M. J., Derwing, T. M., & Munro, M. J. (2010). of comprehensibility and accentedness for learners at different Assessing the fluency of second language speech: A review of ability levels. Applied Psycholinguistics, 40(6), 1461-1487. the literature. Language Teaching Research, 14(3), 393-419. https://doi.org/10.1017/S0142716419000202 https://doi.org/10.1177/1362168809360406 [69]. Saito, K., & Kachlicka, M. (2021). Measuring syntactic

[56] . Rapanta, C., & Felton, M. K. (2022). Learning to argue adaptation in second language learners: The role of proficiency through dialogue. Learning and Instruction, 79, 101-120. https:// and context. Language Learning, 71(4), 1127-1158. https://doi. doi.org/10.1007/s10648-021-09637-2 org/10.1111/lang.12462

[57] . Skehan, P. (2009). Modelling second language [70]. Stivers, T., Enfield, N. J., & Levinson, S. C. (2009). performance: Integrating complexity, accuracy, fluency, Universals and cultural variation in turn-taking in conversation. and lexis. Applied Linguistics, 30(4), 510–532. https://doi. Proceedings of the National Academy of Sciences, 106(26), org/10.1093/applin/amp047 10587-10592. https://doi.org/10.1073/pnas.0903616106

[58] . Skehan, P., & Foster, P. (2016). The role of complexity, [71]. Schmidt, R. (2012). Chapter 2. Attention, awareness, and accuracy, and fluency in L2 task performance. Language Testing, individual differences in language learning. In W. Chan, K. 33(3), 309-329. https://doi.org/ 10.1177/0265532216659953 Chin, S. Bhatt & I. Walker (Ed.), Perspectives on Individual

[59] . Skehan, P., & Foster, P. (2019). Task complexity, repetition, Characteristics and Foreign Language Education (pp. and L2 performance. Studies in Second Language Acquisition, 27-50). Berlin, Boston: De Gruyter Mouton. https://doi. 41(1), 228-256. https://doi.org/10.1017/S0272263118000310 org/10.1515/9781614510932.27

[60] . Segalowitz, N. (2010). Cognitive bases of second [72]. Tavakoli, P., & Foster, P. (2020). The interaction language fluency (pp. 10–15). Routledge. https://doi. of complexity, accuracy, and fluency in second language org/10.4324/9780203851357 production: A study of task effects. International Review of

[61] . Segalowitz, N. (2010). Cognitive fluency and its role Applied Linguistics in Language Teaching, 58(1), 1-22. https:// in language processing. International Journal of Applied doi.org/10.1515/iral-2019-0101 Linguistics, 20(2), 191-208. https://doi.org/10.1111/j.1473- [73]. Tavakoli, P., & Wright, C. (2020). Second language Dean&Francis ISSN 2959-6122 speech fluency: Investigating pauses, speed, and repair. Studies [80]. Wang, Y., & Xu, S. (2020). Response time as a measure in Second Language Acquisition, 42(2), 377–403. https://doi. of listening fluency in L2 learners. Journal of Second org/10.1017/S0272263119000572 Language Studies, 10(2), 128-145. https://doi.org/10.1017/

[74] . Tavakoli, P., & Wright, D. (2020). Task-Based S0022100318000296 Language Teaching and Fluency in Second Language [81]. Wang, H., & Xu, Y. (2021). The role of processing speed Acquisition. Cambridge University Press. https://doi. in second language listening. Language Learning, 71(4), 987– org/10.1017/9781108677042 1005. https://doi.org/10.1111/lang.12470

[75] . Tavakoli, P., & Wright, C. (2020). Investigating the [82]. Zheng, Y., & Wagner, L. (2020). The threshold effect of relationship between pause frequency and perceived fluency in speech rate on fluency and error production in second language second language speech. Language Testing, 37(3), 329–349. speech. Applied Linguistics, 41(5), 756-778. https://doi. https://doi.org/10.1177/0265532219885072 org/10.1093/applin/amah006

[76] . Tavakoli, P., & Wright, C. (2021). Examining the [83]. Zuniga, Michael, and Daphnée Simard (2019). Factors relationship between speech fluency and proficiency: The influencing L2 self-repair behavior: The role of L2 proficiency, role of pauses. Language Testing, 38(4), 453-471. https://doi. attentional control, and L1 self-repair behavior. Journal org/10.1177/02655322211001615 of Psycholinguistic Research, 48(1), 43–65. https://doi.

[77] . Taguchi, N., & Roever, C. (2017). Second language org/10.1007/s10936-018-9581-2. pragmatics: From theory to research. Applied Linguistics Review, [84]. Zhan, Y., & Zhou, X. (2019). The effects of pause duration 8(1), 1–35. https://doi.org/10.1515/applirev-2017-1001 on speech perception in second language learners. Applied

[78] . Towell, R., & Hawkins, R. (2018). The impact of syntactic Linguistics, 40(4), 575–589. https://doi.org/10.1093/applin/ complexity on fluency and comprehension. Applied Linguistics, amw045 39(1), 45-69. https://doi.org/10.1093/applin/amx032 [85]. Zhang, Y., & Li, Z. (2020). Influence of pause position on

[79] . Wang, X., & Liu, M. (2016). The effect of pause position fluency and cognitive load in second language speech. Language on speech perception and fluency in native and non-native Learning and Technology, 24(2), 87–105. https://doi. speakers. Journal of Speech and Hearing Research, 59(5), 894– org/10.1016/j.ltl.2020.04.003 907. https://doi.org/10.1044/2016_JSHR-S-16-0022

Downloads

Published

2024-12-31

Issue

Vol. 2 No. 6 (2024): Volume 2, Issue 6

Section

Articles

License

Copyright (c) 2024 by the authors.

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.