Refusal DCT with content-validity evidence for English-L1 BIPA learners
Abstract views: 18
PDF downloads: 3
Keywords:
Discourse Completion Tasks, content validity, refusal speech acts, BIPA, interlanguage pragmaticsAbstract
Discourse Completion Tasks (DCTs) are widely used to study refusals, but adaptations of Beebe et al.’s framework are seldom accompanied by transparent validation in the studies we mapped, and we found no documented DCT for English-L1 learners of Indonesian (BIPA). An exploratory mapping of 92 refusal studies found that most adapted Beebe et al.’s framework while only a small minority reported explicit content validation. This study developed a 12-situation refusal DCT, built from four eliciting acts and three levels of relative power, and gathered preliminary evidence of its content appropriateness, field usability, and translation equivalence through readability trials, expert review, field piloting, and blind back-translation. Two experts rated 48 situation-aspect rating units, giving S-CVI/Ave = 0.98 and S-CVI/UA = 0.96, yet two units received the lowest score possible with two raters (I-CVI = 0.50). Piloting with B1 learners flagged one wording problem, and back-translation found six discrepancies, five of them in situations that had earned full expert agreement. All eight revised situations later received full scores. The study contributes a documented, layered procedure for adapting a DCT, with CVI reported for rating units, and an instrument for BIPA pragmatics research. The evidence is preliminary and limited to a two-expert panel and B1 learners.
Downloads
References
Alajmi, N. M. (2024). Analysing refusal strategies in Kuwaiti Arabic and British English: Cross-cultural pragmatics. English Language Teaching, 17(9), 107-122. https://doi.org/10.5539/elt.v17n9p107
Al-Gahtani, S., & Roever, C. (2018). Proficiency and preference organization in second language refusals. Journal of Pragmatics, 129, 140-153. https://doi.org/10.1016/j.pragma.2018.01.014
Alrefaee, Y. M. H. A., & Aljabr, F. (2025). Evolution and trends in interlanguage pragmatics research: A bibliometric analysis (1973–2024). Cogent Arts and Humanities, 12(1). https://doi.org/10.1080/23311983.2025.2567505
Al-Sallal, R. E. (2024). Pragmatic analysis of refusal strategies in spoken English of Bahraini and Indian L2 learners. Cogent Arts & Humanities, 11(1), Article 2321682. https://doi.org/10.1080/23311983.2024.2321682
Asteria, P. V., Rofiuddin, A., Suyitno, I., & Susanto, G. (2023). Indonesian-based pluricultural competence in BIPA teachers' perspective. Eurasian Journal of Applied Linguistics, 9(1), 190-201. https://doi.org/10.32601/ejal.901016
Beebe, L. M., Takahashi, T., & Uliss-Weltz, R. (1990). Pragmatic transfer in ESL refusals. In R. C. Scarcella, E. S. Andersen, & S. D. Krashen (Eds.), Developing communicative competence in a second language (pp. 55-73). Newbury House.
Billmyer, K., & Varghese, M. (2000). Investigating instrument-based pragmatic variability: Effects of enhancing discourse completion tests. Applied Linguistics, 21(4), 517-552. https://doi.org/10.1093/applin/21.4.517
Blum-Kulka, S. (1982). Learning to say what you mean in a second language: A study of the speech act performance of learners of Hebrew as a second language. Applied Linguistics, 3(1), 29-59. https://doi.org/10.1093/applin/III.1.29
Boeriswati, E., Ningsih, R. Y., & Rahayu, W. (2023). Web-based design of BIPA placement test instrument for foreign speakers. International Journal of Learning, Teaching and Educational Research, 22(2), 392-412. https://doi.org/10.26803/ijlter.22.2.22
Brislin, R. W. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1(3), 185-216. https://doi.org/10.1177/135910457000100301
Brown, P., & Levinson, S. C. (1987). Politeness: Some universals in language usage. Cambridge University Press.
Dwiana, N. R., Basthomi, Y., Anugerahwati, M., & Syahri, I. (2021). "I'm afraid I can't": Initiating acts on refusal strategy realization. Indonesian Journal of English Language Teaching and Applied Linguistics, 5(2), 297-308. https://doi.org/10.21093/ijeltal.v5i2.716
El Hammouchi, A. (2025). Saying 'no' politely: The use of refusal strategies by Moroccan EFL university learners. Studies in Pragmatics and Discourse Analysis, 6(2), 17-30. https://doi.org/10.48185/spda.v6i2.1732
Eviliana, N. (2019). Pragmatic transfer in refusals realized by proficient EFL learners English Education Program Sriwijaya University. Mabasan, 9(1), 43-54. https://doi.org/10.62107/mab.v9i1.155
García, I. P. (2024). Refusals in Japanese and Spanish: Pragmatic transfer in L2. Acta Linguistica Asiatica, 14(2), 93-119. https://doi.org/10.4312/ala.14.2.93-119
Golato, A. (2003). Studying compliment responses: A comparison of DCTs and recordings of naturally occurring talk. Applied Linguistics, 24(1), 90-121. https://doi.org/10.1093/applin/24.1.90
Gustini, M. (2018). Contrastive analysis of refusal expressions in Japanese and Bahasa at work place. JAPANEDU: Jurnal Pendidikan dan Pengajaran Bahasa Jepang, 3(2), 132-139. https://doi.org/10.17509/japanedu.v3i2.13501
Hosseinpur, R. M., Lowni, A., & Lowni, M. (2022). Does interlanguage pragmatic measure enhancement change the data pattern? A mixed method approach. Issues in Language Teaching, 11(2), 1-32. https://doi.org/10.22054/ilt.2022.68389.704
Kasper, G. (2000). Data collection in pragmatics research. In H. Spencer-Oatey (Ed.), Culturally Speaking Second Edition: Culture, Communication and Politeness Theory (pp. 316-369). Continuum International Publishing Group. https://doi.org/10.5040/9781350934085.ch-014
Kasper, G., & Dahl, M. (1991). Research methods in interlanguage pragmatics. Studies in Second Language Acquisition, 13(2), 215-247. https://doi.org/10.1017/S0272263100009955
Kholiq, A., Yulianto, B., & Suhartono. (2024). Role of L1 and L2 in the acquisition of Bahasa Indonesia as a third language. Issues in Language Studies, 13(1), 413-431. https://doi.org/10.33736/ils.5567.2024
Kurniawati, W. (2026). "Permisi, Bu!" Acquisition of Indonesian politeness for BIPA learners. Tabasa: Jurnal Bahasa, Sastra Indonesia, Dan Pengajarannya, 7(01), 319-336. https://doi.org/10.22515/tabasa.v7i01.14493
Kurniawati, W., & Ginting, S. R. (2026). Requesting with an appropriate degree: The request speech act competence of BIPA learners. Bahastra, 46(1), 196-207. https://doi.org/10.26555/bs.v46i1.1982
Labben, A. (2016). Reconsidering the development of the discourse completion test in interlanguage pragmatics. Pragmatics, 26(1), 69-91. https://doi.org/10.1075/prag.26.1.04lab
Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382-385. https://doi.org/10.1097/00006199-198611000-00017
Mahriyuni, M., Pramuniati, I., & Sitinjak, D. R. (2024). Interlanguage development among the learners of Indonesian language in Paris. Indonesian Journal of Applied Linguistics, 14(1), 206-219. https://doi.org/10.17509/ijal.v14i1.70394
Marniati, M., & Jaafar, M. F. (2022). The realisation of the refusal speech act in Tanjung Tanah dialect of Kerinci. Jurnal Arbitrer, 9(2), 94-106. https://doi.org/10.25077/ar.9.2.94-106.2022
Mokoginta, K., & Arafah, B. (2022). Negotiation in Indonesian culture: A cultural linguistic analysis of Bahasa Indonesia textbooks. Theory and Practice in Language Studies, 12(4), 691-701. https://doi.org/10.17507/tpls.1204.09
Morkus, N. (2021). Negative pragmatic transfer and language proficiency: American learners of Arabic. The Language Learning Journal, 49(1), 41-65. https://doi.org/10.1080/09571736.2018.1474247
Muliastuti, L., Mayuni, I., Nurhaina, A., & Saddhono, K. (2023). Tailoring CEFR to BISOL (Bahasa Indonesia for Speakers of Other Languages): A model for integrative language teaching materials. International Journal of Language Education, 7(4), 590-601. https://doi.org/10.26858/ijole.v7i4.53219
Pasaribu, A. N., Sinambela, E., Pasaribu, T. K., Sihite, J. E., & Sembiring, R. A. (2021). The strategies of refusing requests by students of different ethnic groups. Syntax Literate ; Jurnal Ilmiah Indonesia, 6(1), 67-73. https://doi.org/10.36418/syntax-literate.v6i1.2178
Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what's being reported? Critique and recommendations. Research in Nursing and Health, 29(5), 489-497. https://doi.org/10.1002/nur.20147
Primantari, A. N., & Wijana, I. D. P. (2017). Tindak tutur meminta oleh pembelajar BIPA dari Korea: Kajian pragmatik bahasa antara (interlanguage pragmatics). Jurnal Penelitian Humaniora, 18(1), 27-40. https://doi.org/10.23917/humaniora.v18i1.3638
Romero Jeldres, M., Díaz Costa, E., & Faouzi Nadim, T. (2023). A review of Lawshe's method for calculating content validity in the social sciences. Frontiers in Education, 8, Article 1271335. https://doi.org/10.3389/feduc.2023.1271335
Rusdi, R. P., Purwanti, I. T., & Dahnilsyah, D. (2022). Refusal strategies used by EFL learners of English Study Program in Riau, Indonesia. IDEAS: Journal of Language Teaching and Learning, Linguistics and Literature, 10(1), 175-186. https://doi.org/10.24256/ideas.v10i1.2581
Siddiqa, A., & Whyte, S. (2025). Classroom learning of English L2 requests: Input and interactional opportunities in French secondary schools. Language Teaching Research, 29(2), 535-559. https://doi.org/10.1177/13621688211064932
Susanto, G., Pickus, D., Espree-Conaway, D., Suparmi, Rusiandi, A., & Noviya, H. (2024). Indonesian language policy and perspectives on its implementation in promoting Bahasa Indonesia as an international language. Cogent Arts & Humanities, 11(1), Article 2364511. https://doi.org/10.1080/23311983.2024.2364511
Syafruddin, Pratiwi, B., Izzati, A. N., & Sianipar, I. F. (2025). Teaching Indonesian for foreign speakers (BIPA): A bibliometric analysis. Issues in Language Studies, 14(1), 55-73. https://doi.org/10.33736/ils.7551.2025
Vásári, N. (2022). Pragmatic transfer in the refusal strategy choices of Hungarian EFL students. Alkalmazott Nyelvtudomány, 22(1), 208-222. https://doi.org/10.18460/ANY.2022.1.013
Widanta, I. M. R. J., Hudiananingsih, P. D., Sitawati, A. A. R., & Ardika, I. W. D. (2019). Pragmatic errors and transfer of foreign learners of Indonesian: The case of refusals. Journal of Language Teaching and Research, 10(3), 501-508. https://doi.org/10.17507/jltr.1003.13
Widianto, E., & Pusse, T.-K. (2025). Cultura franca: Investigating cultural gradations of Indonesian as a foreign language textbook. Asian-Pacific Journal of Second and Foreign Language Education, 10(1), Article 30. https://doi.org/10.1186/s40862-025-00335-y
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Raden Yusuf Sidiq Budiawan, I Dewa Putu Wijana, Wira Kurniawati

This work is licensed under a Creative Commons Attribution 4.0 International License.
Ghancaran: Jurnal Pendidikan Bahasa dan Sastra Indonesia uses an Open Access Policy under the Creative Commons Attribution-ShareAlike 4.0 International License. Authors publishing in this journal agree to the following terms:
- Ghancaran Journal holds the copyright and grants the journal rights for first publication with the work simultaneously licensed under a
The work is distributed under Creative Commons Attribution-ShareAlike 4.0 International License which allows others to share, copy, and redistribute the material in any media or format and adapt, remix, change, and develop the material even for commercial purposes, as long as it is stated credit and license derivative works under similar terms. - Authors may make additional contractual arrangements for non-exclusive distribution of the journal's published work version.
- Authors are permitted to post their work online (e.g., in institutional repositories or on their websites) before and during submission, as doing so may lead to productive exchange.












