Refusal DCT with content-validity evidence for English-L1 BIPA learners

Authors

  • Raden Yusuf Sidiq Budiawan Doctoral Program in Humanities, Universitas Gadjah Mada Yogyakarta
  • I Dewa Putu Wijana Doctoral Program in Humanities, Universitas Gadjah Mada Yogyakarta
  • Wira Kurniawati Doctoral Program in Humanities, Universitas Gadjah Mada Yogyakarta
Abstract views: 18 PDF downloads: 3

Keywords:

Discourse Completion Tasks, content validity, refusal speech acts, BIPA, interlanguage pragmatics

Abstract

Discourse Completion Tasks (DCTs) are widely used to study refusals, but adaptations of Beebe et al.’s framework are seldom accompanied by transparent validation in the studies we mapped, and we found no documented DCT for English-L1 learners of Indonesian (BIPA). An exploratory mapping of 92 refusal studies found that most adapted Beebe et al.’s framework while only a small minority reported explicit content validation. This study developed a 12-situation refusal DCT, built from four eliciting acts and three levels of relative power, and gathered preliminary evidence of its content appropriateness, field usability, and translation equivalence through readability trials, expert review, field piloting, and blind back-translation. Two experts rated 48 situation-aspect rating units, giving S-CVI/Ave = 0.98 and S-CVI/UA = 0.96, yet two units received the lowest score possible with two raters (I-CVI = 0.50). Piloting with B1 learners flagged one wording problem, and back-translation found six discrepancies, five of them in situations that had earned full expert agreement. All eight revised situations later received full scores. The study contributes a documented, layered procedure for adapting a DCT, with CVI reported for rating units, and an instrument for BIPA pragmatics research. The evidence is preliminary and limited to a two-expert panel and B1 learners.

Downloads

Download data is not yet available.

Author Biography

I Dewa Putu Wijana, Doctoral Program in Humanities, Universitas Gadjah Mada Yogyakarta

³ Postgraduate Program in Linguistics, Faculty of Cultural Science, Universitas Gadjah Mada Yogyakarta, Indonesia

References

Alajmi, N. M. (2024). Analysing refusal strategies in Kuwaiti Arabic and British English: Cross-cultural pragmatics. English Language Teaching, 17(9), 107-122. https://doi.org/10.5539/elt.v17n9p107

Al-Gahtani, S., & Roever, C. (2018). Proficiency and preference organization in second language refusals. Journal of Pragmatics, 129, 140-153. https://doi.org/10.1016/j.pragma.2018.01.014

Alrefaee, Y. M. H. A., & Aljabr, F. (2025). Evolution and trends in interlanguage pragmatics research: A bibliometric analysis (1973–2024). Cogent Arts and Humanities, 12(1). https://doi.org/10.1080/23311983.2025.2567505

Al-Sallal, R. E. (2024). Pragmatic analysis of refusal strategies in spoken English of Bahraini and Indian L2 learners. Cogent Arts & Humanities, 11(1), Article 2321682. https://doi.org/10.1080/23311983.2024.2321682

Asteria, P. V., Rofiuddin, A., Suyitno, I., & Susanto, G. (2023). Indonesian-based pluricultural competence in BIPA teachers' perspective. Eurasian Journal of Applied Linguistics, 9(1), 190-201. https://doi.org/10.32601/ejal.901016

Beebe, L. M., Takahashi, T., & Uliss-Weltz, R. (1990). Pragmatic transfer in ESL refusals. In R. C. Scarcella, E. S. Andersen, & S. D. Krashen (Eds.), Developing communicative competence in a second language (pp. 55-73). Newbury House.

Billmyer, K., & Varghese, M. (2000). Investigating instrument-based pragmatic variability: Effects of enhancing discourse completion tests. Applied Linguistics, 21(4), 517-552. https://doi.org/10.1093/applin/21.4.517

Blum-Kulka, S. (1982). Learning to say what you mean in a second language: A study of the speech act performance of learners of Hebrew as a second language. Applied Linguistics, 3(1), 29-59. https://doi.org/10.1093/applin/III.1.29

Boeriswati, E., Ningsih, R. Y., & Rahayu, W. (2023). Web-based design of BIPA placement test instrument for foreign speakers. International Journal of Learning, Teaching and Educational Research, 22(2), 392-412. https://doi.org/10.26803/ijlter.22.2.22

Brislin, R. W. (1970). Back-translation for cross-cultural research. Journal of Cross-Cultural Psychology, 1(3), 185-216. https://doi.org/10.1177/135910457000100301

Brown, P., & Levinson, S. C. (1987). Politeness: Some universals in language usage. Cambridge University Press.

Dwiana, N. R., Basthomi, Y., Anugerahwati, M., & Syahri, I. (2021). "I'm afraid I can't": Initiating acts on refusal strategy realization. Indonesian Journal of English Language Teaching and Applied Linguistics, 5(2), 297-308. https://doi.org/10.21093/ijeltal.v5i2.716

El Hammouchi, A. (2025). Saying 'no' politely: The use of refusal strategies by Moroccan EFL university learners. Studies in Pragmatics and Discourse Analysis, 6(2), 17-30. https://doi.org/10.48185/spda.v6i2.1732

Eviliana, N. (2019). Pragmatic transfer in refusals realized by proficient EFL learners English Education Program Sriwijaya University. Mabasan, 9(1), 43-54. https://doi.org/10.62107/mab.v9i1.155

García, I. P. (2024). Refusals in Japanese and Spanish: Pragmatic transfer in L2. Acta Linguistica Asiatica, 14(2), 93-119. https://doi.org/10.4312/ala.14.2.93-119

Golato, A. (2003). Studying compliment responses: A comparison of DCTs and recordings of naturally occurring talk. Applied Linguistics, 24(1), 90-121. https://doi.org/10.1093/applin/24.1.90

Gustini, M. (2018). Contrastive analysis of refusal expressions in Japanese and Bahasa at work place. JAPANEDU: Jurnal Pendidikan dan Pengajaran Bahasa Jepang, 3(2), 132-139. https://doi.org/10.17509/japanedu.v3i2.13501

Hosseinpur, R. M., Lowni, A., & Lowni, M. (2022). Does interlanguage pragmatic measure enhancement change the data pattern? A mixed method approach. Issues in Language Teaching, 11(2), 1-32. https://doi.org/10.22054/ilt.2022.68389.704

Kasper, G. (2000). Data collection in pragmatics research. In H. Spencer-Oatey (Ed.), Culturally Speaking Second Edition: Culture, Communication and Politeness Theory (pp. 316-369). Continuum International Publishing Group. https://doi.org/10.5040/9781350934085.ch-014

Kasper, G., & Dahl, M. (1991). Research methods in interlanguage pragmatics. Studies in Second Language Acquisition, 13(2), 215-247. https://doi.org/10.1017/S0272263100009955

Kholiq, A., Yulianto, B., & Suhartono. (2024). Role of L1 and L2 in the acquisition of Bahasa Indonesia as a third language. Issues in Language Studies, 13(1), 413-431. https://doi.org/10.33736/ils.5567.2024

Kurniawati, W. (2026). "Permisi, Bu!" Acquisition of Indonesian politeness for BIPA learners. Tabasa: Jurnal Bahasa, Sastra Indonesia, Dan Pengajarannya, 7(01), 319-336. https://doi.org/10.22515/tabasa.v7i01.14493

Kurniawati, W., & Ginting, S. R. (2026). Requesting with an appropriate degree: The request speech act competence of BIPA learners. Bahastra, 46(1), 196-207. https://doi.org/10.26555/bs.v46i1.1982

Labben, A. (2016). Reconsidering the development of the discourse completion test in interlanguage pragmatics. Pragmatics, 26(1), 69-91. https://doi.org/10.1075/prag.26.1.04lab

Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382-385. https://doi.org/10.1097/00006199-198611000-00017

Mahriyuni, M., Pramuniati, I., & Sitinjak, D. R. (2024). Interlanguage development among the learners of Indonesian language in Paris. Indonesian Journal of Applied Linguistics, 14(1), 206-219. https://doi.org/10.17509/ijal.v14i1.70394

Marniati, M., & Jaafar, M. F. (2022). The realisation of the refusal speech act in Tanjung Tanah dialect of Kerinci. Jurnal Arbitrer, 9(2), 94-106. https://doi.org/10.25077/ar.9.2.94-106.2022

Mokoginta, K., & Arafah, B. (2022). Negotiation in Indonesian culture: A cultural linguistic analysis of Bahasa Indonesia textbooks. Theory and Practice in Language Studies, 12(4), 691-701. https://doi.org/10.17507/tpls.1204.09

Morkus, N. (2021). Negative pragmatic transfer and language proficiency: American learners of Arabic. The Language Learning Journal, 49(1), 41-65. https://doi.org/10.1080/09571736.2018.1474247

Muliastuti, L., Mayuni, I., Nurhaina, A., & Saddhono, K. (2023). Tailoring CEFR to BISOL (Bahasa Indonesia for Speakers of Other Languages): A model for integrative language teaching materials. International Journal of Language Education, 7(4), 590-601. https://doi.org/10.26858/ijole.v7i4.53219

Pasaribu, A. N., Sinambela, E., Pasaribu, T. K., Sihite, J. E., & Sembiring, R. A. (2021). The strategies of refusing requests by students of different ethnic groups. Syntax Literate ; Jurnal Ilmiah Indonesia, 6(1), 67-73. https://doi.org/10.36418/syntax-literate.v6i1.2178

Polit, D. F., & Beck, C. T. (2006). The content validity index: Are you sure you know what's being reported? Critique and recommendations. Research in Nursing and Health, 29(5), 489-497. https://doi.org/10.1002/nur.20147

Primantari, A. N., & Wijana, I. D. P. (2017). Tindak tutur meminta oleh pembelajar BIPA dari Korea: Kajian pragmatik bahasa antara (interlanguage pragmatics). Jurnal Penelitian Humaniora, 18(1), 27-40. https://doi.org/10.23917/humaniora.v18i1.3638

Romero Jeldres, M., Díaz Costa, E., & Faouzi Nadim, T. (2023). A review of Lawshe's method for calculating content validity in the social sciences. Frontiers in Education, 8, Article 1271335. https://doi.org/10.3389/feduc.2023.1271335

Rusdi, R. P., Purwanti, I. T., & Dahnilsyah, D. (2022). Refusal strategies used by EFL learners of English Study Program in Riau, Indonesia. IDEAS: Journal of Language Teaching and Learning, Linguistics and Literature, 10(1), 175-186. https://doi.org/10.24256/ideas.v10i1.2581

Siddiqa, A., & Whyte, S. (2025). Classroom learning of English L2 requests: Input and interactional opportunities in French secondary schools. Language Teaching Research, 29(2), 535-559. https://doi.org/10.1177/13621688211064932

Susanto, G., Pickus, D., Espree-Conaway, D., Suparmi, Rusiandi, A., & Noviya, H. (2024). Indonesian language policy and perspectives on its implementation in promoting Bahasa Indonesia as an international language. Cogent Arts & Humanities, 11(1), Article 2364511. https://doi.org/10.1080/23311983.2024.2364511

Syafruddin, Pratiwi, B., Izzati, A. N., & Sianipar, I. F. (2025). Teaching Indonesian for foreign speakers (BIPA): A bibliometric analysis. Issues in Language Studies, 14(1), 55-73. https://doi.org/10.33736/ils.7551.2025

Vásári, N. (2022). Pragmatic transfer in the refusal strategy choices of Hungarian EFL students. Alkalmazott Nyelvtudomány, 22(1), 208-222. https://doi.org/10.18460/ANY.2022.1.013

Widanta, I. M. R. J., Hudiananingsih, P. D., Sitawati, A. A. R., & Ardika, I. W. D. (2019). Pragmatic errors and transfer of foreign learners of Indonesian: The case of refusals. Journal of Language Teaching and Research, 10(3), 501-508. https://doi.org/10.17507/jltr.1003.13

Widianto, E., & Pusse, T.-K. (2025). Cultura franca: Investigating cultural gradations of Indonesian as a foreign language textbook. Asian-Pacific Journal of Second and Foreign Language Education, 10(1), Article 30. https://doi.org/10.1186/s40862-025-00335-y

Downloads

Published

2026-11-15

How to Cite

Budiawan, R. Y. S., Wijana, I. D. P., & Kurniawati, W. (2026). Refusal DCT with content-validity evidence for English-L1 BIPA learners. GHANCARAN: Jurnal Pendidikan Bahasa Dan Sastra Indonesia, 20(2), 817–834. Retrieved from https://ejournal.uinmadura.ac.id/index.php/ghancaran/article/view/26078

Issue

Section

Articles