Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations

Juliet Njeri Muasya; Peter Kyalo Mulwa

doi:doi:10.11648/j.her.20230804.11

| Peer-Reviewed

Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations

Juliet Njeri Muasya, Peter Kyalo Mulwa

Published in Higher Education Research (Volume 8, Issue 4)

Received: 12 June 2023 Accepted: 28 June 2023 Published: 6 July 2023

Views: Downloads:

Download PDF

Share This Article

Twitter
Linked In
Facebook

Abstract

Conducting a pilot study is an important step in both qualitative and quantitative research process. Pilot study enable researchers to evaluate research methods and in particular research instruments with the aim of enhancing reliability and validity of data to be collected from the main study. Pilot study help researchers to detect flaws which lead to adequate and appropriate adjustments of the research instruments. Findings presented in this paper are drawn from an in-depth analysis using a documentary guide of randomly selected PhD thesis and dissertations from one public university in Kenya. The aim of this desk study was to examine ways in which PhD students/graduates use findings from pilot studies and in particular for purposes of improving the validity and reliability of research instruments. The study revealed that PhD students/graduates ignore pilot studies or give it minimal attention. Out of the seven students/graduates only 2 discussed pilot study in a stand-alone section, while others integrated it in the sub-sections of reliability and validity. Although two of the students/graduates mentioned the purpose of pilot study, they however, were not specific on the research instruments being piloted. Four of the students/graduates did not report how they analyzed data from the pilot study, while two indicated that they analyzed data but details on how it was done are missing. This study concludes that PhD students/graduates neglect or give general information about pilot studies in their thesis and dissertations. The students/graduates do not show how data analyzed from the pilot studies was used to revise, review or improve the research methodology and in particular research instruments. Findings from this study confirms that pilot study is a ‘neglected part of the research process’. The study recommends that researchers especially post graduate students should be sensitized on the importance of taking pilot studies seriously. In addition, supervisors should provide effective and adequate guidance to their PhD and Masters students on how to conduct, and appropriately use findings from the pilot study.

Published in	Higher Education Research (Volume 8, Issue 4)
DOI	10.11648/j.her.20230804.11
Page(s)	115-123
Creative Commons	This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.
Copyright	Copyright © The Author(s), 2023. Published by Science Publishing Group

Keywords

Pilot Study, Pre-Test, Qualitative, Quantative Research, PhD Dissertations, Thesis

References

[1]	Kim, Y. (2010). The Pilot Study in Qualitative Inquiry, Identifying Issues and Learning Lessons for Culturally Competent Research. Qualitative Social Work, 40 (2), 190-206.
[2]	Van Teijlingen, E. and Hundley, V. (2002). The Importance of Pilot Studies. Nursing Standard, 16 (40), 33–36 https://doi.org/10.7748/ns2002.06.16.40.33.c3214
[3]	Gumbo, M. T. (2014). An Action Research Pilot Study on the Integration of Indigenous Technology in Technology Education, Mediterranean Journal of Social Sciences. 5 (10), 386-392, https://www.scirp.org/(S(lz5mqp453edsnp55rrgjct55))/reference/ReferencesPapers.aspx?ReferenceID=1776515. (Accessed on 17th October, 2022).
[4]	Dikko, M. (2016). Establishing Construct Validity and Reliability: Pilot Testing of a Qualitative Interview for Research in Takaful (Islamic Insurance). Qualitative Report, 21 (3), 521–528.
[5]	Majid, M. A. A. Othman, M. Mohamad, S. F. Lim, S. A. H. Yusof, A. (2017). Piloting for Interviews in Qualitative Research: Operationalization and Lessons Learnt. International Journal of Academic Research in Business and Social Sciences, 7 (4), 2222-6990. https://www.researchgate.net/publication/317696788_Piloting_for_Interviews_in_QualitativeResearch_Operationalization_and_Lessons_Learnt [Accessed September 28 2022]
[6]	Ismail, N. Kinchin, G. and Edwards, J. A. (2018). Pilot Study, Does It Really Matter? Learning Lessons from Conducting a Pilot Study for a Qualitative PhD Thesis. International Journal of Social Science Research, 6 (1), 1-17.
[7]	Malmqvist, J. Hellberg, K. Mo ¨lla, G. Rose, R. and Shevlin, M. (2019). Conducting the Pilot Study: A Neglected Part of the Research Process? Methodological Findings Supporting the Importance of Piloting in Qualitative Research Studies, International Journal of Qualitative Methods, 18: 1–11.
[8]	Williams-McBean, C. T. (2019). The Value of a Qualitative Pilot Study in a Multi-Phase Mixed Methods. The Qualitative Report 24 (5), 1055-1064.
[9]	Abd Gani, N. I. Rathakrishnan, M. and Krishnasamy, H. N. (2020). A Pilot Test for establishing Validity and Reliability of Qualitative Interview in the Blended Learning English Proficiency Course. Journal of Critical Reviews, 7 (5), 140-143.
[10]	Mocorro, R. E. (2017). Pilot Study, The First Step in Research. International Journal of Science and Research (IJSR), 6 (12), 864-866.
[11]	Sekaran, U. and Bougie, R. (2003). Research Method for Business: A Skill Building Approach, 5th Edition. United States: John Wiley & Sons Inc.
[12]	Zohrabi, M. (2013). Mixed Method Research: Instruments, Validity, Reliability and Reporting Findings. Theory and Practice in Language Studies.
[13]	Muasya, J. N. (2013). Exploring Discourses of Access and Sexual Harassment in Higher Education: A Study of Students Perceptions of University of Nairobi’s Institutional Culture, Unpublished PhD Dissertation, University of Cape Town.
[14]	Ahuja, R. (2003). Research Methods. New Delhi, India: Prem Rawat for Rawat Publications.
[15]	Rossouw, D. (2003). Intellectual Tools, Skills for the Human Sciences. 2nd Edition, Pretoria, Van Schaik.
[16]	Cohen, L. Manion, L. and Morrison, K. (2000). Research Methods in Education. 5th Edition, London: Routledge Falmer, Great Britain.
[17]	Ulin, P. R, Robinson, E. T, Tolley, E. E. and McNeill, E. T. (2002). Qualitative Methods. A Guide for Applied Research in Sexual and Reproductive Health. North Carolina: Family Health International, USA.
[18]	Sampson, H. (2004). Navigating the Waves: The Usefulness of a Pilot in Qualitative Research. Qualitative Research 4 (3), 383-402.

Cite This Article

Plain Text BibTeX RIS

APA Style

Juliet Njeri Muasya, Peter Kyalo Mulwa. (2023). Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations. Higher Education Research, 8(4), 115-123. https://doi.org/10.11648/j.her.20230804.11

Copy | Download

ACS Style

Juliet Njeri Muasya; Peter Kyalo Mulwa. Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations. High. Educ. Res. 2023, 8(4), 115-123. doi: 10.11648/j.her.20230804.11

Copy | Download

AMA Style

Juliet Njeri Muasya, Peter Kyalo Mulwa. Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations. High Educ Res. 2023;8(4):115-123. doi: 10.11648/j.her.20230804.11

Copy | Download

@article{10.11648/j.her.20230804.11,
  author = {Juliet Njeri Muasya and Peter Kyalo Mulwa},
  title = {Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations},
  journal = {Higher Education Research},
  volume = {8},
  number = {4},
  pages = {115-123},
  doi = {10.11648/j.her.20230804.11},
  url = {https://doi.org/10.11648/j.her.20230804.11},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.her.20230804.11},
  abstract = {Conducting a pilot study is an important step in both qualitative and quantitative research process. Pilot study enable researchers to evaluate research methods and in particular research instruments with the aim of enhancing reliability and validity of data to be collected from the main study. Pilot study help researchers to detect flaws which lead to adequate and appropriate adjustments of the research instruments. Findings presented in this paper are drawn from an in-depth analysis using a documentary guide of randomly selected PhD thesis and dissertations from one public university in Kenya. The aim of this desk study was to examine ways in which PhD students/graduates use findings from pilot studies and in particular for purposes of improving the validity and reliability of research instruments. The study revealed that PhD students/graduates ignore pilot studies or give it minimal attention. Out of the seven students/graduates only 2 discussed pilot study in a stand-alone section, while others integrated it in the sub-sections of reliability and validity. Although two of the students/graduates mentioned the purpose of pilot study, they however, were not specific on the research instruments being piloted. Four of the students/graduates did not report how they analyzed data from the pilot study, while two indicated that they analyzed data but details on how it was done are missing. This study concludes that PhD students/graduates neglect or give general information about pilot studies in their thesis and dissertations. The students/graduates do not show how data analyzed from the pilot studies was used to revise, review or improve the research methodology and in particular research instruments. Findings from this study confirms that pilot study is a ‘neglected part of the research process’. The study recommends that researchers especially post graduate students should be sensitized on the importance of taking pilot studies seriously. In addition, supervisors should provide effective and adequate guidance to their PhD and Masters students on how to conduct, and appropriately use findings from the pilot study.},
 year = {2023}
}

Copy | Download

TY - JOUR
T1 - Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations
AU - Juliet Njeri Muasya
AU - Peter Kyalo Mulwa
Y1 - 2023/07/06
PY - 2023
N1 - https://doi.org/10.11648/j.her.20230804.11
DO - 10.11648/j.her.20230804.11
T2 - Higher Education Research
JF - Higher Education Research
JO - Higher Education Research
SP - 115
EP - 123
PB - Science Publishing Group
SN - 2578-935X
UR - https://doi.org/10.11648/j.her.20230804.11
AB - Conducting a pilot study is an important step in both qualitative and quantitative research process. Pilot study enable researchers to evaluate research methods and in particular research instruments with the aim of enhancing reliability and validity of data to be collected from the main study. Pilot study help researchers to detect flaws which lead to adequate and appropriate adjustments of the research instruments. Findings presented in this paper are drawn from an in-depth analysis using a documentary guide of randomly selected PhD thesis and dissertations from one public university in Kenya. The aim of this desk study was to examine ways in which PhD students/graduates use findings from pilot studies and in particular for purposes of improving the validity and reliability of research instruments. The study revealed that PhD students/graduates ignore pilot studies or give it minimal attention. Out of the seven students/graduates only 2 discussed pilot study in a stand-alone section, while others integrated it in the sub-sections of reliability and validity. Although two of the students/graduates mentioned the purpose of pilot study, they however, were not specific on the research instruments being piloted. Four of the students/graduates did not report how they analyzed data from the pilot study, while two indicated that they analyzed data but details on how it was done are missing. This study concludes that PhD students/graduates neglect or give general information about pilot studies in their thesis and dissertations. The students/graduates do not show how data analyzed from the pilot studies was used to revise, review or improve the research methodology and in particular research instruments. Findings from this study confirms that pilot study is a ‘neglected part of the research process’. The study recommends that researchers especially post graduate students should be sensitized on the importance of taking pilot studies seriously. In addition, supervisors should provide effective and adequate guidance to their PhD and Masters students on how to conduct, and appropriately use findings from the pilot study.
VL - 8
IS - 4
ER -

Copy | Download

Author Information

Juliet Njeri Muasya

Department of Educational Communication, Technology and Pedagogical Studies, Faculty of Education, University of Nairobi, Nairobi, Kenya
Peter Kyalo Mulwa

Department of Educational Communication, Technology and Pedagogical Studies, Faculty of Education, University of Nairobi, Nairobi, Kenya

Download PDF

Sections

Plain Text BibTeX RIS

APA Style

Juliet Njeri Muasya, Peter Kyalo Mulwa. (2023). Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations. Higher Education Research, 8(4), 115-123. https://doi.org/10.11648/j.her.20230804.11

Copy | Download

ACS Style

Juliet Njeri Muasya; Peter Kyalo Mulwa. Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations. High. Educ. Res. 2023, 8(4), 115-123. doi: 10.11648/j.her.20230804.11

Copy | Download

AMA Style

Juliet Njeri Muasya, Peter Kyalo Mulwa. Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations. High Educ Res. 2023;8(4):115-123. doi: 10.11648/j.her.20230804.11

Copy | Download

@article{10.11648/j.her.20230804.11,
  author = {Juliet Njeri Muasya and Peter Kyalo Mulwa},
  title = {Pilot Study, a Neglected Part of Qualitative and Quantitative Research Process: Evidence from Selected PhD Thesis and Dissertations},
  journal = {Higher Education Research},
  volume = {8},
  number = {4},
  pages = {115-123},
  doi = {10.11648/j.her.20230804.11},
  url = {https://doi.org/10.11648/j.her.20230804.11},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.her.20230804.11},
  abstract = {Conducting a pilot study is an important step in both qualitative and quantitative research process. Pilot study enable researchers to evaluate research methods and in particular research instruments with the aim of enhancing reliability and validity of data to be collected from the main study. Pilot study help researchers to detect flaws which lead to adequate and appropriate adjustments of the research instruments. Findings presented in this paper are drawn from an in-depth analysis using a documentary guide of randomly selected PhD thesis and dissertations from one public university in Kenya. The aim of this desk study was to examine ways in which PhD students/graduates use findings from pilot studies and in particular for purposes of improving the validity and reliability of research instruments. The study revealed that PhD students/graduates ignore pilot studies or give it minimal attention. Out of the seven students/graduates only 2 discussed pilot study in a stand-alone section, while others integrated it in the sub-sections of reliability and validity. Although two of the students/graduates mentioned the purpose of pilot study, they however, were not specific on the research instruments being piloted. Four of the students/graduates did not report how they analyzed data from the pilot study, while two indicated that they analyzed data but details on how it was done are missing. This study concludes that PhD students/graduates neglect or give general information about pilot studies in their thesis and dissertations. The students/graduates do not show how data analyzed from the pilot studies was used to revise, review or improve the research methodology and in particular research instruments. Findings from this study confirms that pilot study is a ‘neglected part of the research process’. The study recommends that researchers especially post graduate students should be sensitized on the importance of taking pilot studies seriously. In addition, supervisors should provide effective and adequate guidance to their PhD and Masters students on how to conduct, and appropriately use findings from the pilot study.},
 year = {2023}
}

Copy | Download