Research Article
BibTex RIS Cite

Delphi Tekniği Kullanılarak Kritik ve Öncelikli Öğrenme Analitiği Göstergelerinin Belirlenmesi

Year 2021, Volume: 41 Issue: 2, 697 - 728, 26.08.2021
https://doi.org/10.17152/gefad.876541

Abstract

Öğrenme analitikleri eğitim ortamlarının ve paydaşlarının objektif ölçümlerle anlaşılabilmesine imkân sağlaması, bu ortamlarda yaşanan sorunlara çözüm sunması ve bu ortamların daha verimli hale getirilmesine yönelik yeni yaklaşımlar sunması nedeniyle üzerine dikkatleri çeken bir konu haline gelmiştir. Öğrenme analitiği göstergeleri ise, henüz öğrenme problemleri ile ilişkilendirilmemiş, ancak e-öğrenme ortamlarında kullanılabilecek türde analitiklerdir. Bir bakıma öğrenme analitiği adaylarıdır. Bu çalışmanın amacı gelişim aşamasında görülen öğrenme analitiklerinin temellerine değinmenin yanı sıra, araştırmacı ve uygulamacılara e-öğrenme ortamlarında kullanabilecekleri öğrenme analitiği göstergelerine ilişkin bir liste sunmaktır. Çalışmada, alanyazın taramasından elde edilen göstergelerin yanı sıra Delphi tekniği kullanılarak uzmanların fikir birliğine vardıkları göstergelere de ulaşılmıştır. Çalışma için geliştirilen çevrimiçi platform aracılığıyla yürütülen Delphi panelleri yaklaşık 1 yıl sürmüş, 22 uzman ile başlayan süreç 11 uzman ile 4 tur sonunda tamamlanmıştır. Çalışmada demografik, betimsel ve algoritmik üst başlıklarında toplam 41 maddeden oluşan öğrenme analitiği göstergesine ulaşılmıştır. Bu listenin gerek öğrenme analitiklerini kullanarak öğrenme ortamlarında nesnel kararlar almaya çalışan uygulayıcılara gerekse de öğrenme analitiği ile ilgili konularda çalışmayı düşünen araştırmacılara katkı sağlayacağı düşünülmektedir.

Supporting Institution

TÜBİTAK

Project Number

117R050

References

  • Adejo, O. & Connolly, T. (2017). Learning analytics in a shared-network educational environment: Ethical issues and countermeasures. Learning, 8(4).
  • Agudo-Peregrina, Á. F., Iglesias-Pradas, S., Conde-González, M. Á. & Hernández-García, Á. (2014). Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning. Computers in human behavior, 31, 542-550.
  • Avella, J. T., Kebritchi, M., Nunn, S. G. & Kanai, T. (2016). Learning analytics methods, benefits, and challenges in higher education: A systematic literature review. Online Learning, 20(2), 13-29.
  • Aydın, C. H. (1999). Eğitim İletişimi Alanında Delfi Tekniğinin Uygulanışı. Kurgu Anadolu Üniversitesi İletişim Bilimleri Fakültesi Uluslararası Hakemli İletişim Dergisi, 16(16), 225-241.
  • Banihashem, S. K., Aliabadi, K., Ardakani, S. P., Delaver, A. & Ahmadabadi, M. N. (2018). Learning analytics: A critical literature review. Interdisciplinary Journal of Virtual Learning in Medical Sciences, 9(2).
  • Belton, I., MacDonald, A., Wright, G. & Hamlin, I. (2019). Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process. Technological Forecasting and Social Change, 147, 72-82.
  • Brown, M., McCormack, M., Reeves, J., Brook, D. C., Grajek, S., Alexander, B., ... & Gannon, K. (2020). 2020 Educause Horizon Report Teaching and Learning Edition (pp. 2-58). EDUCAUSE.
  • Campbell, J. P. & DeBlois, P. B. (2007). Oblinger, and DG Academic Analytics: A New Tool for a New Era. Educause Review, 42(4), 1-10.
  • Chatti, M. A., Dyckhoff, A. L., Schroeder, U. & Thüs, H. (2012). A reference model for learning analytics. International Journal of Technology Enhanced Learning, 4(5-6), 318-331.
  • Christie, C. A. & Barela, E. (2005). The Delphi technique as a method for increasing inclusion in the evaluation process. The Canadian Journal of Program Evaluation, 20(1), 105.
  • Dalkey, N. & Helmer, O. (1963). An experimental application of the Delphi method to the use of experts. Management science, 9(3), 458-467.
  • Day, J. & Bobeva, M. (2005). A generic toolkit for the successful management of Delphi studies. The Electronic Journal of Business Research Methodology, 3(2), 103-116.
  • Delbecq, A. L., Van de Ven, A. H. & Gustafson, D. H. (1975). Group techniques for program planning: A guide to nominal group and Delphi processes. Scott, Foresman.
  • Dyckhoff, A. L., Lukarov, V., Muslim, A., Chatti, M. A. & Schroeder, U. (2013, April). Supporting action research with learning analytics. In Proceedings of the Third International Conference on Learning Analytics and Knowledge (pp. 220-229).
  • Erffmeyer, R. C., Erffmeyer, E. S. & Lane, I. M. (1986). The Delphi technique: An empirical evaluation of the optimal number of rounds. Group & organization studies, 11(1-2), 120-128.
  • Ferguson, R. (2012). Learning analytics: drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5-6), 304-317.
  • Fiaidhi, J. (2014). The next step for learning analytics. IT Professional, 16(5), 4-8.
  • Fish, L. S. & Busby, D. M. (1996). The Delphi Method. Research methods in family therapy, 469-482.
  • Giannarou, L. & Zervas, E. (2014). Using Delphi technique to build consensus in practice. International Journal of Business Science & Applied Management (IJBSAM), 9(2), 65-82.
  • Hsu, C.-C. & Sandford, B. A. (2007). The Delphi technique: making sense of consensus. Practical assessment, research & evaluation, 12(10), 1-8.
  • Hung, H.-L., Altschuld, J. W. & Lee, Y.-F. (2008). Methodological and conceptual issues confronting a cross-country Delphi study of educational program evaluation. Evaluation and Program Planning, 31(2), 191-198.
  • Khalil, M. & Ebner, M. (2015). Learning Analytics: Principles and Constraints. In Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2015. pp. 1326-1336. Chesapeake, VA: AACE.
  • Koçdar, S. & Aydın, H. (2013). Açık ve Uzaktan Öğrenme Araştırmalarında Delfi Tekniğinin Kullanımı. Anadolu University Journal of Social Sciences, 13(3), 31-45.
  • LAK (2011). Proceedings of the 1st International Conference on Learning Analytics and Knowledge. Association for Computing Machinery, New York, NY, USA.
  • Landeta, J. (2006). Current validity of the Delphi method in social sciences. Technological forecasting and social change, 73(5), 467-482.
  • Leitner, P., Khalil, M. & Ebner, M. (2017). Learning analytics in higher education—a literature review. In Learning analytics: Fundaments, applications, and trends (pp. 1-23). Springer, Cham.
  • Linstone, H. A. & Turoff, M. (1975). The delphi method. Reading, MA: Addison-Wesley.
  • Linstone, H. A. & Turoff, M. (2002). The Delphi Method. Techniques and applications, 53.
  • Mitchell, V. W. (1991). The Delphi technique: An exposition and application. Technology Analysis & Strategic Management, 3(4), 333-358.
  • Mullen, P. M. (2003). Delphi: myths and reality. Journal of health organization and management, 17(1), 37-52.
  • Nworie, J. (2011). Using the Delphi technique in educational technology research. TechTrends, 55(5), 24.
  • Okoli, C. & Pawlowski, S. D. (2004). The Delphi method as a research tool: an example, design considerations and applications. Information & management, 42(1), 15-29.
  • Parrish, A. H. & Sadera, W. A. (2020). Teaching Competencies for Student-Centered, One-to-One Learning Environments: A Delphi Study. Journal of Educational Computing Research, 57(8), 1910-1934.
  • Powell, C. (2003). The Delphi technique: myths and realities. Journal of advanced nursing, 41(4), 376-382.
  • Şahin, A. E. (2001). Eğitim araştırmalarında delphi tekniği ve kullanımı. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 20(20), 215-220.
  • Scheffel, M., Drachsler, H., Stoyanov, S. & Specht, M. (2014). Quality indicators for learning analytics. Journal of Educational Technology & Society, 17(4), 117-132.
  • Siemens, G. & Baker, R. S. D. (2012, Nisan). Learning analytics and educational data mining: towards communication and collaboration. In Proceedings of the 2nd international conference on learning analytics and knowledge (pp. 252-254).
  • Siemens, G. & Gasevic, D. (2012). Guest editorial-learning and knowledge analytics. Journal of Educational Technology & Society, 15(3), 1-2.
  • Siemens, G. & Long, P. (2011). Penetrating the fog: Analytics in learning and education. EDUCAUSE review, 46(5), 30.
  • Skulmoski, G. J., Hartman, F. T. & Krahn, J. (2007). The Delphi method for graduate research. Journal of information technology education, 6, 1.
Year 2021, Volume: 41 Issue: 2, 697 - 728, 26.08.2021
https://doi.org/10.17152/gefad.876541

Abstract

Project Number

117R050

References

  • Adejo, O. & Connolly, T. (2017). Learning analytics in a shared-network educational environment: Ethical issues and countermeasures. Learning, 8(4).
  • Agudo-Peregrina, Á. F., Iglesias-Pradas, S., Conde-González, M. Á. & Hernández-García, Á. (2014). Can we predict success from log data in VLEs? Classification of interactions for learning analytics and their relation with performance in VLE-supported F2F and online learning. Computers in human behavior, 31, 542-550.
  • Avella, J. T., Kebritchi, M., Nunn, S. G. & Kanai, T. (2016). Learning analytics methods, benefits, and challenges in higher education: A systematic literature review. Online Learning, 20(2), 13-29.
  • Aydın, C. H. (1999). Eğitim İletişimi Alanında Delfi Tekniğinin Uygulanışı. Kurgu Anadolu Üniversitesi İletişim Bilimleri Fakültesi Uluslararası Hakemli İletişim Dergisi, 16(16), 225-241.
  • Banihashem, S. K., Aliabadi, K., Ardakani, S. P., Delaver, A. & Ahmadabadi, M. N. (2018). Learning analytics: A critical literature review. Interdisciplinary Journal of Virtual Learning in Medical Sciences, 9(2).
  • Belton, I., MacDonald, A., Wright, G. & Hamlin, I. (2019). Improving the practical application of the Delphi method in group-based judgment: A six-step prescription for a well-founded and defensible process. Technological Forecasting and Social Change, 147, 72-82.
  • Brown, M., McCormack, M., Reeves, J., Brook, D. C., Grajek, S., Alexander, B., ... & Gannon, K. (2020). 2020 Educause Horizon Report Teaching and Learning Edition (pp. 2-58). EDUCAUSE.
  • Campbell, J. P. & DeBlois, P. B. (2007). Oblinger, and DG Academic Analytics: A New Tool for a New Era. Educause Review, 42(4), 1-10.
  • Chatti, M. A., Dyckhoff, A. L., Schroeder, U. & Thüs, H. (2012). A reference model for learning analytics. International Journal of Technology Enhanced Learning, 4(5-6), 318-331.
  • Christie, C. A. & Barela, E. (2005). The Delphi technique as a method for increasing inclusion in the evaluation process. The Canadian Journal of Program Evaluation, 20(1), 105.
  • Dalkey, N. & Helmer, O. (1963). An experimental application of the Delphi method to the use of experts. Management science, 9(3), 458-467.
  • Day, J. & Bobeva, M. (2005). A generic toolkit for the successful management of Delphi studies. The Electronic Journal of Business Research Methodology, 3(2), 103-116.
  • Delbecq, A. L., Van de Ven, A. H. & Gustafson, D. H. (1975). Group techniques for program planning: A guide to nominal group and Delphi processes. Scott, Foresman.
  • Dyckhoff, A. L., Lukarov, V., Muslim, A., Chatti, M. A. & Schroeder, U. (2013, April). Supporting action research with learning analytics. In Proceedings of the Third International Conference on Learning Analytics and Knowledge (pp. 220-229).
  • Erffmeyer, R. C., Erffmeyer, E. S. & Lane, I. M. (1986). The Delphi technique: An empirical evaluation of the optimal number of rounds. Group & organization studies, 11(1-2), 120-128.
  • Ferguson, R. (2012). Learning analytics: drivers, developments and challenges. International Journal of Technology Enhanced Learning, 4(5-6), 304-317.
  • Fiaidhi, J. (2014). The next step for learning analytics. IT Professional, 16(5), 4-8.
  • Fish, L. S. & Busby, D. M. (1996). The Delphi Method. Research methods in family therapy, 469-482.
  • Giannarou, L. & Zervas, E. (2014). Using Delphi technique to build consensus in practice. International Journal of Business Science & Applied Management (IJBSAM), 9(2), 65-82.
  • Hsu, C.-C. & Sandford, B. A. (2007). The Delphi technique: making sense of consensus. Practical assessment, research & evaluation, 12(10), 1-8.
  • Hung, H.-L., Altschuld, J. W. & Lee, Y.-F. (2008). Methodological and conceptual issues confronting a cross-country Delphi study of educational program evaluation. Evaluation and Program Planning, 31(2), 191-198.
  • Khalil, M. & Ebner, M. (2015). Learning Analytics: Principles and Constraints. In Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2015. pp. 1326-1336. Chesapeake, VA: AACE.
  • Koçdar, S. & Aydın, H. (2013). Açık ve Uzaktan Öğrenme Araştırmalarında Delfi Tekniğinin Kullanımı. Anadolu University Journal of Social Sciences, 13(3), 31-45.
  • LAK (2011). Proceedings of the 1st International Conference on Learning Analytics and Knowledge. Association for Computing Machinery, New York, NY, USA.
  • Landeta, J. (2006). Current validity of the Delphi method in social sciences. Technological forecasting and social change, 73(5), 467-482.
  • Leitner, P., Khalil, M. & Ebner, M. (2017). Learning analytics in higher education—a literature review. In Learning analytics: Fundaments, applications, and trends (pp. 1-23). Springer, Cham.
  • Linstone, H. A. & Turoff, M. (1975). The delphi method. Reading, MA: Addison-Wesley.
  • Linstone, H. A. & Turoff, M. (2002). The Delphi Method. Techniques and applications, 53.
  • Mitchell, V. W. (1991). The Delphi technique: An exposition and application. Technology Analysis & Strategic Management, 3(4), 333-358.
  • Mullen, P. M. (2003). Delphi: myths and reality. Journal of health organization and management, 17(1), 37-52.
  • Nworie, J. (2011). Using the Delphi technique in educational technology research. TechTrends, 55(5), 24.
  • Okoli, C. & Pawlowski, S. D. (2004). The Delphi method as a research tool: an example, design considerations and applications. Information & management, 42(1), 15-29.
  • Parrish, A. H. & Sadera, W. A. (2020). Teaching Competencies for Student-Centered, One-to-One Learning Environments: A Delphi Study. Journal of Educational Computing Research, 57(8), 1910-1934.
  • Powell, C. (2003). The Delphi technique: myths and realities. Journal of advanced nursing, 41(4), 376-382.
  • Şahin, A. E. (2001). Eğitim araştırmalarında delphi tekniği ve kullanımı. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 20(20), 215-220.
  • Scheffel, M., Drachsler, H., Stoyanov, S. & Specht, M. (2014). Quality indicators for learning analytics. Journal of Educational Technology & Society, 17(4), 117-132.
  • Siemens, G. & Baker, R. S. D. (2012, Nisan). Learning analytics and educational data mining: towards communication and collaboration. In Proceedings of the 2nd international conference on learning analytics and knowledge (pp. 252-254).
  • Siemens, G. & Gasevic, D. (2012). Guest editorial-learning and knowledge analytics. Journal of Educational Technology & Society, 15(3), 1-2.
  • Siemens, G. & Long, P. (2011). Penetrating the fog: Analytics in learning and education. EDUCAUSE review, 46(5), 30.
  • Skulmoski, G. J., Hartman, F. T. & Krahn, J. (2007). The Delphi method for graduate research. Journal of information technology education, 6, 1.
There are 40 citations in total.

Details

Primary Language Turkish
Journal Section Articles
Authors

Bilal Atasoy 0000-0001-6894-0646

Tolga Güyer 0000-0001-9175-5043

Mertcan Ünal 0000-0001-6779-6902

Akça Okan Yüksel 0000-0002-5430-0821

Şeyhmus Aydoğdu 0000-0002-9075-8055

Project Number 117R050
Publication Date August 26, 2021
Published in Issue Year 2021 Volume: 41 Issue: 2

Cite

APA Atasoy, B., Güyer, T., Ünal, M., Yüksel, A. O., et al. (2021). Delphi Tekniği Kullanılarak Kritik ve Öncelikli Öğrenme Analitiği Göstergelerinin Belirlenmesi. Gazi Üniversitesi Gazi Eğitim Fakültesi Dergisi, 41(2), 697-728. https://doi.org/10.17152/gefad.876541
AMA Atasoy B, Güyer T, Ünal M, Yüksel AO, Aydoğdu Ş. Delphi Tekniği Kullanılarak Kritik ve Öncelikli Öğrenme Analitiği Göstergelerinin Belirlenmesi. GEFAD. August 2021;41(2):697-728. doi:10.17152/gefad.876541
Chicago Atasoy, Bilal, Tolga Güyer, Mertcan Ünal, Akça Okan Yüksel, and Şeyhmus Aydoğdu. “Delphi Tekniği Kullanılarak Kritik Ve Öncelikli Öğrenme Analitiği Göstergelerinin Belirlenmesi”. Gazi Üniversitesi Gazi Eğitim Fakültesi Dergisi 41, no. 2 (August 2021): 697-728. https://doi.org/10.17152/gefad.876541.
EndNote Atasoy B, Güyer T, Ünal M, Yüksel AO, Aydoğdu Ş (August 1, 2021) Delphi Tekniği Kullanılarak Kritik ve Öncelikli Öğrenme Analitiği Göstergelerinin Belirlenmesi. Gazi Üniversitesi Gazi Eğitim Fakültesi Dergisi 41 2 697–728.
IEEE B. Atasoy, T. Güyer, M. Ünal, A. O. Yüksel, and Ş. Aydoğdu, “Delphi Tekniği Kullanılarak Kritik ve Öncelikli Öğrenme Analitiği Göstergelerinin Belirlenmesi”, GEFAD, vol. 41, no. 2, pp. 697–728, 2021, doi: 10.17152/gefad.876541.
ISNAD Atasoy, Bilal et al. “Delphi Tekniği Kullanılarak Kritik Ve Öncelikli Öğrenme Analitiği Göstergelerinin Belirlenmesi”. Gazi Üniversitesi Gazi Eğitim Fakültesi Dergisi 41/2 (August 2021), 697-728. https://doi.org/10.17152/gefad.876541.
JAMA Atasoy B, Güyer T, Ünal M, Yüksel AO, Aydoğdu Ş. Delphi Tekniği Kullanılarak Kritik ve Öncelikli Öğrenme Analitiği Göstergelerinin Belirlenmesi. GEFAD. 2021;41:697–728.
MLA Atasoy, Bilal et al. “Delphi Tekniği Kullanılarak Kritik Ve Öncelikli Öğrenme Analitiği Göstergelerinin Belirlenmesi”. Gazi Üniversitesi Gazi Eğitim Fakültesi Dergisi, vol. 41, no. 2, 2021, pp. 697-28, doi:10.17152/gefad.876541.
Vancouver Atasoy B, Güyer T, Ünal M, Yüksel AO, Aydoğdu Ş. Delphi Tekniği Kullanılarak Kritik ve Öncelikli Öğrenme Analitiği Göstergelerinin Belirlenmesi. GEFAD. 2021;41(2):697-728.