Abstract
Günümüzde, bir ürünün fiyatı farklı e-ticaret perakendecileri arasında önemli ölçüde değişmektedir. Bu çalışma, Jsoup ile, modern web veri toplama tekniklerini kullanarak kullanıcı dostu bir fiyat karşılaştırma web sitesi geliştirmeyi amaçlamaktadır. Önerilen platform, tanınmış perakendecilerden veri toplamakta, ürün bilgilerini çıkarmak için verileri analiz etmekte ve gerektiğinde gerçek zamanlı olarak tüketicilere sunmaktadır. Ayrıca, kullanıcılara ürün fiyatlarını belirlemede yardımcı olmak için, platform trend verilerini, ekonomik seçenekleri, birim başına en iyi değeri sunan ürünleri ve yüksek puan alan ürünleri sergilemektedir. Platform, çeşitli ürün özelliklerini titizlikle analiz ederek, SVD algoritması yardımıyla anlamlı kalıpları ve korelasyonları tanımlar. Kullanıcılar hem en uygun fiyatlı ürünü hem de diğer kullanıcıların yorumlarına göre önerilen seçeneği bulabilir. Öte yandan, kullanıcılar bir ürünü pazarın sunduğundan daha yüksek bir fiyata satın almanın duygusal sıkıntısından kaçınabilirler. Sonuç olarak, kullanıcılar platform tarafından sağlanan kapsamlı analizden faydalanarak daha bilinçli satın alma kararları verme yetkisine sahip olurlar. Çalışmanın performansı, farklı perakendecilerden alınan gerçek veriler kullanılarak test edilmiştir. Sonuçlar, sistemimizin endüstriyel çözümlere ve ilgili literatüre kıyasla kabul edilebilir bir doğruluk oranına ulaştığını göstermektedir.
Project Number
1919B012218690
References
- [1] “Akakçe.” [Online]. https://www.akakce.com. [Accessed Dec. 23, 2023].
- [2] “Cimri.” [Online]. https://www.cimri.com. [Accessed Dec. 23, 2023].
- [3] “Trivago.” [Online]. https://www.trivago.com.tr. [Accessed Dec. 23, 2023].
- [4] P. Nagaraj, V. Muneeswaran, A. V. S. R. Pavan Naidu, N. Shanmukh, P. V. Kumar, and G. S. Satyanarayana, “Automated E-Commerce Price Comparison Website using PHP, XAMPP, MongoDB, Django, and Web Scrapping,” in 2023 Int. Conf. Comput. Commun. Informatics, ICCCI 2023, no. Iccci, pp. 1–6, 2023, doi: 10.1109/ICCCI56745.2023.10128573.
- [5] R. Shah, K. Pathan, A. Masurkar, S. Rewatkar, and N. Vengurlekar, “Comparison of E-commerce Products using web mining,” in Int. J. Sci. Res. Publ., vol. 6, no. 5, p. 640, 2016, [Online]. Available: https://www.ijsrp.org/research-paper-0516.php?rp=P535430.
- [6] A. Asawa, S. Dabre, S. Rahise, M. Bansode, K. T. Talele, and P. Chimurkar, “Co-Mart - A Daily Necessity Price Comparison Application,” in Proc. - Int. Conf. Appl. Artif. Intell. Comput. ICAAIC 2022, no. Icaaic, pp. 1076–1080, 2022, doi: 10.1109/ICAAIC53929.2022.9792935.
- [7] A. Alam, A. A. Anjum, F. S. Tasin, M. R. Reyad, S. A. Sinthee, and N. Hossain, “Upoma: A Dynamic Online Price Comparison Tool for Bangladeshi E-commerce Websites,” in 2020 IEEE Reg. 10 Symp. TENSYMP 2020, no. June, pp. 194–197, 2020, doi: 10.1109/TENSYMP50017.2020.9230862.
- [8] V. R. Prasetyo, “Searching Cheapest Product on Three Different E-Commerce Using K-Means Algorithm,” in Proceeding - 2018 Int. Semin. Intell. Technol. Its Appl. ISITIA 2018, pp. 239–244, 2018, doi: 10.1109/ISITIA.2018.8711043.
- [9] J. Wang, S. Yang, Y. Wang, and C. Han, “The crawling and analysis of agricultural products big data based on Jsoup,” in 2015 12th Int. Conf. Fuzzy Syst. Knowl. Discov. FSKD 2015, pp. 1197–1202, 2016, doi: 10.1109/FSKD.2015.7382112.
- [10] K. Harikirshnan., R. Nagavigneshwar., R. Vignesh., R. Santhosh, and R. Reshma, “Intelligent Online Shopping using ML-based Product Comparison Engine,” in 2023 International Conference on Inventive Computation Technologies (ICICT), Apr. 2023, no. Icict, pp. 174–179, doi: 10.1109/ICICT57646.2023.10134401.
- [11] L. R. Julian and F. Natalia, “The use of web scraping in computer parts and assembly price comparison,” in 2015 3rd International Conference on New Media (CONMEDIA), Nov. 2015, pp. 1–6, doi: 10.1109/CONMEDIA.2015.7449152.
- [12] S. Brunton and J. Nathan Kutz, “Singular Value Decomposition (SVD),” in Data-Driven Science and Engineering, no. Dmd, Cambridge University Press, 2019, pp. 3–46.
- [13] J. Han, M. Kamber, and J. Pei, “Getting to Know Your Data,” in Data Min., pp. 39–82, Jan. 2012, doi: 10.1016/B978-0-12-381479-1.00002-2.
- [14] A. R. Lahitani, A. E. Permanasari, and N. A. Setiawan, “Cosine similarity to determine similarity measure: Study case in online essay assessment,” in Proc. 2016 4th Int. Conf. Cyber IT Serv. Manag. CITSM 2016, Sep. 2016, doi: 10.1109/CITSM.2016.7577578.
Abstract
Nowadays, the price of a product varies dramatically across different e-commerce retailers. This study aims to develop a user-friendly price comparison website using Jsoup, state-of-the-art web scraping techniques. The proposed platform gathers data from well-known retailers, analyzes the data to extract product information, and presents it to consumers in real time when needed. Furthermore, to assist users in determining product prices, the platform showcases trending data, economical choices, products that offer the best value per unit, and highly rated items. By meticulously analyzing various product attributes, the platform identifies meaningful patterns and correlations by using SVD algorithm. Users can find both the most affordable product and the recommended option based on other users' reviews. On the other hand, users can avoid the emotional distress of purchasing a product at a higher price than what the marketplace offers. As a result, users are empowered to make more informed purchasing decisions, benefiting from the comprehensive analysis conducted by the platform. The performance of the work was tested using real data grabbed from different marketplaces. The results show our system achieved an acceptable accuracy rate compared to the industrial solutions and relevant literature.
Ethical Statement
This paper improves Emre Özakyıldız and Fatma Birel B.Sc. thesis research at Karabuk University in 2023, supervised by Dr. Oğuzhan Menemencioğlu.
Supporting Institution
TÜBİTAK
Project Number
1919B012218690
Thanks
Fatma Birel’s work was separately supported by the Scientific and Technological Research Council of Turkey (TÜBİTAK) under TÜBİTAK 2209-A Science Fellowships and Grant Programmes and the Project ID is: 1919B012218690.
References
- [1] “Akakçe.” [Online]. https://www.akakce.com. [Accessed Dec. 23, 2023].
- [2] “Cimri.” [Online]. https://www.cimri.com. [Accessed Dec. 23, 2023].
- [3] “Trivago.” [Online]. https://www.trivago.com.tr. [Accessed Dec. 23, 2023].
- [4] P. Nagaraj, V. Muneeswaran, A. V. S. R. Pavan Naidu, N. Shanmukh, P. V. Kumar, and G. S. Satyanarayana, “Automated E-Commerce Price Comparison Website using PHP, XAMPP, MongoDB, Django, and Web Scrapping,” in 2023 Int. Conf. Comput. Commun. Informatics, ICCCI 2023, no. Iccci, pp. 1–6, 2023, doi: 10.1109/ICCCI56745.2023.10128573.
- [5] R. Shah, K. Pathan, A. Masurkar, S. Rewatkar, and N. Vengurlekar, “Comparison of E-commerce Products using web mining,” in Int. J. Sci. Res. Publ., vol. 6, no. 5, p. 640, 2016, [Online]. Available: https://www.ijsrp.org/research-paper-0516.php?rp=P535430.
- [6] A. Asawa, S. Dabre, S. Rahise, M. Bansode, K. T. Talele, and P. Chimurkar, “Co-Mart - A Daily Necessity Price Comparison Application,” in Proc. - Int. Conf. Appl. Artif. Intell. Comput. ICAAIC 2022, no. Icaaic, pp. 1076–1080, 2022, doi: 10.1109/ICAAIC53929.2022.9792935.
- [7] A. Alam, A. A. Anjum, F. S. Tasin, M. R. Reyad, S. A. Sinthee, and N. Hossain, “Upoma: A Dynamic Online Price Comparison Tool for Bangladeshi E-commerce Websites,” in 2020 IEEE Reg. 10 Symp. TENSYMP 2020, no. June, pp. 194–197, 2020, doi: 10.1109/TENSYMP50017.2020.9230862.
- [8] V. R. Prasetyo, “Searching Cheapest Product on Three Different E-Commerce Using K-Means Algorithm,” in Proceeding - 2018 Int. Semin. Intell. Technol. Its Appl. ISITIA 2018, pp. 239–244, 2018, doi: 10.1109/ISITIA.2018.8711043.
- [9] J. Wang, S. Yang, Y. Wang, and C. Han, “The crawling and analysis of agricultural products big data based on Jsoup,” in 2015 12th Int. Conf. Fuzzy Syst. Knowl. Discov. FSKD 2015, pp. 1197–1202, 2016, doi: 10.1109/FSKD.2015.7382112.
- [10] K. Harikirshnan., R. Nagavigneshwar., R. Vignesh., R. Santhosh, and R. Reshma, “Intelligent Online Shopping using ML-based Product Comparison Engine,” in 2023 International Conference on Inventive Computation Technologies (ICICT), Apr. 2023, no. Icict, pp. 174–179, doi: 10.1109/ICICT57646.2023.10134401.
- [11] L. R. Julian and F. Natalia, “The use of web scraping in computer parts and assembly price comparison,” in 2015 3rd International Conference on New Media (CONMEDIA), Nov. 2015, pp. 1–6, doi: 10.1109/CONMEDIA.2015.7449152.
- [12] S. Brunton and J. Nathan Kutz, “Singular Value Decomposition (SVD),” in Data-Driven Science and Engineering, no. Dmd, Cambridge University Press, 2019, pp. 3–46.
- [13] J. Han, M. Kamber, and J. Pei, “Getting to Know Your Data,” in Data Min., pp. 39–82, Jan. 2012, doi: 10.1016/B978-0-12-381479-1.00002-2.
- [14] A. R. Lahitani, A. E. Permanasari, and N. A. Setiawan, “Cosine similarity to determine similarity measure: Study case in online essay assessment,” in Proc. 2016 4th Int. Conf. Cyber IT Serv. Manag. CITSM 2016, Sep. 2016, doi: 10.1109/CITSM.2016.7577578.
Details
| Primary Language | English |
|---|---|
| Subjects | Computer Software, Software Engineering (Other) |
| Journal Section | Conference Paper |
| Authors | |
| Project Number | 1919B012218690 |
| Early Pub Date | March 29, 2024 |
| Publication Date | April 30, 2024 |
| Submission Date | November 20, 2023 |
| Acceptance Date | December 27, 2023 |
| Published in Issue | Year 2024 Volume: 10 Issue: 1 |
Gazi Journal of Engineering Sciences (GJES) publishes open access articles under a Creative Commons Attribution 4.0 International License (CC BY). 