Overview of Recent Methodologies for Open Data Quality Assessment
Pub. online: 27 November 2025
Type: Research Article
Open Access
Open Access
Received
1 November 2024
1 November 2024
Accepted
1 November 2025
1 November 2025
Published
27 November 2025
27 November 2025
Abstract
The open data movement has led to the widespread sharing of data across all sectors, offering great potential for innovation and informed decision-making. Nevertheless, open data quality remains a key challenge. This study provides a systematic overview of 16 recent methodologies for data quality assessment, emphasizing their alignment with ISO/IEC 25012 and ISO 8000 standards, FAIR principles, 5-Star Linked Open Data System, and DCAT vocabulary. We also highlight foundational work and identify adaptable methods suitable for the Slovenian open data portal. By recommending practical approaches, this work provides a strategic basis for improving data quality in regional and national platforms, supporting improved data utilization and transparency for end users.
References
Agenzia per L’Italia Digitale (2022). I dati aperti della pubblica amministrazione. https://www.dati.gov.it.
Alogaiel, N.F., Alrwais, O.A. (2023). An assessment of the quality of Open Government Data in Saudi Arabia. IEEE Access, 11, 61560–61599. https://doi.org/10.1109/access.2023.3285611.
Álvarez Sánchez, R., Beristain Iraola, A., Epelde Unanue, G., Carlin, P. (2019). TAQIH, a tool for tabular data quality assessment and improvement in the context of health data. Computer Methods and Programs in Biomedicine, 181, 104824. https://doi.org/10.1016/j.cmpb.2018.12.029.
Berners-Lee, T. (2006). Linked Data – Design Issues. https://www.w3.org/DesignIssues/LinkedData.html.
Berners-Lee, T. (2012). 5-star Open Data. https://5stardata.info/en/.
Bouchelouche, K., Ghomari, A.R., Zemmouchi-Ghomari, L. (2022). Enhanced analysis of Open Government Data: proposed metrics for improving data quality assessment. In: 2022 5th International Symposium on Informatics and Its Applications (ISIA). IEEE, pp. 1–6. https://doi.org/10.1109/isia55826.2022.9993482.
Consorzio per il Sistema Informativo Piemonte (2010). Il portale degli Open Data della Regione Piemonte. https://www.dati.piemonte.it/#/home.
Debattista, J., Auer, S., Lange, C. (2016). Luzzu—a methodology and framework for linked data quality assessment. Journal of Data and Information Quality, 8(1), 1–32. https://doi.org/10.1145/2992786.
Ehrlinger, L., Wöß, W. (2022). A survey of data quality measurement and monitoring tools. Frontiers in Big Data, 5. https://doi.org/10.3389/fdata.2022.850611.
EU (2019). Directive (EU) 2019/1024 of the European Parliament and of the Council of 20 June 2019 on open data and the re-use of public sector information (recast). OJ L 172, 26.6.2019, pp. 56–83. http://data.europa.eu/eli/dir/2019/1024/oj.
European Union (2021). The official portal for European data. https://data.europa.eu.
Fadlallah, H., Kilany, R., Dhayne, H., El Haddad, R., Haque, R., Taher, Y., Jaber, A. (2023). BIGQA: declarative Big Data Quality Assessment. Journal of Data and Information Quality, 15(3), 1–30. https://doi.org/10.1145/3603706.
Ferradji, M.A., Benchikha, F. (2022). Enhanced metrics for temporal dimensions toward assessing Linked Data: a case study of Wikidata. Journal of King Saud University – Computer and Information Sciences, 34(8), 4983–4992. https://doi.org/10.1016/j.jksuci.2021.05.010.
Fragkou, P. (2023). DCAT-AP 3.0. https://semiceu.github.io/DCAT-AP/releases/3.0.0/.
Hafidz, I., Adzanni, G.A., Aini Rakhmawati, N. (2023). Open Data Portal Quality (ODPQ) framework based metric for assessing the quality of open data portals in Indonesian Local Governments. In: 2023 International Conference on Smart-Green Technology in Electrical and Information Systems (ICSGTEIS). IEEE, pp. 127–132. https://doi.org/10.1109/icsgteis60500.2023.10424389.
Hesteren, D., Weyzen, R., Knippenberg, L. (2022). Open data best practices in Europe – Estonia, Slovenia and Ukraine. Publications Office of the European Union. https://doi.org/10.2830/277405.
Huyer, E. (2020). The Economic Impact of Open Data – Opportunities for Value Creation in Europe. Publications Office of the European Union. https://doi.org/doi/10.2830/63132.
Interministerial Digital Directorate (2011). Plateforme ouverte des données publiques françaises. https://www.data.gouv.fr.
Janssen, M., Charalabidis, Y., Zuiderwijk, A. (2012). Benefits, adoption barriers and myths of Open Data and Open Government. Information Systems Management, 29(4), 258–268. https://doi.org/10.1080/10580530.2012.716740.
Kiran, S., Donnellan, B., Helfert, M. (2024). Addressing data quality gaps in open data maturity models: a comparative study and real-world dataset analysis. In: ECIS 2024 Proceedings. https://aisel.aisnet.org/ecis2024/track10_dmds_ecosystems/track10_dmds_ecosystems/11.
Krasikov, P., Legner, C. (2023). A method to screen, assess, and prepare open data for use. Journal of Data and Information Quality, 15(4), 1–25. https://doi.org/10.1145/3603708.
Kubler, S., Robert, J., Neumaier, S., Umbrich, J., Le Traon, Y. (2018). Comparison of metadata quality in open data portals using the Analytic Hierarchy Process. Government Information Quarterly, 35(1), 13–29. https://doi.org/10.1016/j.giq.2017.11.003.
Kusnirakova, D., Ge, M., Walletzky, L., Buhnova, B. (2022). Interoperability-oriented quality assessment for Czech Open Data. In: Proceedings of the 11th International Conference on Data Science, Technology and Applications. SCITEPRESS – Science and Technology Publications, pp. 446–453. https://doi.org/10.5220/0011291900003269.
Lämmel, P., Dittwald, B., Bruns, L., Tcholtchev, N., Glikman, Y., Cuno, S., Flügge, M., Schieferdecker, I. (2020). Metadata harvesting and quality assurance within open urban platforms. Journal of Data and Information Quality, 12(4), 1–20. https://doi.org/10.1145/3409795.
Manyika, J., Chui, M., Farrell, D., Van Kuiken, S., Groves, P., Doshi, E.A. (2013). Open Data: Unlocking Innovation and Performance with Liquid Information. https://www.mckinsey.com/~/media/mckinsey/business%20functions/mckinsey%20digital/our%20insights/open%20data%20unlocking%20innovation%20and%20performance%20with%20liquid%20information/mgi_open_data_fullreport_oct2013.pdf.
Ministrstvo za javno upravo (2016). Odprti podatki Slovenije. https://podatki.gov.si.
Molodtsov, F., Nikiforova, A. (2024). An integrated usability framework for evaluating Open Government Data Portals: comparative analysis of EU and GCC countries. In: Proceedings of the 25th Annual International Conference on Digital Government Research. ACM, pp. 899–908. https://doi.org/10.1145/3657054.3657159.
Moraga, C., Moraga, M., Calero, C., Caro, A. (2009). SQuaRE-aligned Data Quality Model for Web Portals. In: 2009 Ninth International Conference on Quality Software, Vol. 31. IEEE, pp. 117–122. https://doi.org/10.1109/qsic.2009.23.
Neumaier, S., Umbrich, J., Polleres, A. (2016). Automated quality assessment of metadata across Open Data Portals. Journal of Data and Information Quality, 8(1), 1–29. https://doi.org/10.1145/2964909.
Nogueras-Iso, J., Lacasta, J., Urena-Camara, M.A., Ariza-Lopez, F.J. (2021). Quality of metadata in Open Data Portals. IEEE Access, 9, 60364–60382. https://doi.org/10.1109/access.2021.3073455.
Open Knowledge (2012). Global Open Data Index. http://index.okfn.org/.
Open Knowledge (2015). The Open Definition – Version 2.1. https://opendefinition.org/od/2.1/en/.
Page, M., Behrooz, A., Moro, M. (2024). Open Data Maturity Report 2024. Publications Office of the European Union. https://doi.org/doi/10.2830/8656811.
Page, M.J., McKenzie, J.E., Bossuyt, P.M., Boutron, I., Hoffmann, T.C., Mulrow, C.D., Shamseer, L., Tetzlaff, J.M., Akl, E.A., Brennan, S.E., Chou, R., Glanville, J., Grimshaw, J.M., Hróbjartsson, A., Lalu, M.M., Li, T., Loder, E.W., Mayo-Wilson, E., McDonald, S., McGuinness, L.A., Stewart, L.A., Thomas, J., Tricco, A.C., Welch, V.A., Whiting, P., Moher, D. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ, 372. https://doi.org/10.1136/bmj.n71.
Page, M., Hajduk, E., Lincklaen Arriëns, E.N., Cecconi, G., Brinkhuis, S. (2023). Open Data Maturity Report 2023. Publications Office of the European Union. https://doi.org/doi/10.2830/384422.
Pesek, M., Juvan, J., Žnideršič, K., Marolt, M. (2025). Metodologija za kvalitativno vrednotenje odprtih podatkov. In: International Conference on Organizational Science Development: Human Being, Artificial Intelligence and Organization, Conference Proceedings, Vol. 44. Univerzitetna založba Univerze v Mariboru, 729–742. https://press.um.si/index.php/ump/catalog/book/962/chapter/320.
Raca, V., Velinov, G., Cico, B., Kon-Popovska, M. (2021). Measuring the government openness using an assessment tool: case study of six western Balkan countries. In: 2021 10th Mediterranean Conference on Embedded Computing (MECO), Vol. 27. IEEE, pp. 1–5. https://doi.org/10.1109/meco52532.2021.9460163.
Šlibar, B., Mu, E. (2022). OGD metadata country portal publishing guidelines compliance: a multi-case study search for completeness and consistency. Government Information Quarterly, 39(4), 101756. https://doi.org/10.1016/j.giq.2022.101756.
Vetrò, A., Canova, L., Torchiano, M., Minotas, C.O., Iemma, R., Morando, F. (2016). Open data quality measurement framework: definition and application to Open Government Data. Government Information Quarterly, 33(2), 325–337. https://doi.org/10.1016/j.giq.2016.02.001.
Ville de Paris (2023). Paris Data. https://opendata.paris.fr.
Wang, B., Wen, J., Zheng, J. (2020). Research on assessment and comparison of the forestry Open Government Data Quality between China and the United States. In: Data Science, ICDS 2019, Communications in Computer and Information Science, Vol. 1179. Springer Singapore, pp. 370–385. 9789811528101. https://doi.org/10.1007/978-981-15-2810-1_36.
Wentzel, B., Kirstein, F., Jastrow, T., Sturm, R., Peters, M., Schimmler, S. (2023). An Extensive Methodology and Framework for Quality Assessment of DCAT-AP Datasets. Springer Nature Switzerland, pp. 262–278. 9783031411380. https://doi.org/10.1007/978-3-031-41138-0_17.
Wilkinson, M.D., Dumontier, M., Aalbersberg, I.J., Appleton, G., Axton, M., Baak, A., Blomberg, N., Boiten, J.-W., da Silva Santos, L.B., Bourne, P.E., Bouwman, J., Brookes, A.J., Clark, T., Crosas, M., Dillo, I., Dumon, O., Edmunds, S., Evelo, C.T., Finkers, R., Gonzalez-Beltran, A., Gray, A.J.G., Groth, P., Goble, C., Grethe, J.S., Heringa, J., ‘t Hoen, P.A.C., Hooft, R., Kuhn, T., Kok, R., Kok, J., Lusher, S.J., Martone, M.E., Mons, A., Packer, A.L., Persson, B., Rocca-Serra, P., Roos, M., van Schaik, R., Sansone, S.-A., Schultes, E., Sengstag, T., Slater, T., Strawn, G., Swertz, M.A., Thompson, M., van der Lei, J., van Mulligen, E., Velterop, J., Waagmeester, A., Wittenburg, P., Wolstencroft, K., Zhao, J., Mons, B. (2016). The FAIR Guiding Principles for scientific data management and stewardship. Scientific Data, 3(1). https://doi.org/10.1038/sdata.2016.18.
Yan, T., You, Z., Zhang, Y., Hua, R. (2023). Multi-source Open Data Quality Evaluation Model in the Web 3.0 Era. In: 2023 6th International Conference on Data Science and Information Technology (DSIT), Vol. 264. IEEE, pp. 203–207. https://doi.org/10.1109/dsit60026.2023.00038.
Zuiderwijk, A., Janssen, M., Poulis, K., van de Kaa, G. (2015). Open data for competitive advantage: insights from open data use by companies. In: Proceedings of the 16th Annual International Conference on Digital Government Research. Association for Computing Machinery. https://doi.org/10.1145/2757401.2757411.
Biographies
Žnideršič Klara
K. Žnideršič has been a member of the Laboratory for Computer Graphics and Multimedia at Faculty of Computer and Information Science at the University of Ljubljana since 2023. Her research interests include modern approaches in music pedagogy and qualitative evaluation of open data collections.
Marolt Matija
M. Marolt is a full professor at the Faculty of Computer and Information Science, where he is head of Laboratory for Computer Graphics and Multimedia. His research interests are in the areas of music/audio information retrieval, computer graphics and visualization. He focuses on problems such as music transcription, audio segmentation and classification, and organization, search and visualization of music collections.
Pesek Matevž
M. Marolt is a full professor at the Faculty of Computer and Information Science, where he is head of Laboratory for Computer Graphics and Multimedia. His research interests are in the areas of music/audio information retrieval, computer graphics and visualization. He focuses on problems such as music transcription, audio segmentation and classification, and organization, search and visualization of music collections.
