TY - UNPB
T1 - Generative AI: New Framework of Using Large Language Models for Analysing Descriptive Qualitative Data
AU - Zięba-Kulawik, Karolina
N1 - This article was submitted and deposit in arXiv : Open archive of the social sciences
PY - 2025/3/12
Y1 - 2025/3/12
N2 - Development of Large Language Models (LLMs) offers new opportunities to analyse large qualitative data sets. This study proposes a framework that uses LLMs from five popular families (GPT, Mistral, Claude, DeepSeek and Llama) to automate data extraction process. The framework is tested on real estate listings from Luxembourg webscraped in 2025 (Jan) to demonstrate: (1) framework stability -ability to generate similar responses when provided with the same data set, but also of following the same pattern when faced with new questions, (2) framework calibration mechanism – by adding code sheets that clarify how to interpret specific situations, (3) mechanism of validating model behaviour over larger data set – by calculating correlations between partial responses generated by the framework and comparing them with the pattern generated on the test set.
AB - Development of Large Language Models (LLMs) offers new opportunities to analyse large qualitative data sets. This study proposes a framework that uses LLMs from five popular families (GPT, Mistral, Claude, DeepSeek and Llama) to automate data extraction process. The framework is tested on real estate listings from Luxembourg webscraped in 2025 (Jan) to demonstrate: (1) framework stability -ability to generate similar responses when provided with the same data set, but also of following the same pattern when faced with new questions, (2) framework calibration mechanism – by adding code sheets that clarify how to interpret specific situations, (3) mechanism of validating model behaviour over larger data set – by calculating correlations between partial responses generated by the framework and comparing them with the pattern generated on the test set.
KW - GenAI
KW - LLMs
KW - data extraction
KW - qualitative attributes
KW - real estate
UR - https://doi.org/10.31235/osf.io/rk29m_v1
U2 - https://osf.io/preprints/socarxiv/rk29m_v1
DO - https://osf.io/preprints/socarxiv/rk29m_v1
M3 - Working paper
BT - Generative AI: New Framework of Using Large Language Models for Analysing Descriptive Qualitative Data
PB - SocArXiv
ER -