R Code for Verifying Qualtrics- vs. CloudResearch-exported MTurk IDs [link]
Whenever I run a Qualtrics survey on MTurk via CloudResearch, I pre-register to use data from the following participants only: Participants whose MTurk ID or IP address does not appear more than once in any complete/incomplete responses (to prevent participants from revisiting the attention check questions or reattempting the incentive-compatible questions) AND whose HIT has been submitted to MTurk for payment (to ensure that I use responses from verifiable sources only). This requires downloading both the Qualtrics and CloudResearch data files and comparing the list of MTurk IDs from the two files.
I am sharing my R code that does this automatically. It compares the list of MTurk IDs from Qualtrics vs. CloudResearch and indicates any observations that may need to be excluded along with the reasons. I have written this R code such that it does not require new packages and it also visualizes the process using simple for loops and if/else if statements, but I would greatly appreciate any suggestions for streamlining it!
Whenever I run a Qualtrics survey on MTurk via CloudResearch, I pre-register to use data from the following participants only: Participants whose MTurk ID or IP address does not appear more than once in any complete/incomplete responses (to prevent participants from revisiting the attention check questions or reattempting the incentive-compatible questions) AND whose HIT has been submitted to MTurk for payment (to ensure that I use responses from verifiable sources only). This requires downloading both the Qualtrics and CloudResearch data files and comparing the list of MTurk IDs from the two files.
I am sharing my R code that does this automatically. It compares the list of MTurk IDs from Qualtrics vs. CloudResearch and indicates any observations that may need to be excluded along with the reasons. I have written this R code such that it does not require new packages and it also visualizes the process using simple for loops and if/else if statements, but I would greatly appreciate any suggestions for streamlining it!