In recent studies on GUIs, I collected data from over 100 crowdworkers. I often encountered a common issue where some of the data appeared to be from participants who were not performing the tasks diligently. This is a well-known problem in other crowdsourced tasks like data labeling or short-text writing. To address this, we investigated whether a simple, interactive GUI task could help identify diligent participants. Specifically, we asked workers to adjust an image to a specific size (e.g., 5 centimeters on a side) using a pinch gesture. Our key finding was that the workers who performed this preliminary task accurately also followed instructions more precisely in the subsequent main task. In the HCI field, while the importance of securing a sufficient sample size is now widely recognized, improving data quality is equally critical. My belief is that properly designed GUI-based tasks make this possible, and it is a challenge that more researchers should address.
when they conducted the data test, I think the most interesting thing is the results. The people who were conducting a small task such as the pinch to the image followed this preliminary task more precise than the main task itself. This is interesting because the main task at hand like data labeling or short-text should be the tasks that are followed to be as precise as they can however this test made it seem like that shorter much easier test of pinching an image resulted in people closely following the intrustions comapred to the larger task.