Joe Stanganelli

Question Order Can Make a Difference in the Data You Collect

NO RATINGS
View Comments: Newest First | Oldest First | Threaded View
Joe Stanganelli
User Rank
Blogger
Re: Abiguous Manipulation
Joe Stanganelli   5/1/2012 12:22:29 AM
NO RATINGS
Hi, Callmebob.

To be fair, as Doug Williamson discussed with me for an earlier piece (and as addressed here), making people commit to exacting language, without allowing them to hedge, actually yields better, more accurate, more truthful results.

At the same time, there are surveys with loaded questions that do try to steer people, particularly in survey contexts outside of customer surveys, and I may have a piece about this topic coming in the future.

rbaz
User Rank
Data Doctor
Re: Peeves
rbaz   4/30/2012 10:58:07 PM
NO RATINGS
Bulk,

You would think the approach would be to gradually build up to the main questions, that way you are lead to be fully engaged and more prone to answer candidly.

Hospice_Houngbo
User Rank
Prospector
Re: Peeves
Hospice_Houngbo   4/30/2012 3:50:37 PM
NO RATINGS
@Maryam:

 Do it yourself web based survey tools are not the problem. The main issue is about the presentation of the informaiton in the questionnaire and the way it is organized. The KISS (Keep It Simple and Straightforward) concept should be applied to online surveys as well.

Hospice_Houngbo
User Rank
Prospector
Open responses
Hospice_Houngbo   4/30/2012 3:38:04 PM
NO RATINGS
"Allow for open responses and employ text analytics to categorize the answers you get."

Thank you for the advice. But personally I don't like spending my time writing open responses to survey questions. I prefer to have many answers to choose from.

Callmebob
User Rank
Master Analyst
Abiguous Manipulation
Callmebob   4/30/2012 1:24:37 PM
NO RATINGS
My biggest pet peeve survey questions are ones that force me to respond with an ambiguous and inexact answer. This is when none of the responses reflect my true and accurate choice. My market research professor from many years ago explained how surveys can be constructed to steer answers to a desired result. In these cases when questions exclude a none of the above response, I feel manipulated and that the survey provider is trying to steer me to their preferred response. If the survey included a, Does this question make you feel paranoid?, I would probably answer, "Yes".

bulk
User Rank
Data Doctor
Re: Peeves
bulk   4/30/2012 1:13:01 PM
NO RATINGS
I have noticed this as well, more and more of the web based surveys I have come across are leading off with loaded questions.

rbaz
User Rank
Data Doctor
Re: Quickest way to incomplete responses
rbaz   4/30/2012 1:02:05 PM
NO RATINGS
Most participants begin surveys halfhearted and not fully engaged, many factors play crucial roles in fostering full engagement or lead to disinterest. Lenght of questions (having to read a short paragraph before answering a question) is on top of my list. The increase use of paying participants is evidence.

impactnow
User Rank
Blogger
Peeves
impactnow   4/30/2012 12:40:07 PM
NO RATINGS

By Far leading and loaded question are my greatest peeve they scream of no analyst involvement. Unfortunately they are getting more common with all the do it yourself web based survey tools.

Cordell
User Rank
Blogger
Re: Quickest way to incomplete responses
Cordell   4/30/2012 12:17:33 PM
NO RATINGS
"Figure out to the penny how much each piece of information is worth to you. From that, determine the information that it is really worth it to you to find out."

This could be said for a lot of research efforts - data mining, model building, decision management etc.  It's too easy to get involved in a fishing expedition!

Michelle
User Rank
Data Doctor
Quickest way to incomplete responses
Michelle   4/30/2012 9:33:15 AM
NO RATINGS
Thank you for asking, I have so many survey pet peeves. Response ordering is high on my list, as is the number of options in sliding scales or any question asking me to rate the degree of my satisfaction. A big block of responses and radio buttons is a great way to encourage respondents to bail.

I have seen the verifcation questions in surveys. They usually say something like 'for quality purposes, please select ___". If you're reading you'll answer correctly.

Information Resources
More Blogs from Joe Stanganelli
Dun&Bradstreet is tapping its huge database of company information to identify suppliers that have potential human trafficking violations that would be of concern to customers concerned about sustainability.
Speakers at Bio-IT World explore techniques for biotech researchers and others working with big data to identify the accurate data in their data files.
Cooperation among medical researchers -- done right -- very simply can mean lives saved, but the research community needs education on how to execute on that collaboration.
Research into the digital marketing campaigns of some of the presidential candidates raises the question of how much voter messaging is appropriate and who should get which types of messages.
Predictive asset maintenance analytics is finding its niche across industries, from automotive to oil and gas.
Radio Show
A2 Conversations
UPCOMING
Jessica Davis
Monetize Your Data: Turning Insights Into Action


3/29/2017   REGISTER   0
ARCHIVE
James M. Connolly
Evolution of the Data Scientist Role


3/23/2017  LISTEN   31
ARCHIVE
Jessica Davis
Data Analysts in Training: Meeting Tomorrow's Demand


3/8/2017  LISTEN   63
ARCHIVE
Jessica Davis
Our Bodies, Our Data: Medical Records For Sale


2/21/2017  LISTEN   63
ARCHIVE
Jessica Davis
Energy Analytics: Using Data to Find Savings


2/14/2017  LISTEN   44
ARCHIVE
Jessica Davis
Sharpen Your Analytics & Data Management Strategy


2/8/2017  LISTEN   74
ARCHIVE
Jessica Davis
Analytics: Make the Most of Data's Potential in 2017


1/19/2017  LISTEN   19
ARCHIVE
Jessica Davis
A2 Radio: Can You Trust Your Data?


12/20/2016  LISTEN   70
ARCHIVE
James M. Connolly
Retail Analytics: See Where Style Meets Statistics


12/6/2016  LISTEN   53
ARCHIVE
James M. Connolly
Why the IoT Matters to Your Business


11/29/2016  LISTEN   45
ARCHIVE
James M. Connolly
Will Data and Humans Become Friends in 2017?


11/22/2016  LISTEN   40
Information Resources
Quick Poll
Quick Poll
About Us  |  Contact Us  |  Help  |  Register  |  Twitter  |  Facebook  |  RSS