When Data Go Bad

Last updated on: November 12, 2012 at 5:00 am by Mark Regnerus

When Data Go Bad 2012-11-11T21:15:48-05:00 Mark Regnerus

LOGO Patheos Explore the world's faith through different perspectives on religion and spirituality! Patheos has the views of the prevalent religions and spiritualities of the world.

Imagine if some evangelical social scientists set out 20 years ago to document how the children of “Christian” parents fare in life, and began the task by gathering a small sample of children even before they were born by recruiting married parents who attended Sunday School classes at New Life Church in Colorado Springs, the Wheaton Bible Church outside Chicago, and Saddleback Community Church in Orange County, California—all located in prosperous communities exhibiting above-average social support of families, children, and faith. And then these scholars interviewed and re-interviewed the parents—and later the kids themselves—off and on for 20 years, and called it the National Christian Family Study. Their findings were published in peer-reviewed social science journals with a good deal of regularity over the years, and were utilized by political and social movements to improve public perception of (all) Christian parents. The news media regularly run stories on this study and its updated findings. Occasionally those studies included a comparison sample of other parents and kids, pulled from other small datasets collected by other people, and an occasional comparison with nationally-representative data from large studies like the National Survey of Family Growth. The evangelical kids compared favorably. Year after year the kids are re-interviewed, regardless of their awareness of the media attention cast upon them—including cover stories in Christian magazines—and the obvious utility of the findings for the movement to enhance respect for Christians, especially evangelicals.

Would the social scientific community consider this study a solid one, employing high-quality sample selection methods and useful both for understanding the experience of Christian households in America and for comparing this group of children with those in other studies? Unlikely. Seriously unlikely. And I would concur.

Well, this is what’s happened in the social science of family, except the study wasn’t about evangelical parents and their children. Read about it here.

Before you presume I’m on the war path here, think again. Quality sampling yielding valid, reliable data is not threatening. It is what is: good information, subject to invariable limitations. I just want to see the social scientific study of children and families more rooted in good data in which we can have confidence. I’m not alone. Despite a summer of abuse, however, I continue to hold that accurate information on politicized topics is important to collect, even though it may not reveal what the conventional wisdom would suggest or what elites–including very many social scientists–wish to hear. So be it.

Mark Regnerus

Previous Post

November 11, 2012

“I Can’t Believe I Did That!” The Role of Shame in Happiness

Next Post

November 14, 2012 When is Suffering Transformative? Sullivan's "Living Faith: Everyday Religion and Mothers in Poverty"

Browse Our Archives

Select a Category Amy Reynolds Becky Hsu Brad Wright critical realism George Yancey Gerardo Marti Jeremy Rhodes Jerry Park John Schmalzbauer Margarita Mooney Mark Regnerus Nicolette Manglos positive sociology Richard Flory Robert Woodberry Uncategorized

Select a Month April 2017 August 2016 April 2016 March 2016 February 2016 January 2016 December 2015 November 2015 October 2015 September 2015 August 2015 July 2015 June 2015 May 2015 April 2015 March 2015 February 2015 January 2015 December 2014 November 2014 October 2014 September 2014 August 2014 July 2014 June 2014 May 2014 April 2014 March 2014 February 2014 January 2014 December 2013 November 2013 October 2013 September 2013 August 2013 July 2013 June 2013 May 2013 April 2013 March 2013 February 2013 January 2013 December 2012 November 2012 October 2012 September 2012 August 2012 July 2012 June 2012 May 2012 April 2012 March 2012 February 2012 January 2012 December 2011 November 2011 October 2011

TAKE THE

Religious Wisdom Quiz