Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Camelia Satava commented on 13-Jan-2019 01:46 AM
Thanks for this great share. I have a great website with pizza vouchers for Dominos, Papa johns, Dennys, & more https://pizzacoupon24.com
Warren Wennersten commented on 13-Jan-2019 01:48 AM
Hello! I just would like to give a huge thumbs up for the great info. I found some great pizza, burger & bbq coupons for a free menu from Dominos, Papa johns, Dennys, & more https://pizzacoupon24.com
Elanor Destephen commented on 13-Jan-2019 01:50 AM
Aw, this was a really nice post. I found some great pizza, burger & bbq vouchers for a free menu from Dominos, Papa johns, Dennys, & more https://pizzacoupon24.com
Chadwick commented on 13-Jan-2019 02:20 AM
Excellent post.Never knew this, appreciate it for letting me know.


My siteonline homework
landscaping commented on 13-Jan-2019 02:39 AM
Appreciate the recommendation. Let me try it out.
Kevin commented on 13-Jan-2019 02:41 AM
Hey! I know this is kind of off topic but I was wondering if you knew where I could find a captcha plugin for my comment form?
I'm using the same blog platform as yours and I'm having trouble finding one? Thanks a lot!

Also visit my site: lose money
Jared commented on 13-Jan-2019 02:48 AM
What's up, I log on to your blogs daily. Your story-telling style is witty, keep up the good work!


My homepage ...proper business
Http://Www.Section3Athletics.Org commented on 13-Jan-2019 03:23 AM
It's truly very complex in this active life to listen news on TV,
thus I simply use the web for that reason, and get
the most recent news.
Candelaria commented on 13-Jan-2019 03:44 AM
It's actually very complicated in this busy life to listen news on TV, thus I only
use world wide web for that reason, and take the latest news.
pdf entschlüsseln commented on 13-Jan-2019 04:10 AM
This is a very good tips especially to those new to blogosphere, brief and accurate information… Thanks for sharing this one. A must read article.
Dating Sites For Disabled Singles commented on 13-Jan-2019 04:17 AM
You can definitely see your expertise in the work you write.
The sector hopes for more passionate writers like you who are not afraid
to say how they believe. At all times follow your heart.
สล็อต commented on 13-Jan-2019 04:22 AM
Irrational thinking among slot machine players.
play free domino online games commented on 13-Jan-2019 05:24 AM
Thanks to my father who shared with me on the topic of this weblog,
this webpage is in fact remarkable.
Betsy Montenegro commented on 13-Jan-2019 05:31 AM
Thanks designed for sharing such a pleasant thinking, article is good, thats why i have read it completely
Danae commented on 13-Jan-2019 05:37 AM
[/IMAGE]

My weblog :: city real estate
Ferdinand Clisby commented on 13-Jan-2019 05:38 AM
Really when someone doesn't understand after that its up to other users that they will help, so here it takes place.
Janessa commented on 13-Jan-2019 05:39 AM
Greetings I am so happy I found your blog page, I really found you by mistake, while I was looking on Google for something else, Nonetheless I am here now and would just like to say thanks a lot for a tremendous post and a all round interesting blog (I also love the theme/design), I don?t have time to look over it all at the minute but I have saved it and also added in your RSS feeds, so when I have time I will be back to read more, Please do keep up the fantastic work.


Feel free to surf to my webpage :: online skin products
Willian commented on 13-Jan-2019 05:48 AM
Great article, just what I wanted to find.

Here is my blog post ...online cricket score
Lonnie commented on 13-Jan-2019 05:49 AM
[/IMAGE]

Look at my page ... service provider
Stephany Fisk commented on 13-Jan-2019 05:53 AM
What i do not realize is in reality how you're not actually a lot more neatly-appreciated than you may be right now. You're so intelligent. You realize thus considerably with regards to this topic, produced me in my view believe it from numerous numerous angles. Its like men and women aren't involved until it's one thing to accomplish with Woman gaga! Your own stuffs outstanding. At all times take care of it up!
locksmith houston commented on 13-Jan-2019 05:59 AM
Hello to all, the contents present at this web page are
actually remarkable for people knowledge, well, keep up
the nice work fellows.
State Of Missouri Divorce Records commented on 13-Jan-2019 07:13 AM
Hey, you used to write wonderful, but the last several posts have been kinda boring?
I miss your tremendous writings. Past few posts are just a bit out of track!
come on!
Maryann commented on 13-Jan-2019 07:21 AM
I think this website holds very good pent articles blog posts.


Feel free to visit my web site ...tampa locksmith
Michale commented on 13-Jan-2019 07:24 AM
I am really enjoying the theme/design of your website.
Do you ever run into any internet browser compatibility issues? A number of my blog readers have complained about my website not operating correctly in Explorer but looks great in Opera. Do you have any solutions to help fix this problem?

Feel free to visit my blog post ::life starts
Archer commented on 13-Jan-2019 07:27 AM
But wanna say that this is handy, Thanks for taking your time to write this.


Also visit my web site ::real estate

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Camelia Satava commented on 13-Jan-2019 01:46 AM
Thanks for this great share. I have a great website with pizza vouchers for Dominos, Papa johns, Dennys, & more https://pizzacoupon24.com
Warren Wennersten commented on 13-Jan-2019 01:48 AM
Hello! I just would like to give a huge thumbs up for the great info. I found some great pizza, burger & bbq coupons for a free menu from Dominos, Papa johns, Dennys, & more https://pizzacoupon24.com
Elanor Destephen commented on 13-Jan-2019 01:50 AM
Aw, this was a really nice post. I found some great pizza, burger & bbq vouchers for a free menu from Dominos, Papa johns, Dennys, & more https://pizzacoupon24.com
Chadwick commented on 13-Jan-2019 02:20 AM
Excellent post.Never knew this, appreciate it for letting me know.


My siteonline homework
landscaping commented on 13-Jan-2019 02:39 AM
Appreciate the recommendation. Let me try it out.
Kevin commented on 13-Jan-2019 02:41 AM
Hey! I know this is kind of off topic but I was wondering if you knew where I could find a captcha plugin for my comment form?
I'm using the same blog platform as yours and I'm having trouble finding one? Thanks a lot!

Also visit my site: lose money
Jared commented on 13-Jan-2019 02:48 AM
What's up, I log on to your blogs daily. Your story-telling style is witty, keep up the good work!


My homepage ...proper business
Http://Www.Section3Athletics.Org commented on 13-Jan-2019 03:23 AM
It's truly very complex in this active life to listen news on TV,
thus I simply use the web for that reason, and get
the most recent news.
Candelaria commented on 13-Jan-2019 03:44 AM
It's actually very complicated in this busy life to listen news on TV, thus I only
use world wide web for that reason, and take the latest news.
pdf entschlüsseln commented on 13-Jan-2019 04:10 AM
This is a very good tips especially to those new to blogosphere, brief and accurate information… Thanks for sharing this one. A must read article.
Dating Sites For Disabled Singles commented on 13-Jan-2019 04:17 AM
You can definitely see your expertise in the work you write.
The sector hopes for more passionate writers like you who are not afraid
to say how they believe. At all times follow your heart.
สล็อต commented on 13-Jan-2019 04:22 AM
Irrational thinking among slot machine players.
play free domino online games commented on 13-Jan-2019 05:24 AM
Thanks to my father who shared with me on the topic of this weblog,
this webpage is in fact remarkable.
Betsy Montenegro commented on 13-Jan-2019 05:31 AM
Thanks designed for sharing such a pleasant thinking, article is good, thats why i have read it completely
Danae commented on 13-Jan-2019 05:37 AM
[/IMAGE]

My weblog :: city real estate
Ferdinand Clisby commented on 13-Jan-2019 05:38 AM
Really when someone doesn't understand after that its up to other users that they will help, so here it takes place.
Janessa commented on 13-Jan-2019 05:39 AM
Greetings I am so happy I found your blog page, I really found you by mistake, while I was looking on Google for something else, Nonetheless I am here now and would just like to say thanks a lot for a tremendous post and a all round interesting blog (I also love the theme/design), I don?t have time to look over it all at the minute but I have saved it and also added in your RSS feeds, so when I have time I will be back to read more, Please do keep up the fantastic work.


Feel free to surf to my webpage :: online skin products
Willian commented on 13-Jan-2019 05:48 AM
Great article, just what I wanted to find.

Here is my blog post ...online cricket score
Lonnie commented on 13-Jan-2019 05:49 AM
[/IMAGE]

Look at my page ... service provider
Stephany Fisk commented on 13-Jan-2019 05:53 AM
What i do not realize is in reality how you're not actually a lot more neatly-appreciated than you may be right now. You're so intelligent. You realize thus considerably with regards to this topic, produced me in my view believe it from numerous numerous angles. Its like men and women aren't involved until it's one thing to accomplish with Woman gaga! Your own stuffs outstanding. At all times take care of it up!
locksmith houston commented on 13-Jan-2019 05:59 AM
Hello to all, the contents present at this web page are
actually remarkable for people knowledge, well, keep up
the nice work fellows.
State Of Missouri Divorce Records commented on 13-Jan-2019 07:13 AM
Hey, you used to write wonderful, but the last several posts have been kinda boring?
I miss your tremendous writings. Past few posts are just a bit out of track!
come on!
Maryann commented on 13-Jan-2019 07:21 AM
I think this website holds very good pent articles blog posts.


Feel free to visit my web site ...tampa locksmith
Michale commented on 13-Jan-2019 07:24 AM
I am really enjoying the theme/design of your website.
Do you ever run into any internet browser compatibility issues? A number of my blog readers have complained about my website not operating correctly in Explorer but looks great in Opera. Do you have any solutions to help fix this problem?

Feel free to visit my blog post ::life starts
Archer commented on 13-Jan-2019 07:27 AM
But wanna say that this is handy, Thanks for taking your time to write this.


Also visit my web site ::real estate

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.