Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Thank you for sharing your thoughts. I really
appreciate your efforts and I am waiting for your further write ups thank
you once again.
locksmith tampa commented on 12-Oct-2018 07:07 PM
For the reason that the admin of this site is working,
no doubt very quickly it will be famous, due to
its feature contents.
Breanna commented on 12-Oct-2018 07:11 PM
Oh my goodness! Amazing article dude! Thank you, Howqever
I am encountering troubles with your RSS. I don't understand the reason why I cannot
subscribe to it. Is there anyboy else having thhe same RSS issues?

Anyone that knows thee answer can you kindly respond?
Thanx!!
locksmith near me commented on 12-Oct-2018 07:27 PM
I am really enjoying the theme/design of your blog.
Do you ever run into any web browser compatibility problems?

A handful of my blog visitors have complained
about my blog not operating correctly in Explorer but looks great in Firefox.

Do you have any recommendations to help fix this issue?
Training skills business commented on 12-Oct-2018 07:33 PM
My brother suggested I might like this web site. He was totally right.

This post truly made my day. You cann't imagine
simply how much time I had spent for this info!
Thanks!
audience traffic commented on 12-Oct-2018 07:39 PM
There is certainly a lot to learn about this
topic. I really like all the points you made.
Katherin commented on 12-Oct-2018 07:45 PM
Really had to say Now i am relieved I stumbled onto your internet page!


Here is my websitetinder dating site
divorce paper california commented on 12-Oct-2018 08:00 PM
It's a shame you don't have a donate button! I'd without
a doubt donate to this excellent blog! I suppose for now
i'll settle for book-marking and adding your RSS feed to my Google
account. I look forward to fresh updates and will share this blog with my Facebook group.
Talk soon!
locksmith tampa commented on 12-Oct-2018 08:08 PM
When someone writes an piece of writing he/she keeps
the idea of a user in his/her brain that how a user
can know it. So that's why this post is great. Thanks!
Dacia commented on 12-Oct-2018 08:12 PM
Basically desired to emphasize I am just delighted that i came in your web site!


my web pagehttps://www.gumtree.pl/a-inne-zdrowotne-produkty/sosnowiec/alveo-oryginal-winogronowe-i-mietowe-+-126-pln/1002761100890911441007409
Situs Domino99 commented on 12-Oct-2018 08:13 PM
Pretty section of content. I just stumbled upon your
site and in accession capital to assert that I get actually enjoyed
account your blog posts. Anyway I will be subscribing too your feeds and
even I achievement you access consistently quickly.
Corazon commented on 12-Oct-2018 08:18 PM
I enjoy this website - its so usefull and helpfull.


Also visit my web page:https://www.gumtree.pl/a-inne-zdrowotne-produkty/sosnowiec/alveo-oryginal-winogronowe-i-mietowe-+-126-pln/1002761100890911441007409
locksmith commented on 12-Oct-2018 08:56 PM
We are a gaggle of volunteers and opening a brand new scheme in our community.

Your website offered us with valuable info to work on. You have done a formidable job and our whole
neighborhood will be grateful to you.
Disabled women commented on 12-Oct-2018 09:34 PM
I love your blog.. very nice colors & theme.
Did you create this website yourself or did you hire someone to
do it for you? Plz respond as I'm looking to design my own blog and
would like to know where u got this from. thanks
Divorce Papers Illinois commented on 12-Oct-2018 09:41 PM
Greetings! Very useful advice in this particular article!
It's the little changes which will make the most significant changes.
Thanks a lot for sharing!
dish network advertising campaigns commented on 12-Oct-2018 09:59 PM
I am curious to find out what blog system you have been utilizing?
I'm experiencing some small security issues with my latest blog and I'd
like to find something more risk-free. Do you have any solutions?
Www.Electronicrepairegypt.Com commented on 12-Oct-2018 10:35 PM
I couldn't residt commenting. Very well written!
I am no longer positive the place you're getting your info,
but good topic. I must spend some time learning more or understanding more.

Thanks for great info I used to bee on the lookout for thiis info forr my mission.
renault Truck egr off commented on 12-Oct-2018 11:30 PM
If soe one wishes expert view on the topic of blogging then i recommend
him/her to visit this webpage, Keep up the pleasant job.
Donny commented on 12-Oct-2018 11:34 PM
Keep up the excellent work !! Lovin' it!

Feel free to surf to my web page ::https://www.gumtree.pl/a-inne-zdrowotne-produkty/sosnowiec/alveo-oryginal-winogronowe-i-mietowe-+-126-pln/1002761100890911441007409
vesselhope6.host-sc.com commented on 13-Oct-2018 12:40 AM
First off I would like to say superb blog! I had a quick question which
I'd like to ask if you don't mind. I was curious to know how you center yourself and clear your mind prior
to writing. I have had a tough time clearing my mind in getting my thoughts out there.

I truly do take pleasure in writing however it just seems like the first 10 to 15 minutes are
usually lost simply just trying to figure out how to begin. Any suggestions or hints?
Kudos! http://vesselhope6.host-sc.com/2018/08/22/was-kosten-wachstumshormone/
mercedes-benz egr off commented on 13-Oct-2018 01:21 AM
I've read several excellent stuff here. Definitely worth bookmarking for revisiting.
I womder how a lot attempt you place to make this type of great informative website.
Airbag Services commented on 13-Oct-2018 02:01 AM
I'll immediately grasp your rss feed aas I can not to find your e-mail subscription link or e-newsletter service.
Do you've any? Plase permit mme recogjize in order thaqt I could subscribe.
Thanks.
national Database for physicians commented on 13-Oct-2018 02:19 AM
I always used to read post in news papers but now as I am a user of internet therefore from now I am using net for articles or reviews,
thanks to web.
sponsored links commented on 13-Oct-2018 03:13 AM
Pretty component to content. I just stumbled
upon your website and in accession capital to say
that I acquire actually enjoyed account your weblog posts.
Anyway I will be subscribing on your augment
or even I fulfillment you get right of entry to constantly quickly.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Thank you for sharing your thoughts. I really
appreciate your efforts and I am waiting for your further write ups thank
you once again.
locksmith tampa commented on 12-Oct-2018 07:07 PM
For the reason that the admin of this site is working,
no doubt very quickly it will be famous, due to
its feature contents.
Breanna commented on 12-Oct-2018 07:11 PM
Oh my goodness! Amazing article dude! Thank you, Howqever
I am encountering troubles with your RSS. I don't understand the reason why I cannot
subscribe to it. Is there anyboy else having thhe same RSS issues?

Anyone that knows thee answer can you kindly respond?
Thanx!!
locksmith near me commented on 12-Oct-2018 07:27 PM
I am really enjoying the theme/design of your blog.
Do you ever run into any web browser compatibility problems?

A handful of my blog visitors have complained
about my blog not operating correctly in Explorer but looks great in Firefox.

Do you have any recommendations to help fix this issue?
Training skills business commented on 12-Oct-2018 07:33 PM
My brother suggested I might like this web site. He was totally right.

This post truly made my day. You cann't imagine
simply how much time I had spent for this info!
Thanks!
audience traffic commented on 12-Oct-2018 07:39 PM
There is certainly a lot to learn about this
topic. I really like all the points you made.
Katherin commented on 12-Oct-2018 07:45 PM
Really had to say Now i am relieved I stumbled onto your internet page!


Here is my websitetinder dating site
divorce paper california commented on 12-Oct-2018 08:00 PM
It's a shame you don't have a donate button! I'd without
a doubt donate to this excellent blog! I suppose for now
i'll settle for book-marking and adding your RSS feed to my Google
account. I look forward to fresh updates and will share this blog with my Facebook group.
Talk soon!
locksmith tampa commented on 12-Oct-2018 08:08 PM
When someone writes an piece of writing he/she keeps
the idea of a user in his/her brain that how a user
can know it. So that's why this post is great. Thanks!
Dacia commented on 12-Oct-2018 08:12 PM
Basically desired to emphasize I am just delighted that i came in your web site!


my web pagehttps://www.gumtree.pl/a-inne-zdrowotne-produkty/sosnowiec/alveo-oryginal-winogronowe-i-mietowe-+-126-pln/1002761100890911441007409
Situs Domino99 commented on 12-Oct-2018 08:13 PM
Pretty section of content. I just stumbled upon your
site and in accession capital to assert that I get actually enjoyed
account your blog posts. Anyway I will be subscribing too your feeds and
even I achievement you access consistently quickly.
Corazon commented on 12-Oct-2018 08:18 PM
I enjoy this website - its so usefull and helpfull.


Also visit my web page:https://www.gumtree.pl/a-inne-zdrowotne-produkty/sosnowiec/alveo-oryginal-winogronowe-i-mietowe-+-126-pln/1002761100890911441007409
locksmith commented on 12-Oct-2018 08:56 PM
We are a gaggle of volunteers and opening a brand new scheme in our community.

Your website offered us with valuable info to work on. You have done a formidable job and our whole
neighborhood will be grateful to you.
Disabled women commented on 12-Oct-2018 09:34 PM
I love your blog.. very nice colors & theme.
Did you create this website yourself or did you hire someone to
do it for you? Plz respond as I'm looking to design my own blog and
would like to know where u got this from. thanks
Divorce Papers Illinois commented on 12-Oct-2018 09:41 PM
Greetings! Very useful advice in this particular article!
It's the little changes which will make the most significant changes.
Thanks a lot for sharing!
dish network advertising campaigns commented on 12-Oct-2018 09:59 PM
I am curious to find out what blog system you have been utilizing?
I'm experiencing some small security issues with my latest blog and I'd
like to find something more risk-free. Do you have any solutions?
Www.Electronicrepairegypt.Com commented on 12-Oct-2018 10:35 PM
I couldn't residt commenting. Very well written!
I am no longer positive the place you're getting your info,
but good topic. I must spend some time learning more or understanding more.

Thanks for great info I used to bee on the lookout for thiis info forr my mission.
renault Truck egr off commented on 12-Oct-2018 11:30 PM
If soe one wishes expert view on the topic of blogging then i recommend
him/her to visit this webpage, Keep up the pleasant job.
Donny commented on 12-Oct-2018 11:34 PM
Keep up the excellent work !! Lovin' it!

Feel free to surf to my web page ::https://www.gumtree.pl/a-inne-zdrowotne-produkty/sosnowiec/alveo-oryginal-winogronowe-i-mietowe-+-126-pln/1002761100890911441007409
vesselhope6.host-sc.com commented on 13-Oct-2018 12:40 AM
First off I would like to say superb blog! I had a quick question which
I'd like to ask if you don't mind. I was curious to know how you center yourself and clear your mind prior
to writing. I have had a tough time clearing my mind in getting my thoughts out there.

I truly do take pleasure in writing however it just seems like the first 10 to 15 minutes are
usually lost simply just trying to figure out how to begin. Any suggestions or hints?
Kudos! http://vesselhope6.host-sc.com/2018/08/22/was-kosten-wachstumshormone/
mercedes-benz egr off commented on 13-Oct-2018 01:21 AM
I've read several excellent stuff here. Definitely worth bookmarking for revisiting.
I womder how a lot attempt you place to make this type of great informative website.
Airbag Services commented on 13-Oct-2018 02:01 AM
I'll immediately grasp your rss feed aas I can not to find your e-mail subscription link or e-newsletter service.
Do you've any? Plase permit mme recogjize in order thaqt I could subscribe.
Thanks.
national Database for physicians commented on 13-Oct-2018 02:19 AM
I always used to read post in news papers but now as I am a user of internet therefore from now I am using net for articles or reviews,
thanks to web.
sponsored links commented on 13-Oct-2018 03:13 AM
Pretty component to content. I just stumbled
upon your website and in accession capital to say
that I acquire actually enjoyed account your weblog posts.
Anyway I will be subscribing on your augment
or even I fulfillment you get right of entry to constantly quickly.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.