Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
puma fenty commented on 18-Sep-2018 11:44 AM
The right operating system for you'll determine on what degree of comfort you are looking
for and in addition the required perform.
Hey I know this is off topic but I was wondering if you knew of any
widgets I could add to my blog that automatically tweet my newest twitter updates.
I've been looking for a plug-in like this for quite some time and was hoping maybe you would
have some experience with something like this.
Please let me know if you run into anything. I truly enjoy reading
your blog and I look forward to your new updates.
eyefinity adaptive learning Technology commented on 18-Sep-2018 12:55 PM
Hello very cool blog!! Man .. Beautiful .. Amazing ..
I'll bookmark your site and take the feeds also...I'm happy to seek out
numerous useful info here in the submit, we want develop extra techniques in this regard, thanks for sharing.
feeding you special cat commented on 18-Sep-2018 01:29 PM
always i used to read smaller content which as well
clear their motive, and that is also happening with this post which
I am reading here.
anal bead commented on 18-Sep-2018 01:40 PM
I'll immeԀiately grab yߋur rss as I can't
in finding your e-mail subscription link оr e-newsletter service.
Ꭰo yoս have any? Pleɑse permitt me realize
ѕo tһat Ι may just subscribe. Thanks.
Insert Your Data commented on 18-Sep-2018 02:11 PM
Heya i'm for the first time here. I found this board and I find It really useful
& it helped me out much. I hope to give something back and help others like you aided me. http://Rlu.ru/2tuiA
Kian commented on 18-Sep-2018 02:20 PM
cheap iphone Casesiphone 8 plus case yissis 16330
data pengeluaran sgp togel master commented on 18-Sep-2018 02:46 PM
I appreciate, cause I found exactly what I used to be having a
look for. You have ended my 4 day lengthy hunt! God Bless you
man. Have a nice day. Bye
ویلا شمال تا 150 میلیون commented on 18-Sep-2018 02:51 PM
Hi there Dear, are you genuinely visiting this website
regularly, if so after that you will without doubt get fastidious know-how.
reduce stress commented on 18-Sep-2018 03:43 PM
Somebody necessarily help to make critically articles I'd state.
This is the first time I frequented your web page and so far?
I surprised with the research you made to make this actual publish extraordinary.
Fantastic job!
anchortext commented on 18-Sep-2018 03:49 PM
So if you're expecting a lot of help, remember that this may not be forthcoming.

It is common for teachers to lament that students are unable to write despite having done quite nicely within the PMR English exam for 15-year-olds.
To ensure that they will will view the message that you are trying to find across, write using their language and write while considering their amount of comprehension.
anchortext commented on 18-Sep-2018 03:58 PM
nevertheless [cue for newness] bravery, constancy,
and resolution [reverse of submission]. Understand the subject - While writing the essay, the first
thing you have to do is to define this issue. However, you
may also be wondering to purchase good essay writing examples.
popup ad commented on 18-Sep-2018 04:03 PM
hello there and thank you for your info – I've certainly picked up something new from
right here. I did however expertise a few
technical issues using this website, as I experienced to
reload the site a lot of times previous to I could get it to load properly.
I had been wondering if your hosting is OK? Not that I am complaining,
but sluggish loading instances times will very frequently affect
your placement in google and can damage your quality score if advertising and marketing with Adwords.
Well I'm adding this RSS to my email and can look out
for much more of your respective exciting content.
Ensure that you update this again very soon.
Medical health App commented on 18-Sep-2018 04:08 PM
After going over a few of the blog posts on your website, I really
appreciate your technique of writing a blog. I bookmarked it to my bookmark website list and will be checking back in the near future.

Please check out my web site as well and tell me
your opinion.
saudedescribe.com commented on 18-Sep-2018 04:29 PM
Hi there, this weekend is pleasant in favor of me, since this occasion i am reading this great educational article here at my house. http://www.saudedescribe.com/?s=saude
movers Web Site commented on 18-Sep-2018 04:53 PM
Hi there to all, the contents existing at this site are genuinely remarkable for people knowledge,
well, keep up the good work fellows.
Faye commented on 18-Sep-2018 04:54 PM
iphone 6 plus casecheap iphone Cases paqdcj 35473
Casey commented on 18-Sep-2018 04:54 PM
iphone x casesiphone x cases tngpiw 88180
conveyor belt non-Working commented on 18-Sep-2018 05:38 PM
Hmm it appears like your site ate my first comment (it
was extremely long) so I guess I'll just sum it up
what I submitted and say, I'm thoroughly enjoying your blog.
I too am an aspiring blog blogger but I'm still new to the whole thing.

Do you have any recommendations for inexperienced blog writers?
I'd definitely appreciate it.
free domain registration and web hosting in pakistan commented on 18-Sep-2018 05:44 PM
Do not sign up a domain name that has hyphens.
io domain names cheap commented on 18-Sep-2018 05:44 PM
Domain Call for you,just so it is signed up to you.
COMENTARIOS http://www.makeu.kr/board_RQJh02/262899
Nike Vapormax commented on 18-Sep-2018 05:51 PM
This Nike accumulating is blood-tingling all the bazaar due to its latest
structure and blush scheme.
Vince commented on 18-Sep-2018 05:53 PM
iPhone Casesiphone 7 case horfqa 16735
Kntc.Binhduong.Gov.vn commented on 18-Sep-2018 06:13 PM
Oh my goodness! Amazing article dude! Many thanks, However I am
encountering problems with your RSS. I don't know why I am unable to join it.
Is there anybody getting similar RSS problems? Anybody who knows
the solution will you kindly respond? Thanx!!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
puma fenty commented on 18-Sep-2018 11:44 AM
The right operating system for you'll determine on what degree of comfort you are looking
for and in addition the required perform.
Hey I know this is off topic but I was wondering if you knew of any
widgets I could add to my blog that automatically tweet my newest twitter updates.
I've been looking for a plug-in like this for quite some time and was hoping maybe you would
have some experience with something like this.
Please let me know if you run into anything. I truly enjoy reading
your blog and I look forward to your new updates.
eyefinity adaptive learning Technology commented on 18-Sep-2018 12:55 PM
Hello very cool blog!! Man .. Beautiful .. Amazing ..
I'll bookmark your site and take the feeds also...I'm happy to seek out
numerous useful info here in the submit, we want develop extra techniques in this regard, thanks for sharing.
feeding you special cat commented on 18-Sep-2018 01:29 PM
always i used to read smaller content which as well
clear their motive, and that is also happening with this post which
I am reading here.
anal bead commented on 18-Sep-2018 01:40 PM
I'll immeԀiately grab yߋur rss as I can't
in finding your e-mail subscription link оr e-newsletter service.
Ꭰo yoս have any? Pleɑse permitt me realize
ѕo tһat Ι may just subscribe. Thanks.
Insert Your Data commented on 18-Sep-2018 02:11 PM
Heya i'm for the first time here. I found this board and I find It really useful
& it helped me out much. I hope to give something back and help others like you aided me. http://Rlu.ru/2tuiA
Kian commented on 18-Sep-2018 02:20 PM
cheap iphone Casesiphone 8 plus case yissis 16330
data pengeluaran sgp togel master commented on 18-Sep-2018 02:46 PM
I appreciate, cause I found exactly what I used to be having a
look for. You have ended my 4 day lengthy hunt! God Bless you
man. Have a nice day. Bye
ویلا شمال تا 150 میلیون commented on 18-Sep-2018 02:51 PM
Hi there Dear, are you genuinely visiting this website
regularly, if so after that you will without doubt get fastidious know-how.
reduce stress commented on 18-Sep-2018 03:43 PM
Somebody necessarily help to make critically articles I'd state.
This is the first time I frequented your web page and so far?
I surprised with the research you made to make this actual publish extraordinary.
Fantastic job!
anchortext commented on 18-Sep-2018 03:49 PM
So if you're expecting a lot of help, remember that this may not be forthcoming.

It is common for teachers to lament that students are unable to write despite having done quite nicely within the PMR English exam for 15-year-olds.
To ensure that they will will view the message that you are trying to find across, write using their language and write while considering their amount of comprehension.
anchortext commented on 18-Sep-2018 03:58 PM
nevertheless [cue for newness] bravery, constancy,
and resolution [reverse of submission]. Understand the subject - While writing the essay, the first
thing you have to do is to define this issue. However, you
may also be wondering to purchase good essay writing examples.
popup ad commented on 18-Sep-2018 04:03 PM
hello there and thank you for your info – I've certainly picked up something new from
right here. I did however expertise a few
technical issues using this website, as I experienced to
reload the site a lot of times previous to I could get it to load properly.
I had been wondering if your hosting is OK? Not that I am complaining,
but sluggish loading instances times will very frequently affect
your placement in google and can damage your quality score if advertising and marketing with Adwords.
Well I'm adding this RSS to my email and can look out
for much more of your respective exciting content.
Ensure that you update this again very soon.
Medical health App commented on 18-Sep-2018 04:08 PM
After going over a few of the blog posts on your website, I really
appreciate your technique of writing a blog. I bookmarked it to my bookmark website list and will be checking back in the near future.

Please check out my web site as well and tell me
your opinion.
saudedescribe.com commented on 18-Sep-2018 04:29 PM
Hi there, this weekend is pleasant in favor of me, since this occasion i am reading this great educational article here at my house. http://www.saudedescribe.com/?s=saude
movers Web Site commented on 18-Sep-2018 04:53 PM
Hi there to all, the contents existing at this site are genuinely remarkable for people knowledge,
well, keep up the good work fellows.
Faye commented on 18-Sep-2018 04:54 PM
iphone 6 plus casecheap iphone Cases paqdcj 35473
Casey commented on 18-Sep-2018 04:54 PM
iphone x casesiphone x cases tngpiw 88180
conveyor belt non-Working commented on 18-Sep-2018 05:38 PM
Hmm it appears like your site ate my first comment (it
was extremely long) so I guess I'll just sum it up
what I submitted and say, I'm thoroughly enjoying your blog.
I too am an aspiring blog blogger but I'm still new to the whole thing.

Do you have any recommendations for inexperienced blog writers?
I'd definitely appreciate it.
free domain registration and web hosting in pakistan commented on 18-Sep-2018 05:44 PM
Do not sign up a domain name that has hyphens.
io domain names cheap commented on 18-Sep-2018 05:44 PM
Domain Call for you,just so it is signed up to you.
COMENTARIOS http://www.makeu.kr/board_RQJh02/262899
Nike Vapormax commented on 18-Sep-2018 05:51 PM
This Nike accumulating is blood-tingling all the bazaar due to its latest
structure and blush scheme.
Vince commented on 18-Sep-2018 05:53 PM
iPhone Casesiphone 7 case horfqa 16735
Kntc.Binhduong.Gov.vn commented on 18-Sep-2018 06:13 PM
Oh my goodness! Amazing article dude! Many thanks, However I am
encountering problems with your RSS. I don't know why I am unable to join it.
Is there anybody getting similar RSS problems? Anybody who knows
the solution will you kindly respond? Thanx!!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.