Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Situs Poker qq commented on 15-Oct-2018 10:55 PM
Yes! Finally someone writes about agen bandar q.
Slot online commented on 15-Oct-2018 11:10 PM
you're really a excellent webmaster. The website loading pace is amazing.
It seems that you're doing any unique trick. Moreover, The contents are masterwork.
you've done a magnificent process on this matter!
dg-datenschutz.de commented on 16-Oct-2018 12:27 AM
Great website you have here but I was wanting to know if you knew of any user discussion forums that cover the
same topics discussed in this article? I'd really like to be a part of community where I can get advice from other experienced people that share the same interest.
If you have any recommendations, please let me
know. Many thanks!
locksmith commented on 16-Oct-2018 12:32 AM
I was more than happy to discover this web site. I wanted to thank you
for your time just for this fantastic read!!
I definitely savored every bit of it and i also
have you saved as a favorite to check out new information in your web
site.
car locksmith tampa commented on 16-Oct-2018 12:50 AM
Just wish to say your article is as surprising. The clarity
to your put up is just spectacular and i could suppose you're a professional in this subject.

Well together with your permission allow me to grab your RSSfeed to
keep up to date with imminent post. Thanks a million and please keep up the
enjoyable work.
high quality traffic commented on 16-Oct-2018 02:07 AM
I loved as much as you'll receive carried out right here. The sketch is attractive, your authored material stylish.
nonetheless, you command get got an edginess over that you wish be delivering the following.
unwell unquestionably come further formerly again as exactly the
same nearly very often inside case you shield this increase.
Charissa commented on 16-Oct-2018 02:16 AM
The next time I read a blog, Hopefully it does not disappoint me just as much as this one.

After all, I know it was my choice to read through, nonetheless I really believed you would have something interesting to say.

All I hear is a bunch of moaning about something that you can fix if you weren't too busy
searching for attention.
Volvo Truck Dtc Remove commented on 16-Oct-2018 02:29 AM
Please let me know if you're looking for a article writer ffor your
weblog. You hhave some really good posts and I think I would
bee a gooid asset. If you ever want to take some of the load off, I'd reslly like to write some content for your blog in exchange for a link back to mine.
Please blast me an email if interested. Thank you!
Bandar q commented on 16-Oct-2018 02:53 AM
hey there and thank you for your info – I've definitely picked up anything new
from right here. I did however expertise some technical issues using
this website, since I experienced to reload the website many times previous to
I could get it to load correctly. I had been wondering if your web host is OK?

Not that I'm complaining, but slow loading instances times will often affect your placement in google and can damage
your quality score if ads and marketing with Adwords. Anyway I am adding this RSS to my email and can look out for much
more of your respective exciting content. Make sure you update this again very soon.
sell scrap jewelry commented on 16-Oct-2018 02:58 AM
My brother recommended I might like this blog. He was entirely right.
This post truly made my day. You can not imagine just how much time I had spent for this information!
Thanks!
dissolution Uncontested online commented on 16-Oct-2018 03:25 AM
Great post. I was checking constantly this blog and I'm impressed!

Extremely helpful info specially the last part :) I care for such information much.
I was looking for this particular information for a very long time.
Thank you and good luck.
rfid Parking system cost commented on 16-Oct-2018 03:30 AM
There is definately a great deal to find out about this issue.
I love all the points you have made.
Http://www.einpresswire.Com/ commented on 16-Oct-2018 03:39 AM
Amazing! Itss in fact remarkable article, I have ggot much
clear idea oon the topic of from this post.
Celesta commented on 16-Oct-2018 03:45 AM
Superb Site, Keep up the beneficial work. Appreciate it.


Feel free to visit my homepage:car stereos
locksmith commented on 16-Oct-2018 04:12 AM
I am regular reader, how are you everybody? This piece of writing
posted at this web site is truly nice.
Domino99 Terpercaya commented on 16-Oct-2018 04:20 AM
Hey there! I just wanted to ask if you ever have
anny problems with hackers? My last blog (wordpress) was hacked and I ended up losing many
months of hard work duue to no back up. Do you have any solutions to prevent hackers?
locksmith near me commented on 16-Oct-2018 04:53 AM
Hi there mates, how is everything, and what you wish for
to say about this article, in my view its actually awesome
in favor of me.
Cheap Divorce Quick commented on 16-Oct-2018 04:58 AM
Hello, I enjoy reading through your article post. I wanted
to write a little comment to support you.
Dudley Allenbach commented on 16-Oct-2018 04:59 AM
After all, you can’t rank if you don’t have content!
Alana commented on 16-Oct-2018 05:03 AM
say thanks to so a lot for your site it aids a lot.


Review my web page;remiqq
Mikki commented on 16-Oct-2018 05:29 AM
Great goods from you, man. I've understand your stuff previous to and you're just too wonderful.
I actually like what you have acquired here, certainly like what you're stating and the way in which you say it. You make it enjoyable and you still take care of to keep it wise. I can not wait to read much more from you. This is really a great website.

Here is my weblog -lead Generation Tools free download
how to promote your website for free commented on 16-Oct-2018 07:25 AM
Good respond in return of this matter with firm arguments and telling the whole thing about that.
Faye commented on 16-Oct-2018 07:39 AM
Paris (5 days). 2. Plan down days into your itinerary.
Joanna commented on 16-Oct-2018 07:52 AM
However it takes more then reading several articles to become a professional
even if you own an incredible digital camera. This all needs
a lot of time and patience for your guests along with the photographer.
With the affordable price, there is an luxury of spending several
dollars on buying accessories to produce our photography experience even better.
molten Glass Glides commented on 16-Oct-2018 07:57 AM
Greetings from California! I'm bored too deqth at work
so I decided to browse your blog on my iphone during
lunch break. I enjoy the info you provide here and can't wait to take a look when I get home.
I'm shocked at how fast your blkog loaded on my phoje ..
I'm nott even using WIFI, just 3G .. Anyways, amazing site!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Situs Poker qq commented on 15-Oct-2018 10:55 PM
Yes! Finally someone writes about agen bandar q.
Slot online commented on 15-Oct-2018 11:10 PM
you're really a excellent webmaster. The website loading pace is amazing.
It seems that you're doing any unique trick. Moreover, The contents are masterwork.
you've done a magnificent process on this matter!
dg-datenschutz.de commented on 16-Oct-2018 12:27 AM
Great website you have here but I was wanting to know if you knew of any user discussion forums that cover the
same topics discussed in this article? I'd really like to be a part of community where I can get advice from other experienced people that share the same interest.
If you have any recommendations, please let me
know. Many thanks!
locksmith commented on 16-Oct-2018 12:32 AM
I was more than happy to discover this web site. I wanted to thank you
for your time just for this fantastic read!!
I definitely savored every bit of it and i also
have you saved as a favorite to check out new information in your web
site.
car locksmith tampa commented on 16-Oct-2018 12:50 AM
Just wish to say your article is as surprising. The clarity
to your put up is just spectacular and i could suppose you're a professional in this subject.

Well together with your permission allow me to grab your RSSfeed to
keep up to date with imminent post. Thanks a million and please keep up the
enjoyable work.
high quality traffic commented on 16-Oct-2018 02:07 AM
I loved as much as you'll receive carried out right here. The sketch is attractive, your authored material stylish.
nonetheless, you command get got an edginess over that you wish be delivering the following.
unwell unquestionably come further formerly again as exactly the
same nearly very often inside case you shield this increase.
Charissa commented on 16-Oct-2018 02:16 AM
The next time I read a blog, Hopefully it does not disappoint me just as much as this one.

After all, I know it was my choice to read through, nonetheless I really believed you would have something interesting to say.

All I hear is a bunch of moaning about something that you can fix if you weren't too busy
searching for attention.
Volvo Truck Dtc Remove commented on 16-Oct-2018 02:29 AM
Please let me know if you're looking for a article writer ffor your
weblog. You hhave some really good posts and I think I would
bee a gooid asset. If you ever want to take some of the load off, I'd reslly like to write some content for your blog in exchange for a link back to mine.
Please blast me an email if interested. Thank you!
Bandar q commented on 16-Oct-2018 02:53 AM
hey there and thank you for your info – I've definitely picked up anything new
from right here. I did however expertise some technical issues using
this website, since I experienced to reload the website many times previous to
I could get it to load correctly. I had been wondering if your web host is OK?

Not that I'm complaining, but slow loading instances times will often affect your placement in google and can damage
your quality score if ads and marketing with Adwords. Anyway I am adding this RSS to my email and can look out for much
more of your respective exciting content. Make sure you update this again very soon.
sell scrap jewelry commented on 16-Oct-2018 02:58 AM
My brother recommended I might like this blog. He was entirely right.
This post truly made my day. You can not imagine just how much time I had spent for this information!
Thanks!
dissolution Uncontested online commented on 16-Oct-2018 03:25 AM
Great post. I was checking constantly this blog and I'm impressed!

Extremely helpful info specially the last part :) I care for such information much.
I was looking for this particular information for a very long time.
Thank you and good luck.
rfid Parking system cost commented on 16-Oct-2018 03:30 AM
There is definately a great deal to find out about this issue.
I love all the points you have made.
Http://www.einpresswire.Com/ commented on 16-Oct-2018 03:39 AM
Amazing! Itss in fact remarkable article, I have ggot much
clear idea oon the topic of from this post.
Celesta commented on 16-Oct-2018 03:45 AM
Superb Site, Keep up the beneficial work. Appreciate it.


Feel free to visit my homepage:car stereos
locksmith commented on 16-Oct-2018 04:12 AM
I am regular reader, how are you everybody? This piece of writing
posted at this web site is truly nice.
Domino99 Terpercaya commented on 16-Oct-2018 04:20 AM
Hey there! I just wanted to ask if you ever have
anny problems with hackers? My last blog (wordpress) was hacked and I ended up losing many
months of hard work duue to no back up. Do you have any solutions to prevent hackers?
locksmith near me commented on 16-Oct-2018 04:53 AM
Hi there mates, how is everything, and what you wish for
to say about this article, in my view its actually awesome
in favor of me.
Cheap Divorce Quick commented on 16-Oct-2018 04:58 AM
Hello, I enjoy reading through your article post. I wanted
to write a little comment to support you.
Dudley Allenbach commented on 16-Oct-2018 04:59 AM
After all, you can’t rank if you don’t have content!
Alana commented on 16-Oct-2018 05:03 AM
say thanks to so a lot for your site it aids a lot.


Review my web page;remiqq
Mikki commented on 16-Oct-2018 05:29 AM
Great goods from you, man. I've understand your stuff previous to and you're just too wonderful.
I actually like what you have acquired here, certainly like what you're stating and the way in which you say it. You make it enjoyable and you still take care of to keep it wise. I can not wait to read much more from you. This is really a great website.

Here is my weblog -lead Generation Tools free download
how to promote your website for free commented on 16-Oct-2018 07:25 AM
Good respond in return of this matter with firm arguments and telling the whole thing about that.
Faye commented on 16-Oct-2018 07:39 AM
Paris (5 days). 2. Plan down days into your itinerary.
Joanna commented on 16-Oct-2018 07:52 AM
However it takes more then reading several articles to become a professional
even if you own an incredible digital camera. This all needs
a lot of time and patience for your guests along with the photographer.
With the affordable price, there is an luxury of spending several
dollars on buying accessories to produce our photography experience even better.
molten Glass Glides commented on 16-Oct-2018 07:57 AM
Greetings from California! I'm bored too deqth at work
so I decided to browse your blog on my iphone during
lunch break. I enjoy the info you provide here and can't wait to take a look when I get home.
I'm shocked at how fast your blkog loaded on my phoje ..
I'm nott even using WIFI, just 3G .. Anyways, amazing site!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.