Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
bosch ecu simulators no download commented on 16-Sep-2018 03:44 PM
hi!,I like your writing soo a lot! share we be in contact
more about your pot on AOL? I need an expert in this area to unravel my problem.

May be that'syou! Having a look ahead to look you.
adidas eqt support adv commented on 16-Sep-2018 03:51 PM
The firm has a BIG BIG list of different types of footwear they've created.I
only know a pair that are Nike SB,Air Yeezy,Dunks,Air Jordan,Air Max,HyperDunk,Blazer and Cortez.I'm certain there are a lot of more that i have
never said but these are the one's i feels like the company has made at least
one hundred,000 completely different designs.
http://studentpower2012.org/ commented on 16-Sep-2018 04:09 PM
I'd like to thank you for the efforts you've put
in writing this site. I am hoping to see the same high-grade
content from you in the future as well. In fact, your creative writing abilities has encouraged
me to get my own website now ;)
Wilda commented on 16-Sep-2018 04:10 PM
After that's complete, he has to provide personal information, like address,
family background, telephone number, job details, and monthly salary details.
If you would like to spot a great agency from one that is certainly fake the English suited for the
site is easily understandable and possesses few grammatical
mistakes. It may seem a lot more like a company arrangement but,
my understanding is, one's parents will pick the best possible mate for their child and their judgment is unclouded
by hormones.
prescription without a doctors prescription commented on 16-Sep-2018 04:20 PM
That became a took related side few in great healthy Viagra also being forced
with ritonavir, and a day in between use of the optical multiple disparate.
Www lasvegas com prescription without a doctors prescription fridae.
The most effective side effects are:What is the pharmacy of Cialis vs.
Hye commented on 16-Sep-2018 04:35 PM
[/IMAGE]

Also visit my web-site; Eureka Bitcoin
Lena commented on 16-Sep-2018 04:42 PM
Thanks very useful. Will certainly share website with my good friends.


my website:driving in top gear
sarcoidosis doctor Database physicians commented on 16-Sep-2018 04:54 PM
Very nice write-up. I absolutely appreciate this website.
Thanks!
movie online stream commented on 16-Sep-2018 04:55 PM
wonderful publish, very informative. I wonder why the other
specialists of this sector do not understand this. You must continue your writing.
I am confident, you have a great readers' base already!
Christopher commented on 16-Sep-2018 05:01 PM
naturally like your website however you need
to test the spelling on several of your posts.
Several of them are rife with spelling problems and I to find it very bothersome to tell the truth
on the other hand I'll definitely come back again.
Edna commented on 16-Sep-2018 05:05 PM
A great deal oof bussinesses arre searching for brandable domain names.
Each year, 1000s of Russian mail order brides visit western countries by marriage.
If you would like to recognize a good agency derived from one of
that is fake the English used on the website is readily understandable and it has hardly any grammatical mistakes.

But they are certainly not always welcomed in to the lucrative professional jobs
they're suited for.
Columbus commented on 16-Sep-2018 05:44 PM
Thanks for the purpose of offering these fantastic details.


Also visit my web-site:types of accessories
Cliff commented on 16-Sep-2018 06:03 PM
Every day, countless domawin names are signed up.
Bernie commented on 16-Sep-2018 06:05 PM
1. InterNICis in charge of signing up domain.
safer.enjoyegypttravel.com commented on 16-Sep-2018 06:08 PM
Each year, thousands of Russian catalog shopping brides come to western countries by marriage.
This is no more true than when reaching a potential partner, the place that the way you say things will determine
whether you bomb or succeed. Even interracial, military
and also the disabled will find online dating services to be a more viable
option these days.
automated garment conveyor commented on 16-Sep-2018 06:22 PM
Greetings I am so happy I found your blog, I really found you by accident, while I was researching on Digg for something else, Nonethelsss I am here now and would just
like to say thank you for a fantastic post and a all round thrilling bkog
(I also love the theme/design), I don’t have time to go
through it alll at the minute but I have bookmarked it and also included your RSS feeds, soo when I have time I will be back
to read much more, Please do keep up the fantastic jo.
Hey! I know this is kind of off topic but I was wondering
which blog platform are youu using for this website?
I'm getting tired of Wordpress because I've had issues wih hackers
and I'm looking at options for anolther platform.
I would be awesome if you could point me iin the direction of a good platform.
Angelita commented on 16-Sep-2018 06:27 PM
I am in fact delighted to glance at this web site posts
which includes plenty off useful facts, thanks for providfing such data.
Ecu Test Stand commented on 16-Sep-2018 06:31 PM
WOW just what I was searching for. Came here by searching for auto ecu repair tools
german weather house barometer commented on 16-Sep-2018 06:33 PM
I like reading through an article that will make people think.
Also, thank you for allowing me to comment!
Ecu Remapping Software Download Ecm Titanium commented on 16-Sep-2018 06:57 PM
Greetings, I think your web sitte might be having internet browser compatibility issues.
When I look aat your blog in Safari, it looks finne but when opening in Internet Explorer, it's got some overlapping issues.
I simply wanted to give youu a quick hesds up!

Othewr than that, wonderful blog!
Bosch Ecu Tester Tool commented on 16-Sep-2018 07:00 PM
I visit every day some wweb pages and information sites
to rdad content,however this blog gives feature
based writing.
Lori commented on 16-Sep-2018 07:00 PM
Wow, stunning portal. Thnx ...

My web blog ... upgrading the head unit
Automotive Electronics Repair commented on 16-Sep-2018 07:00 PM
It is appropriate time to make a few plans for the longer term and it is time to be happy.
I have learn this put up and if I may just I desire to recommend you few interesting issues or advice.
Perhaps you can write subsequent articles relating to this article.
I wish to read even more things approximately it!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
bosch ecu simulators no download commented on 16-Sep-2018 03:44 PM
hi!,I like your writing soo a lot! share we be in contact
more about your pot on AOL? I need an expert in this area to unravel my problem.

May be that'syou! Having a look ahead to look you.
adidas eqt support adv commented on 16-Sep-2018 03:51 PM
The firm has a BIG BIG list of different types of footwear they've created.I
only know a pair that are Nike SB,Air Yeezy,Dunks,Air Jordan,Air Max,HyperDunk,Blazer and Cortez.I'm certain there are a lot of more that i have
never said but these are the one's i feels like the company has made at least
one hundred,000 completely different designs.
http://studentpower2012.org/ commented on 16-Sep-2018 04:09 PM
I'd like to thank you for the efforts you've put
in writing this site. I am hoping to see the same high-grade
content from you in the future as well. In fact, your creative writing abilities has encouraged
me to get my own website now ;)
Wilda commented on 16-Sep-2018 04:10 PM
After that's complete, he has to provide personal information, like address,
family background, telephone number, job details, and monthly salary details.
If you would like to spot a great agency from one that is certainly fake the English suited for the
site is easily understandable and possesses few grammatical
mistakes. It may seem a lot more like a company arrangement but,
my understanding is, one's parents will pick the best possible mate for their child and their judgment is unclouded
by hormones.
prescription without a doctors prescription commented on 16-Sep-2018 04:20 PM
That became a took related side few in great healthy Viagra also being forced
with ritonavir, and a day in between use of the optical multiple disparate.
Www lasvegas com prescription without a doctors prescription fridae.
The most effective side effects are:What is the pharmacy of Cialis vs.
Hye commented on 16-Sep-2018 04:35 PM
[/IMAGE]

Also visit my web-site; Eureka Bitcoin
Lena commented on 16-Sep-2018 04:42 PM
Thanks very useful. Will certainly share website with my good friends.


my website:driving in top gear
sarcoidosis doctor Database physicians commented on 16-Sep-2018 04:54 PM
Very nice write-up. I absolutely appreciate this website.
Thanks!
movie online stream commented on 16-Sep-2018 04:55 PM
wonderful publish, very informative. I wonder why the other
specialists of this sector do not understand this. You must continue your writing.
I am confident, you have a great readers' base already!
Christopher commented on 16-Sep-2018 05:01 PM
naturally like your website however you need
to test the spelling on several of your posts.
Several of them are rife with spelling problems and I to find it very bothersome to tell the truth
on the other hand I'll definitely come back again.
Edna commented on 16-Sep-2018 05:05 PM
A great deal oof bussinesses arre searching for brandable domain names.
Each year, 1000s of Russian mail order brides visit western countries by marriage.
If you would like to recognize a good agency derived from one of
that is fake the English used on the website is readily understandable and it has hardly any grammatical mistakes.

But they are certainly not always welcomed in to the lucrative professional jobs
they're suited for.
Columbus commented on 16-Sep-2018 05:44 PM
Thanks for the purpose of offering these fantastic details.


Also visit my web-site:types of accessories
Cliff commented on 16-Sep-2018 06:03 PM
Every day, countless domawin names are signed up.
Bernie commented on 16-Sep-2018 06:05 PM
1. InterNICis in charge of signing up domain.
safer.enjoyegypttravel.com commented on 16-Sep-2018 06:08 PM
Each year, thousands of Russian catalog shopping brides come to western countries by marriage.
This is no more true than when reaching a potential partner, the place that the way you say things will determine
whether you bomb or succeed. Even interracial, military
and also the disabled will find online dating services to be a more viable
option these days.
automated garment conveyor commented on 16-Sep-2018 06:22 PM
Greetings I am so happy I found your blog, I really found you by accident, while I was researching on Digg for something else, Nonethelsss I am here now and would just
like to say thank you for a fantastic post and a all round thrilling bkog
(I also love the theme/design), I don’t have time to go
through it alll at the minute but I have bookmarked it and also included your RSS feeds, soo when I have time I will be back
to read much more, Please do keep up the fantastic jo.
Hey! I know this is kind of off topic but I was wondering
which blog platform are youu using for this website?
I'm getting tired of Wordpress because I've had issues wih hackers
and I'm looking at options for anolther platform.
I would be awesome if you could point me iin the direction of a good platform.
Angelita commented on 16-Sep-2018 06:27 PM
I am in fact delighted to glance at this web site posts
which includes plenty off useful facts, thanks for providfing such data.
Ecu Test Stand commented on 16-Sep-2018 06:31 PM
WOW just what I was searching for. Came here by searching for auto ecu repair tools
german weather house barometer commented on 16-Sep-2018 06:33 PM
I like reading through an article that will make people think.
Also, thank you for allowing me to comment!
Ecu Remapping Software Download Ecm Titanium commented on 16-Sep-2018 06:57 PM
Greetings, I think your web sitte might be having internet browser compatibility issues.
When I look aat your blog in Safari, it looks finne but when opening in Internet Explorer, it's got some overlapping issues.
I simply wanted to give youu a quick hesds up!

Othewr than that, wonderful blog!
Bosch Ecu Tester Tool commented on 16-Sep-2018 07:00 PM
I visit every day some wweb pages and information sites
to rdad content,however this blog gives feature
based writing.
Lori commented on 16-Sep-2018 07:00 PM
Wow, stunning portal. Thnx ...

My web blog ... upgrading the head unit
Automotive Electronics Repair commented on 16-Sep-2018 07:00 PM
It is appropriate time to make a few plans for the longer term and it is time to be happy.
I have learn this put up and if I may just I desire to recommend you few interesting issues or advice.
Perhaps you can write subsequent articles relating to this article.
I wish to read even more things approximately it!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.