Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Orval commented on 13-Feb-2019 05:51 AM
Hmm is anyone else experiencing problems with the images on this blog loading?
I'm trying to figure out if its a problem on my end or if it's the blog. Any suggestions would be greatly appreciated.

Feel free to visit my webpage team Building Retreat
Anibal commented on 13-Feb-2019 06:56 AM
Excellent blog! Do you have any tips for aspiring writers?
I'm hoping to start my own website soon but I'm a little lost on everything. Would you recommend starting with a free platform like Wordpress or go for a paid option? There are so many options out there that I'm completely overwhelmed .. Any tips? Appreciate it!

My homepage;Bob Tysoe Physician Marketing Specialist
4243.kqmj.net commented on 13-Feb-2019 07:07 AM
If yes, then you have to have played Shadow Fight.
Olive commented on 13-Feb-2019 07:14 AM
Hmm is anyone else experiencing problems with the pictures on this blog loading?
I'm trying to find out if its a problem on my end or if it's the blog. Any responses would be greatly appreciated.

Also visit my homepage :: London corporate training limited
Benito commented on 13-Feb-2019 07:19 AM
Hmm is anyone else encountering problems with the images on this blog loading?
I'm trying to figure out if its a problem on my end or if it's the blog. Any suggestions would be greatly appreciated.

My web blog ::Education connection lyrics
Brenton commented on 13-Feb-2019 07:51 AM
Hello there I am so delighted I found your webpage, I really found you by mistake, while I was looking on Google for something else, Anyhow I am here now and would just like to say cheers for a marvelous post and a
all round enjoyable blog (I also love the theme/design), I
don?t have time to look over it all at the minute but I
have bookmarked it and also added in your RSS feeds,
so when I have time I will be back to read
more, Please do keep up the fantastic b.
Jerilyn commented on 13-Feb-2019 08:18 AM
I truly enjoy studying on this internet site, it has got excellent articles.


My site ::Http://Yogakiddoswithgaileee.Com/
Karry commented on 13-Feb-2019 08:41 AM
Thanks so much for providing individuals with such a spectacular opportunity to read from here.

It can be so beneficial plus full of fun for me personally and my office peers to search your web site no less than three times weekly to learn the fresh tips you have got. And lastly, I'm so certainly pleased for the incredible suggestions served by you.
Certain 3 tips in this post are basically the simplest we've had.

My website ::restaurant world
Dermavix Anti Wrinkle Cream commented on 13-Feb-2019 10:09 AM
I do believe all of the concepts you've introduced in your post.
They are really convincing and will certainly work.
Still, the posts are very short for novices. May
just you please extend them a bit from next time?
Thanks for the post.
online cost forms commented on 13-Feb-2019 11:06 AM
hello there and thank you for your info – I've certainly picked up anything new from right here.
I did however expertise several technical points using this web site, as I experienced to reload the website many times previous
to I could get it to load properly. I had been wondering if your hosting is OK?

Not that I'm complaining, but slow loading instances times will very frequently affect your placement in google and could damage your high-quality score if advertising and marketing with Adwords.

Well I am adding this RSS to my e-mail and could look
out for a lot more of your respective exciting content.
Ensure that you update this again very soon.
Phenterage Garcinia side effects commented on 13-Feb-2019 11:20 AM
Hiya, I'm really glad I've found this info. Nowadays bloggers
publish just about gossips and web and this is really annoying.
A good website with interesting content, this is what I need.
Thanks for keeping this site, I will be visiting it.
Do you do newsletters? Cant find it.
Beulah commented on 13-Feb-2019 11:26 AM
My spouse andd I absolutely love ylur blog and find nearly all of your post's tto be precisely
what I'm looking for. Would you offer gueszt writers to write content in your
case? I wouldn't mind publishing a powt or elaborating on many of thhe
subjects you write regarding here. Again, awesome blog!
Mireya commented on 13-Feb-2019 12:02 PM
Very efficiently written story. It will be useful to everyone who employess it, as well as yours truly :).
Keep up the good work - i will definitely read more posts.

my web site ...Free Va Divorce Forms
Vivien commented on 13-Feb-2019 12:02 PM
Amazing blog! Is your theme custom made or did you download it from somewhere?
A design like yours with a few simple adjustements would really make my blog stand out. Please let me know where you got your theme. Cheers

Check out my page - how much does a divorce Cost in Virginia
Praltrix Male Enhancement Pills commented on 13-Feb-2019 12:12 PM
Hey there! This post couldn't be written any better!
Reading through this post reminds me of my previous
room mate! He always kept talking about this.

I will forward this page to him. Fairly certain he will have a good read.
Thanks for sharing!
SC A Cream UK commented on 13-Feb-2019 12:33 PM
Really good information can be found on web site.
Madeleine commented on 13-Feb-2019 01:20 PM
Hi there, just became alert to your blog through Google, and found that it is really informative.
I am going to watch out for brussels. I'll be grateful if you continue this in future. Lots of people will be benefited from your writing. Cheers!

my blog :: women relate
http://www.yuleweb.com/ commented on 13-Feb-2019 01:20 PM
Making use of an air impact wrench is truly extremely uncomplicated.
Arlen commented on 13-Feb-2019 01:45 PM
I like this post, enjoyed this one regards for putting up.
Micheline commented on 13-Feb-2019 02:10 PM
Hello! Do you use Twitter? I'd like to follow you if that would be ok.

I'm absolutely enjoying your blog and look forward to new updates.

Feel free to surf to my homepage ...how to file A divorce in california
https://หาเสี่ยเลี้ยง.com commented on 13-Feb-2019 02:26 PM
Brushless motors are sturdy for cordless wrenches.
Lilly commented on 13-Feb-2019 02:30 PM
Good � I should certainly pronounce, impressed with your web site.

I had no trouble navigating through all the tabs as well as related info ended up being truly easy to do to access. I recently found what I hoped for before you know it at all. Reasonably unusual. Is likely to appreciate it for those who add forums or something, web site theme .

a tones way for your customer to communicate. Nice task.

Also visit my web page ::locksmiths tampa
noocubepills.org commented on 13-Feb-2019 02:56 PM
You're so cool! I do not think I have read anything like this before.
So good to find someone with a few unique thoughts on this subject matter.
Really.. thanks for starting this up. This website is
one thing that is required on the web, someone with a
bit of originality!
buy Ecu Training commented on 13-Feb-2019 02:58 PM
I used to be suggested this website by way of my cousin. I am not crtain whether this put up is written bby hiim as
nobody else recognize such distinct approximately my problem.
You're wonderful! Thank you!
해적게임 commented on 13-Feb-2019 03:02 PM
Greetings from Florida! I'm bored to tears at work so I decided to
check out your site on my iphone during lunch break. I
love the information you present here and can't wait to take a look when I
get home. I'm shocked at how quick your blog loaded on my phone ..
I'm not even using WIFI, just 3G .. Anyhow, good blog!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Orval commented on 13-Feb-2019 05:51 AM
Hmm is anyone else experiencing problems with the images on this blog loading?
I'm trying to figure out if its a problem on my end or if it's the blog. Any suggestions would be greatly appreciated.

Feel free to visit my webpage team Building Retreat
Anibal commented on 13-Feb-2019 06:56 AM
Excellent blog! Do you have any tips for aspiring writers?
I'm hoping to start my own website soon but I'm a little lost on everything. Would you recommend starting with a free platform like Wordpress or go for a paid option? There are so many options out there that I'm completely overwhelmed .. Any tips? Appreciate it!

My homepage;Bob Tysoe Physician Marketing Specialist
4243.kqmj.net commented on 13-Feb-2019 07:07 AM
If yes, then you have to have played Shadow Fight.
Olive commented on 13-Feb-2019 07:14 AM
Hmm is anyone else experiencing problems with the pictures on this blog loading?
I'm trying to find out if its a problem on my end or if it's the blog. Any responses would be greatly appreciated.

Also visit my homepage :: London corporate training limited
Benito commented on 13-Feb-2019 07:19 AM
Hmm is anyone else encountering problems with the images on this blog loading?
I'm trying to figure out if its a problem on my end or if it's the blog. Any suggestions would be greatly appreciated.

My web blog ::Education connection lyrics
Brenton commented on 13-Feb-2019 07:51 AM
Hello there I am so delighted I found your webpage, I really found you by mistake, while I was looking on Google for something else, Anyhow I am here now and would just like to say cheers for a marvelous post and a
all round enjoyable blog (I also love the theme/design), I
don?t have time to look over it all at the minute but I
have bookmarked it and also added in your RSS feeds,
so when I have time I will be back to read
more, Please do keep up the fantastic b.
Jerilyn commented on 13-Feb-2019 08:18 AM
I truly enjoy studying on this internet site, it has got excellent articles.


My site ::Http://Yogakiddoswithgaileee.Com/
Karry commented on 13-Feb-2019 08:41 AM
Thanks so much for providing individuals with such a spectacular opportunity to read from here.

It can be so beneficial plus full of fun for me personally and my office peers to search your web site no less than three times weekly to learn the fresh tips you have got. And lastly, I'm so certainly pleased for the incredible suggestions served by you.
Certain 3 tips in this post are basically the simplest we've had.

My website ::restaurant world
Dermavix Anti Wrinkle Cream commented on 13-Feb-2019 10:09 AM
I do believe all of the concepts you've introduced in your post.
They are really convincing and will certainly work.
Still, the posts are very short for novices. May
just you please extend them a bit from next time?
Thanks for the post.
online cost forms commented on 13-Feb-2019 11:06 AM
hello there and thank you for your info – I've certainly picked up anything new from right here.
I did however expertise several technical points using this web site, as I experienced to reload the website many times previous
to I could get it to load properly. I had been wondering if your hosting is OK?

Not that I'm complaining, but slow loading instances times will very frequently affect your placement in google and could damage your high-quality score if advertising and marketing with Adwords.

Well I am adding this RSS to my e-mail and could look
out for a lot more of your respective exciting content.
Ensure that you update this again very soon.
Phenterage Garcinia side effects commented on 13-Feb-2019 11:20 AM
Hiya, I'm really glad I've found this info. Nowadays bloggers
publish just about gossips and web and this is really annoying.
A good website with interesting content, this is what I need.
Thanks for keeping this site, I will be visiting it.
Do you do newsletters? Cant find it.
Beulah commented on 13-Feb-2019 11:26 AM
My spouse andd I absolutely love ylur blog and find nearly all of your post's tto be precisely
what I'm looking for. Would you offer gueszt writers to write content in your
case? I wouldn't mind publishing a powt or elaborating on many of thhe
subjects you write regarding here. Again, awesome blog!
Mireya commented on 13-Feb-2019 12:02 PM
Very efficiently written story. It will be useful to everyone who employess it, as well as yours truly :).
Keep up the good work - i will definitely read more posts.

my web site ...Free Va Divorce Forms
Vivien commented on 13-Feb-2019 12:02 PM
Amazing blog! Is your theme custom made or did you download it from somewhere?
A design like yours with a few simple adjustements would really make my blog stand out. Please let me know where you got your theme. Cheers

Check out my page - how much does a divorce Cost in Virginia
Praltrix Male Enhancement Pills commented on 13-Feb-2019 12:12 PM
Hey there! This post couldn't be written any better!
Reading through this post reminds me of my previous
room mate! He always kept talking about this.

I will forward this page to him. Fairly certain he will have a good read.
Thanks for sharing!
SC A Cream UK commented on 13-Feb-2019 12:33 PM
Really good information can be found on web site.
Madeleine commented on 13-Feb-2019 01:20 PM
Hi there, just became alert to your blog through Google, and found that it is really informative.
I am going to watch out for brussels. I'll be grateful if you continue this in future. Lots of people will be benefited from your writing. Cheers!

my blog :: women relate
http://www.yuleweb.com/ commented on 13-Feb-2019 01:20 PM
Making use of an air impact wrench is truly extremely uncomplicated.
Arlen commented on 13-Feb-2019 01:45 PM
I like this post, enjoyed this one regards for putting up.
Micheline commented on 13-Feb-2019 02:10 PM
Hello! Do you use Twitter? I'd like to follow you if that would be ok.

I'm absolutely enjoying your blog and look forward to new updates.

Feel free to surf to my homepage ...how to file A divorce in california
https://หาเสี่ยเลี้ยง.com commented on 13-Feb-2019 02:26 PM
Brushless motors are sturdy for cordless wrenches.
Lilly commented on 13-Feb-2019 02:30 PM
Good � I should certainly pronounce, impressed with your web site.

I had no trouble navigating through all the tabs as well as related info ended up being truly easy to do to access. I recently found what I hoped for before you know it at all. Reasonably unusual. Is likely to appreciate it for those who add forums or something, web site theme .

a tones way for your customer to communicate. Nice task.

Also visit my web page ::locksmiths tampa
noocubepills.org commented on 13-Feb-2019 02:56 PM
You're so cool! I do not think I have read anything like this before.
So good to find someone with a few unique thoughts on this subject matter.
Really.. thanks for starting this up. This website is
one thing that is required on the web, someone with a
bit of originality!
buy Ecu Training commented on 13-Feb-2019 02:58 PM
I used to be suggested this website by way of my cousin. I am not crtain whether this put up is written bby hiim as
nobody else recognize such distinct approximately my problem.
You're wonderful! Thank you!
해적게임 commented on 13-Feb-2019 03:02 PM
Greetings from Florida! I'm bored to tears at work so I decided to
check out your site on my iphone during lunch break. I
love the information you present here and can't wait to take a look when I
get home. I'm shocked at how quick your blog loaded on my phone ..
I'm not even using WIFI, just 3G .. Anyhow, good blog!

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.org/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.