Machine Learning Times
Machine Learning Times
EXCLUSIVE HIGHLIGHTS
97 Things About Ethics Everyone In Data Science Should Know
 Every now and then an opportunity comes along that...
Machine Learning is Transforming Modern Healthcare
 The pandemic has propelled the adoption of innovation and...
It’s a Bird, It’s a Plane, It’s a Classified Flying Object
 How Computer Vision Is Used To Classify Objects. Featuring...
Overcoming the Explainability Challenges of Machine Learning Models
 Some History Machine Learning Models, which have historically been...
SHARE THIS:

2 weeks ago
Challenges of Comparing Human and Machine Perception

 
Originally published in The Gradient, July 6, 2020

Deep Neural Networks (DNNs) have become very successful in the domain of artificial intelligence. They have begun to directly influence our lives through image recognition, automated machine translation, precision medicine and many other solutions. Furthermore, there are many parallels between these modern artificial algorithms and biological brains: The two systems resemble each other in their function – for example, they can solve surprisingly complex tasks – and in their anatomical structure – for example, they contain many hierarchically structured neurons.

Given these apparent similarities, many questions arise: How similar are human and machine vision really? Can we understand human vision by studying machine vision? Or the other way round: Can we gain insights from human vision to improve machine vision? All these questions motivate the comparison of these two intriguing systems.

While comparison studies can advance our understanding, they are not straightforward to conduct. Differences between the two systems can complicate the endeavor and open up several challenges. Therefore, it is important to carefully investigate the comparisons of DNNs and humans.

In our recently published preprint “The Notorious Difficulty of Comparing Human and Machine Perception”, we highlight three of the most common pitfalls that can easily lead to fragile conclusions:

  1. Humans can be too quick to conclude that machines learned human-like concepts. This is similar to our tendency of quickly concluding that an animal would be happy or sad, simply because its face might have a human-like expression.
  2. It can be tricky to draw general conclusions that reach beyond the tested architectures and training procedures.
  3. When comparing humans and machines, experimental conditions should be equivalent.

Pitfall 1: Humans are often too quick to conclude that machines learned human-like concepts

Let’s start with a small experiment on yourself: Does the following image contain a closed contour?

To continue reading this article, click here.

One thought on “Challenges of Comparing Human and Machine Perception

  1. Pingback: Challenges of Comparing Human and Machine Perception – Machine Learning Times – machine learning & data science news – The Predictive Analytics Times – Machine.Vision

Leave a Reply

Pin It on Pinterest

Share This