Facial recognition technology is upon us; phones and computers can be unlocked with your specific facial structure using this gimmick, but it can also scarily be used to identify you from security cameras, which are increasingly becoming omnipresent. As a matter of fact, Australian governments have been actively pushing for the implementation of this technology with what The Guardian calls “creative reasons” such as public transport payments and government rebates.
But what about the implications of this technology in healthcare? From better diagnosis of rare conditions to ethnic discrimination, will it revolutionise the healthcare system or be the harbinger of a Black Mirror-worthy reality? We’ll analyze these questions and more in this article as we guide you through the basics of this hot technology and its potential implications and ethical challenges lying ahead.
What the FRT?!
FRT, short for facial recognition technology, is a method used to identify a person based on their specific facial features like bone structure and skin texture. Its functional algorithm relies on existing databases which it dives into to compare those features in order to output a result.
Such software has been in use to identify law offenders or to visualise how missing children might look like as adults but not really in the healthcare sector, that is until recently. This is because with time FRT became more sophisticated (thanks to a larger database of faces) and accessible (your phone has it!), and is now becoming increasingly attractive in medicine thanks to the numerous ways it can be implemented in this sector from cutting down on paperwork to helping physicians in diagnosis.
From Facebook picture-tagging to identifying rare genetic conditions: how can FRT benefit healthcare?
Do you know how Facebook or your mobile prompts you with suggestions about people to tag in a photo? This is a prime example of FRT in action – the software can identify someone based on their unique facial features. Now imagine going to your local hospital in the near future for that sore throat that has been bothering you for over a week.
Instead of going through the waiting lines for administrative purposes, a virtual assistant will scan your face in a matter of seconds and assign you to your doctor. In so doing, the algorithm can even detect other irregularities like signs of depression and will inform your doctor of such a possibility.

Such applications are far from being mere products of the mind. An oft-cited example is Face2Gene, an app used by clinicians that can detect rare genetic conditions like Cornelia de Lange syndrome, where patients have characteristic facial features which can be missed by physicians because they simply might not have come across it during their clinical practice.
This was the case with Omar Abdul-Rahman, a medical geneticist, who, thanks to the app, recommended the family of a three-year-old boy that they order a specific genetic test for Mowat-Wilson syndrome, which returned positive. “If it weren’t for the app I’m not sure I would have had the confidence to say ‘yes you should spend $1000 on this test,” Rahman told the online outlet Leapsmag. This saved the family from making further expenses which might not have correctly identified the condition and would have further delayed the appropriate care that the young boy required.
In a study, the deep-learning algorithm DeepGestalt, which powers Face2Gene was shown to outperform clinicians in diagnosing syndromes like Noonan syndrome. DeepGestalt even correctly identified conditions in its top ten list 91% of the time. “It’s like a Google search,” the study’s co-author Karen Gripp tells Nature. With such a high success rate and the ease of using the app, such a comparison is not far-fetched.
What about the future of healthcare?
It wouldn’t even be worthless to speculate what this technology could lead to or do in the future. Below are our top 5 potential and highly anticipated uses of FRT in healthcare in the (near?) future:
1. Smart mirrors
“Mirror, Mirror on the Wall, Am I Healthy?” Asking your mirror this question might soon be possible. By combining FRT into a seemingly simple mirror with a built-in camera and existing technologies like SkinVision’s skin analysis and Nuralogix’s transdermal optical imaging technique to measure blood pressure and stress level, a quick scan can reveal a lot by simply looking at your own reflection (or by asking your mirror!). Such a smart mirror could advise you to get that new mole on your cheek checked, recommend meditation in case your stress level is higher than usual and refer you to your doctor if there are any abnormal fluctuations in your blood pressure.
2. Care for healthcare professionals
More than just for patients’ health, FRT can also be used for the wellbeing of healthcare practitioners themselves. Medscape’s 2022 report found that 47% of physicians feel burned out, 64% were colloquially depressed and 24% suffered from clinical depression. These can be identified via facial analysis and subsequently addressed, like suggesting stress-relieving measures like yoga or even vacations, before they further affect the health of healthcare providers.
3. Looking for mischief
The applications of such technology can further be adapted to other areas within the healthcare system. For example, unlawful people like insurance imposters, drug seekers and criminals can be easily identified from a given database and dealt with accordingly.
4. Touchless access control
Access control will probably become the most typical use of facial recognition technology: it limits surface contact (and thus disease transmission) while allowing accelerated admission to office buildings, and can be used in many work-related areas: allowing dedicated team members to enter departments, operate turnstiles, or access other entry points with their face. As face recognition was developed to identify users even with a face mask on, it can be a valuable ally in pandemic situations.
5. Mask detection
Facial recognition systems are also capable of recognising people not wearing / not properly wearing a mask in a setting where it is mandatory, and notify the person, or the authorities if necessary.
Does the ‘F’ in FRT stand for friend or foe?
The answer to this question is: it depends on who you are. While using FRT for aiding in identifying medical conditions and providing a safer work environment is laudable, the worrying implications of the same seemingly benevolent technology are manifold.

As the technology picks up steam and gets used more widely by clinics and physicians, the increasing amount of biometric data collected will present a real responsibility for those in its possession. Advertising companies would jump on this gold mine and make offers that many can’t refuse. Hackers will find new content to hold hostage and ask for ransoms. With greater amounts of personal data comes greater responsibility.
The healthcare system will have to double down on its efforts to securely store them and adhere to privacy protection rules like the Health Insurance Portability and Accountability Act (HIPAA), which protects “full-face photographs and any comparable images” and offers the standard for de-identification so that such “health information is not individually identifiable”.
The inherent bias in databases
Even with tightly controlled security over those data, the database itself might be put into question. As we discussed extensively in this article, the AI behind such technology as facial recognition isn’t immune to human-induced bias. We identified three main reasons behind biased algorithms namely judgmental data sets, deeply ingrained social injustices and unconscious or conscious individual choices. These can subsequently affect the results of diagnostic methods relying on FRT by discriminating against patients based on their sex, ethnicity and even their accent.
Even though facial recognition technology has shown impressive usage in healthcare, it still needs to be worked on to be a must-have tool for every physician. It’s just not there yet. It’s one thing to have a wide database to be able to identify conditions from but it’s another to have one which is representative of every human being, irrespective of their background. While definitely a challenging goal and one that will involve complex processes and years of hard work, isn’t this an ideal that we should aim to achieve?
The post Your Guide To Facial Recognition Technology in Healthcare appeared first on The Medical Futurist.