The Variability Problem in Face Matching
A face recognition system receives a stream of pixel values, not a face in any semantic sense. A slight change in lighting can alter hundreds of thousands of those values while the actual face remains unchanged. This is the core challenge: the input signal is highly sensitive to conditions that have nothing to do with identity. A photo taken in bright sunlight differs enormously at the pixel level from a photo taken indoors, even when the subject is identical.
Modern systems address this using deep neural networks trained on deliberately varied datasets, the same people photographed in many different lighting conditions, angles, and environments. This forces the network to learn features that survive variation, effectively separating surface appearance from structural identity. The result is much more robust than early systems, but not perfectly stable. Sufficiently different photos can still produce noticeably different top matches.
Lighting: The Biggest Source of Variation
Lighting is the single largest source of variation in face recognition results. Harsh directional light creates shadows that substantially alter the contrast map the network processes. A shadow across one side of the face can reduce apparent nose width, deepen apparent eye socket depth, and alter the apparent jaw angle. These changes shift the facial embedding toward celebrities with different geometric profiles.
Backlighting, a bright window or lamp behind you, is particularly problematic. It can reduce the face to a near-silhouette, eliminating the detail the recognition network depends on. Coloured lighting (neon signs, coloured gels, coloured walls reflecting onto your face) shifts skin tone values outside the distribution the network was trained on, further degrading embedding quality.
Read more: What Is Facial Embedding? The Technology Behind Celebrity Matching
Camera Angle and Lens Distortion
Camera angle is the second major source of variation. A face rotated even 15 to 20 degrees from front-facing appears different in the network's early feature layers, because the projections of three-dimensional facial structures change. Nose width and prominence, ear visibility, apparent jaw width, and chin projection all shift substantially with pose.
The lens used also matters significantly. The front-facing (selfie) camera on most smartphones uses a wide-angle lens that creates perspective distortion at close range, making the nose appear about 30% wider relative to the face than in a photo taken from 1.5 metres, according to a 2018 study in JAMA Facial Plastic Surgery. This systematic distortion shifts the embedding toward celebrities with wider noses and narrower jaws. Photos taken from further away, ideally about 1.5 metres with the rear camera, minimise this distortion and produce more stable embeddings.
Image Quality and Compression
Low-resolution images and heavy JPEG compression both degrade matching accuracy. A face that occupies fewer than 100 pixels of width in an image does not contain enough detail for reliable feature extraction. Compression artefacts, the blocky distortions introduced by high JPEG compression, add structured noise to the image that can resemble genuine facial features, shifting the embedding unpredictably.
Screenshots from video calls, images downloaded from social media (which apply heavy compression), and crops from large group photos are the most common sources of quality-related variation. Uploading the original, uncompressed file from your camera app produces the most reliable results.
Read more: The Best Photo for Celebrity Matching: A Practical Guide
Get new guides by email
Why Different Lookalike Apps Give Different Results
Even the exact same photo gets a different celebrity match in different lookalike apps. That isn't because one of them is broken. Each app makes four choices that change the answer: the model, the celebrity list, the photos of each celebrity, and the scoring rule.
The model decides which facial features count. Two networks trained on different datasets learn different ideas of what makes faces similar. Ollie's was trained from scratch on 5.8 million photos of about 85,000 people. Another app's model might weigh hairstyle or skin tone more, or less.
The celebrity list decides who you can match. An app can only return people it has indexed. One that lists 500 Hollywood actors will never match you with a K-pop star or a footballer. Ollie indexes more than 5,000 living celebrities, and our post on how the database was built explains how they were chosen.
The photos matter too. An app that stores one photo per celebrity matches you against that one image, lighting and angle included. Ollie stores up to 12 checked photos per person and scores each celebrity by their single photo closest to yours. Finally, the percentage is each app's own scale. An 85% in one app and a 60% in another can describe the same distance, so compare the ranking of results, not the numbers across apps.
How to Get Consistent Results
The conditions that produce the most stable facial embeddings are: even, diffuse lighting from the front; a front-facing pose with the camera at roughly eye level; the camera about 1.5 metres away (at least arm's length); and enough resolution, with the face at least 300 pixels wide. A photo taken near a window on a bright overcast day checks most of these boxes simultaneously.
If you upload multiple photos and receive different top matches, look at which conditions differed. Consistent results across different photos indicate strong geometric similarity to a particular celebrity. Shifting results often indicate that different photos are emphasising different features due to lighting or angle, each photo is pulling the embedding in a slightly different direction in the feature space.