Using Face Detection
Talk to Rico (open forum for questions & feedback) – Rico’s Flickr sets – Expanded XQ1 Sample Images Set – Expanded X-E2 Sample Images Set – X-E2 AF tracking samples – Mastering the Fujifilm X-Pro1 reading samples (65 free pages) – Order my NEW book (print or DRM-free eBook/PDF): Mastering the Fujifilm X-E1 and X-Pro1 (use code FUJISAVES30 to save 30%!)
Fujifilm kindly delivered the LMO and PDAF upgrades for most of the X-Mount lenses a day earlier than expected, and they have also fixed the manual focus glitch in firmware 2.00 for the classic X100. I am looking forward to read about your first impressions with the X-E2 (and XQ1) using the new hybrid tracking autofocus.
If you need assistance upgrading your camera or lens firmware, you might find this article helpful. Sadly, there’s still no word if or when Zeiss will issue similar firmware updates for their X-Mount Touit lenses.
In Your Face!
Face Detection has always been available in most of Fujifilm’s “consumer” cameras. Among others, you can find this feature in the X10, X-S1, X20, XF1 and XQ1, and now also in the X-A1, X-M1 and X-E2. Face Detection is also available in combination with the tracking autofocus feature of the XQ1 and X-E2. This means that you can use Face Detection along with AF-C (in either single shot or low-speed burst mode) to keep the face of a person in focus while this person is moving left or right, or towards or away the camera.
While the hybrid PDAF/CDAF (combining on-sensor Phase Detection Auto Focus with on-sensor Contrast Detection Auto Focus) allows the camera to focus faster on a subject, Face Detection has to rely mostly (if not entirely) on the camera’s CDAF, because in many real-life situations, the face the camera is locking on will not be fully located inside of the nine central AF frames (the area that is equipped with PDAF pixels).
PDAF helps the camera establish and lock focus faster, but it’s not mandatory to enable autofocus tracking. Just think of the Olympus OM-D EM-5, which doesn’t have PDAF, but still offers fast AF and subject tracking capabilities. Your X-E2 and XQ1 can do this, too: Both cameras can track subjects with any of their 49 AF frames, not just the nine central ones (aka those with PDAF pixels).
In addition to selecting one of the camera’s 49 AF frames, you can also set the X-E2 and XQ1 to track subjects using Face Detection. Click here to access a private Flickr set that illustrates both standard AF tracking (pre-production 23mm lens) and Face Detection AF tracking (pre-production 50-230mm lens) with a pre-production X-E2.
Wait, There’s More!
While most users will immediately understand how Face Detection and the camera’s autofocus work hand-in-hand, some may not realize that Face Detection also influences the exposure metering of the camera. To illustrate this, let’s have a look at an example.
Here’s a straight-out-of-camera (SOOC) JPEG taken with Face Detection. I used Auto White Balance and the Pro Neg. Hi film simulation, which delivers natural skin tones. I took the shot with a pre-production sample of the new XC50-230mmF4.5-6.7 OIS telephoto zoom lens.
I didn’t have to apply any exposure correction, as the X-E2 automatically adjusted the exposure to the detected face. This is also why only multi metering (not spot or average metering) is available when the Face Detection feature is turned on.
So what happens when the Face Detection feature loses track of a face, or when the feature is manually turned off? In this case, the same shooting situation will play out like this:
Again, no exposure compensation was applied, and as you can clearly see, the camera is now overexposing the scene because its multi metering isn’t concentrating on the face and skin tones, but on the entire scene.
Luckily, nothing was lost in this particular case. I could salvage the image by reprocessing it with the X-E2’s built-in RAW converter, pulling the exposure down by 1 EV:
The reason why this worked so well is that the X-E2 (which was set to DR-Auto) selected DR200% for this shot, so it was “underexposing” the RAW by 1 EV and applied digital gain during JPEG processing. I simply took away that gain with the RAW converter’s push/pull function. Click here to learn more about options to expand a shot’s dynamic range.
Of course, there’s a lesson to be learned by these examples: Keep in mind that Face Detection will influence the camera’s exposure metering! This is a nice feature as long as the camera detects a face, but it can become tricky when it fails to do so. When Face Detection is losing track of a face, the exposure metering will revert to standard multi metering.
Relax! In many situations, the difference will be less pronounced. I obviously chose a rather drastic scene that illustrates the effect very clearly.
It’s worth knowing that Face Detection works in video mode, too, where it also influences focusing and exposure metering based on whether a face is detected or not. Of course, these observations not only apply to the X-E2, but also to the X-M1, X-A1, XQ1 and other Fuji cameras with built-in Face Detection.
Improving Face Detection
While automatic exposure adjustment based on Face Detection may be beneficial to most if not all “consumers”, I can imagine that photographers who belong to the “enthusiast” or “professional” crowd would prefer to have an option that allows them to choose whether Face Detection should influence both focusing and exposure metering, or only focusing without exposure metering.
With the “focusing only” option enabled, the camera could allow the use of either multi, spot or average metering in concert with Face Detection. I have already asked Fuji to add such an option in a future firmware upgrade. I image you’ll agree, but feel free to express your thoughts about this matter in the comment section of this article.
Another Face Detection quirk: The camera always reverts to the central AF frame when no face has been detected, or when the camera has lost track of a face. Instead, I would much prefer the camera to revert to a user-selected AF frame.
A related quirk is this X-E2’s inability to toggle Face Detection with any of its four Fn buttons or the Quick Menu. You have to navigate to the second entry of the fourth tab of the shooting menu to switch Face Detection on and off. I have asked Fujifilm to add Face Detection to the list of Fn button function choices.
For your convenience, here’s a TOC with links to my previous X-PERT CORNER articles:
- First Look: Fujifilm XQ1
- PDAF & LMO Lens Firmware Updates Coming in November
- First Look: Fujifilm X-E2
- How Fuji could save the X-M1
- X-A1 vs. X-M1: Photo Ninja Edition
- X-A1 vs. X-M1: the Shootout
- Using the Fujifilm X-A1 [& X-M1]
- First Look: Fujinon XF23mmF1.4 R
- RAW Converter Shootout Results
- Ultimate RAW Converter Shootout
- First Look: X-M1 with New Kit Zoom and Pancake Lens
- Zeiss Touit vs. Fujinon XF
- Remote Shutter Control for X Series Cameras
- Apple Camera RAW, X-Trans and EXR
- First Look: XF55-200mmF3.5-4.8 R LM OIS
- Studio X
- Using the X100S
- Using the X20
- X100S vs. X100
- X20 vs. X10
- RAW, JPEG, Silkypix and “Fuji Colors”
- Adapting Third-Party Lenses (updated with Speed Booster)
- RAW for JPEG Shooters…
- Tips for Updating your Firmware
- How to Clean the X-Trans Sensor
- Using the XF14mmF2.8 R
- Decoding XF18-55mmF2.8-4 R LM OIS
- Comparing RAW converters: JPEG vs. Lightroom, Capture One, Silkypix & RPP
- XF14mmF2.8 R appears to be almost distortion free
- How to Expand Dynamic Range
- How to Use Extended ISO
- EXR, anyone?
- Capture One – When the Going Gets Tough…
- Using Shooting Profiles and the Quick Menu
Rico Pfirstinger studied communications and has been working as journalist, publicist, and photographer since the mid-80s. He has written a number of books on topics as diverse as Adobe PageMaker and sled dogs, and produced a beautiful book of photographs titled Huskies in Action (German version). He has spent time working as the head of a department with the German Burda-Publishing Company and served as chief editor for a winter sports website. After eight years as a freelance film critic and entertainment writer in Los Angeles, Rico now lives in Germany and devotes his time to digital photography and compact camera systems. His book “Mastering the FUJIFILM X-Pro1” (Kindle Edition) (Apple iBook Store) (German version) is available on Amazon and offers a plethora of tips, secrets and background information on successfully using Fuji’s X-Pro1 and X-E1 system cameras, lenses and key accessories.
85 Responses
Nice read, and it’s very informative Rico…thanks!
Good report Rico, Now that the baseline is more or less established, I just hope Fuji concentrates on performance does not start adding features of dubious value (face detection is borderline dubious) that make the cameras cluttered complicated to operate. This deal with Face detection & view mode being menu options only is case in point.
One of the things that attracted me to the X-E1 & X-Pro1 system was it’s relatively (if not quirky) simplicity. With most of the controls one would use readily available. View mode is one I use a lot.
Thanks, Rico, for the informative piece.
Looking forward to future X-Series cameras with this, and other improvements. If Fuji smashes it out of the park with its upcoming cameras (hopefully X-Pro 2 or something just as inspiring), I will definitely purchase more lenses in early 2014 ~ holding out to see what they will have on their plate. Currently, on my X-Pro 1, I am still using the Canon EF-S 10-22mm, for ultrawide (works very well, I must say), EF 100mm f/2.8L IS for macro, and EF 70-200mm f/4L for telephoto. Of course, I have the 35mm f/1.4R and 60mm f/2.4R for regular use, but I am still impatiently waiting to see what Fuji’s next move will be. I am hopeful, it will be impressive…
If they provide an excellent option for an upgrade from the X-Pro 1, I will buy it, and I will definitely by the 14mm (or 10-24mm), the 56 f/1.2, and perhaps the 55-200mm (rather have a 90mm f/2 and a 135mm f/2, if Fuji will make them). Until then, I will keep my money…Though a firmware upgrade for the X-Pro 1 with “minimum shutter speed settings in auto ISO would likely keep me happy as well…
i think view mode should be separated for shooting and reviewing/menu
i need the EVF to compose only. i need the LCD to review and use the menus.
i don’t like the idea that my preferences for shooting and reviewing will be the same.
the current situation is that when using EVF only or EVF+eye sensor, the menus and image review are all in the EVF as well. A menu on the EVF to me is an extreme use case.
my preferences would be EVF with eye sensor for shooting mode and for image review or menu to use the LCD.
I agree! EVF is for framing, LCD for reviewing and menus.
And who told them to remove the View Mode button on the X-E2??? Listening to which customers?
I agree.
A mixed mode evf to compose and lcd for playback is the solution
Thanks Rico! Is the FD also active with manual set aperture? Sony does only allow FD with automatic mode.
In all PASM modes.
Rico,
I’m curious to know if X20 has the same behavior related to quirks you found in FD.
All cameras with FD seem to work the same, but except for the X-E2, FD is an Fn button option.
Great article again Rico! I wonder how much of the Fuji hype is actually based on your excellent work. Such an professional explanation of a manufactures system does not every manufacturer have. Fuji benefits from your work a lot, also financially! I hope they know it. And i hope you benefit too! (Haven’t a X-system camera yet. But I will buy your book of course if I get one). I would even say, that a lot of the X-quality is based on your honest, critical and very professional work. I like that! Wonder how products would look like, if companies would only have people like you 😉
You are too kind. As a matter of fact, I spent most of yesterday meeting managers and product planners from Tokyo, giving feedback on the X-E2 and other cameras. I have just emailed a 7 page long meeting summary, so yes, I’m always trying to help improving the products for all of us.
Hi Rico, first, thank you for your constant dialogue with Fuji to achieve improvements for all of us! Just wanted to let you know, that I also sent a little inquiry to Fuji yesterday concerning improvement/extension of WIFI App features..
Very good, everybody should write their suggestions to Fuji. The more, the merrier.
Remote control via wifi is definitely a hot item for a firmware upgrade.
..forgot something, eye detection instead or better additional to FD like omd would be nice, what do you think?
Why not? Mail it to Fuji!
done 🙂
Hi Rico,
why are the examples for face detected AF done with an old russian manualfocus lens ?
RegH
Wow – now that´s invention only Fuji could achive!
Fuji even got that Helios 44M to use face detection af 😉
No, but it FS still modifies the exposure when using adapted MF lenses. Just make sure the camera remains in AF mode. You still have a magnifier now in AF mode.
Yep, FD works with MF lenses, too, which is pretty clear from the article, as it influences AF and metering. The metering part remains, of course.
I can’t find any FD examples with this lens, only examples showing the Russian lens (as outlined in the Flickr description). But as mentioned, FD works with MF lenses, too (the metering part).
Unfortunately not when you are in MF mode to take advantage of the focus peaking feature 🙁
Yep, it’s not intended as a pure exposure feature, it’s coming from the compact P&S cameras. That’s also why they never thought of decoupling AF and metering in this feature. But now, with AF-C and burst mode, it makes sense to decouple it, because in a burst of (for example) 8 frames, the camera migt recognize a face in 5 of them but not in 3 of them in-between. In this case, the camera keepe changing the exposure between shots due the FD influencing the metering. This is pretty bad, as you’d definitely want to have exposure consistency in a burst. So Fuji really has to fix this IMHO in order to make the feature more useful to enthusiasts and advanced cameras with tracking AF like the X-E2 and even XQ1.
Rico, do you – or anyone else here – know when Lightroom will be able to edit raw files from the X-E2? If I have to wait half a year or one year for Lightroom support there’s no need to rush out and buy the camera – tempting though it is.
(Yes, I know there are other raw editors, but I prefer working with Lightroom. It handles the X-E1 raw files good enough for me.)
You would have to ask Adobe.
Well, here it is! 🙂
http://www.fujirumors.com/lightroom-5-3-rc-with-support-for-xq1-and-x-e2/
Yep, at least the beta version.
I just really wish Fuji would add face detection af to x100s!
It’s a possibility, but OTOH, Fuji used to get feedback from purists who said that they don’t want to have practical functions like FD in the X100. They also complained about the existence of art filters in the camera.
Thanks a lot for the info, Rico.
As I mentioned in an earlier posting, I found that the eyes are out of focus in quite a number of shots (as of now, 30-50%) using face detection. I upoaded a sample:
http://www.flickr.com/x/t/0098009/photos/flesix/10741798273/
As you can see, the ear is in focus, but the front if the face is not.
So is the Fuji-FD really focussing on the eyes? If so, how come, that you can get results like the one above?
Minimal Movement of target or photografer after the af-lock? easy to move an inch…
If it was the only instance, I’d consider this. But I can also pretty much rule it out for this particular image, because I deliberately shot it for reviewing this behaviour particularly after discovering it the night before.
I haven’t had such problems, so far. If you keep having them, write to Fuji and include samples, so they can improve the function.
And BTW, the exposure metering implemented with the PD is really really helpful!
I’ve always missed a center weighed exposure metering I used almost exclusively with my DSLR which always worked fine for faces (as long as they covered an adequate portion of the frame) and I needed to fiddle around a lot more with exposure compensation in my X-E1 to compensate for not having this. But with the FD exposure metering, I’m totally happy again 🙂
1. i’d like to be able to turn FD on/off on a function key. ive had my X-e2 for 2 days and it doesnt seem to let you do that.
2. i still dont understand why the macro button jut doesnt toggle macro on and off. why do i have to press macro then switch it from off to on?
3. as someone who has written and published iPhone and iPad apps – has anyone of fuji mentioned making the camera API public so third parties can write apps for it? – id love to write an app that controlled my camera and added functions.
Re 2: +1
double-click the macro button to “toggle”, like explained in my book.
a good tip thanks but they could still make it one press not two.
Some cameras have more than one macro mode, Fuji wants to keep it consistent.
Oh – ok – i didn’t know that – that makes sense at last! Thanks.
ok other comments after another 24 hours of playing.
1. I had an X100 and I miss the fact i could get to the flash settings from the command dial. now i have to route through the menus.
2. i also miss the display button – from the x100 – ok there was a OVF too but on the back i could change from OVf eve lcd. now i have to route through menus.
as previous – i think more needs to be assignable to a function key.
3. im not getting the custom functions settings at all – is it meant to work like this. I’ve setup a b&W profile in C1. i use the quick menu to go to it – great. i then want to use the quick menu to switch back to what i had before and – no can’t the basic menu is now the same as the C1 menu. weird! should it allow me to go back to what i was before? i understand i can now setup a basic profile and choose that but id like to just revert to previous – is it me?
thanks for your great comments and time. are you going to update the book for the xe-2? if not ill get a copy of the existing one.
You might want to read my very first column here on FR. 😉
Never used face detect focusing before on a camera. Do you find it useful in “real life”? I agree with your “suggested improvements”, and I’m glad you have Fuji’s ear.
Now that you have PDAF updates on the lenses, will you be writing more about that? I’m excited to see what changes, if any, these updates will bring to the X-mount system. I’m on the ledge about the X-E2, but I also suspect I might wait for the rumored “high end” X-mount camera.
Love my X-mount bodies so far, the only thing I’ve wanted is some real world focus improvement, especially in low light and/or with moving subjects.
If FD is in the x-m1 and x-a1, they should be able to add it to x-e1 and x100s, right? Hopefully Fuji keeps up their track record of firmware updates to older cameras.
X100S might be able to get it, X-E1 and X-Pro1, probably not due the slower processor, but nobody know for sure.
Hi Rico, I would like to see the selecting of AF box simplified. I have the XE-1 and it takes too long I feel to get to the correct box. On my Canon I always just focused and reframed but it doesn’t seem to work so well on the Fuji I find. Do you always move the box? Do you think a firmware update could change the way you have to move the AF box?
I usually move the frame, and I find it pretty simple as it is now. I wouldn’t know a way to simplify it w/o losing the macro button, one of three Fn buttons, program shift and the ability to set intermediate shutter speeds.
It would be faster to move the af box only with the arrows/ pad when zoomed to check focus.
With canon, in liveview i often move around the zoomed portion, to check focus in different parts of the image.
If would be really faster …
I agree, that would be a nice addition, now that the X-E2 actually allows zooming in AF mode.
Yes, but even in MF.
In studio or in architectural shot i use it a lot.
Acually with my X-pro1 i hav do dezoom, change af point, zoom again, tht’s really slow.
Yep, since the selector keys are currently unassigend in magnifier mode, this should be possible. Please write to Fuji and explain it to them. I will also include it in my next feedback.
@Rico
Please ask Fujifilm also to make it possible to put the view mode to any of the 4 fn buttons! The xe1 had an extra button, now its hidden deep in the menu and (i think i’m right) by now no ability to use it with the fn buttons 🙁
Already done. But you still have to write directly to Fujifilm yourself. Otherwise, they won’t believe me when I tell them that users actually want this.
Rico, do you have a particular contact / email at Fuji to which we best address our suggestions?
It’s best to email it to your regional office.
Rico, do you have a particular contact / email at Fuji to which to best address our suggestions?
Done 🙂
Rico, your SOOC JPEG file metadata show they were saved with Aperture 3.5 and report a focal length of 58mm from a 58mm f/0 lens.
Yes, the images that were taken with a 58mm lens show 58mm in the EXIFs. That’s because I programmed the adapter menu to 58mm. Of course, there’s no aperture in the EXIFs, the cameras can’t know it, it’s operating in Shoot Without Lens Mode with adapted lenses.
Xe-2 do support a predective af when using pdaf?
And now, it’s possible to shoot without refocus, when keeping the shutter button half pressed, after a shoot?
I think you can use AF-lock button to lock focus, don’t you?
I don’t have my X-E2 yet. it’s in pre-order at B&H… just wondering.
Yes , you can, but 1 button is better than 2.
And all the camera i have work half pressing the shutter button, whitout refocus.
That’s really easier and faster than af-l or switch to MF
In that respect, the X-E2 behaves like the X-E1 unfortunately.
ouch :/ thanks
I doubt that the AF is predictive. It is hybrid PDAF/CDAF, though. In AF-C, the camera keeps moving objects under the active AF frame in focus while the shutter button is half-pressed. Exposure is locked, too. In AF-S, exposure and focus are locked, as usual. You can also separately lock exposure and focus with the separate AF-L and AE-L buttons.
i doubt too that AF is predective,
but looking at this comparison page fuji say it is
http://www.fujifilm.com.au/blogs/digital-photography/bid/190035/Key-Differences-Between-the-Fujifilm-X-E1-X-E2
i suspect that’s wrong.
That thing in page 4 of the shooting menu is the pre-AF.
Thanks Rico! Good info to have. Any chance face detection can be implemented on the older bodies?
Btw, I have added several new full-size SOOC samples with LMO from a production X-E2 to my Flickr set.
Dear Rico !
If it is possible please tell Fuji that X100S owners really need Face Detection too.
Overexposure mistakes on faces is a huge challenge for us.
Yes, it is, but you should also write to Fuji yourself to make it count.
Rico – what address should we send our suggestions to Fuji? I searched on their website but couldn’t see an appropriate one and fear it wouldn’t be read if not sent to the appropriate department.
I recommend the regional office in your country.
Rico,
I am experimenting with Face Detection on and autofocus mode set to Multi simultaneously. When street shooting it seems to give a Multi focus point if a face isn’t recognized in the frame. What do you think, is this OK?
That’s normal.
It is so stupid X-E2 can’t toggle face detection with Fn buttons which X-M1 is can !
and why can’t save to c1 – c7 which X-M1 can save to C mode
Fuji please make it simple, toggle face detection with “exposure metering” menu
why exposure is locked In AF-C while the shutter button is half-pressed too, they should fix the problem, I can AE-L to lock the exposure if i want to.
Hi Rico, Has Fuji fixed the need to restart the flash manually after the camera is awakened with the shutter button? I have the EF-X20 which shuts off (does not just sleep) after the camera goes to sleep … really a pain. Any information on that issue?
Henry
Hi Rico I just received my new X-E2, and saw immediately that Face detection should be (de)selectable via a Fn button or in the Q menu’s.
But another possibility should be to use the macro button therefore. Normally when you do portrait, you don’t need macro. So giving the possibility to the macro button to toggle between Macro and Face detection should will avoid to sacrifice an Fn button therefore.
Interesting idea. Of course, FD also works in MF mode, while Macro does not, which is a potential conflict. Also, other X cameras have 2 different macro modes, so the number of selections increases. But it’s definitely an option to think about!
My idea was just to use this button to switch FD ON or OFF, instead of having to walk trough the menu’s, I don’t see why there could be a conflict.
When can we expect to see the new X E2 book
Re your comment:
“Another Face Detection quirk: The camera always reverts to the central AF frame when no face has been detected, or when the camera has lost track of a face. Instead, I would much prefer the camera to revert to a user-selected AF frame.”
I would prefer that the camera revert to the last AF point where it lost the face detection, because it probably means the person turned their head sideways temporarily, and I wouldn’t want the head to suddenly go out of focus just because the person’s face isn’t showing anymore.
face detection was the reason i didn’t take xe2 and took a 70d instead.
i will wait for xe3 and see if the FD works accurately and fast.
Face detection on the x-e2 is completely useless, because it does not focus on the nearest eye, as it should. Instead it focuses randomly on any part of the face. They have just ported the primitive algorithm of their point-and-shot cameras to the x-e2. With a high-quality camera like the x-e2 one would expect something else.