Jump to content

Processing X-Trans with Photo Ninja


FrankF asked if I could write up something about processing X-Trans raw files, noting that his usual adjustments for NEF files didn’t work with RAF files.

Straight off, and despite much dismissive hand waving by those who would use Adobe Lightroom or Camera Raw to process their files regardless of any opinion as to the quality of the end result for X-Trans files, I can only say that I’ve tried ACR at every update until CC Rent-a Shop came into play and the results, while tinkered with substantially about the edge, were still nowhere near as good as processors using Dave Coffin’s dcraw algorithms for the X-Trans demosaic.

So the following will not be for Adobe users as I don’t use LR/ACR for X-Trans. Ever.

As Frank uses Photo Ninja (as do I), I’ll run through what I do to convert X-Trans raw files using that program. This is just how I use it, I'm not suggesting it is gospel. :D I really like the results I get this way, so I guess that's what really matters to me - your needs might vary.

For whatever reason the folk at PN did individualise their program by assigning names to sliders that are not common in their effect to more conventionally consistent names in other makers’ programs. This isn’t really a problem once familiarity is gained, but can be confusing at first.

Here’s the image I used as Photo Ninja presented it straight from the demosaic. I used this image because it has fine detail, the highlights are overexposed, and there are many fine and small colour gradations - plus the folder was open on the computer anyway :) . As a photograph it isn’t anything much, but as a taxing of the demosaic it perhaps is.

OIYRH3u.jpg

The following is how I have found it best to use the controls - this might differ from any “official” instructions, but hey, whatever works....

Note that when you're working in any panel, clicking on the ◄► icon under the sliders (highlighted in screen grab below)will show the unprocessed image, releasing will show the processed image concerning that panel. After exiting one of the control panels for the overall menu, clicking on them will show the unprocessed image, releasing will show the processed image including all panels adjusted so far. So at any time you can flick back and forward between processed states without having to hunt all over the screen for a preview box to tick or un-tick.

Here’s a screen grab at 100% of the image as opened, along with clipped highlight indicators:

TNcAUPa.jpg

So here’s the PN controls panel as it has opened an un-worked image with default settings:

lainPBI.jpg

Starting at the top, and the first hurdle which had me stumped for a long time when I first used this current version of PN (and which took an email to PN support to get an answer) is the “Color correction” menu.

Misleading, because in it is the slider that controls what everyone else calls "Highlight recovery" but has been called “Color recovery” in PN. Further confusion is caused by the fact that its default setting is strength 100. At this setting PN will fill any blown highlights with an aggregate colour from the surrounding un-blown area, which can sometimes look awful, even taking on a solarised appearance.

The Color correction panel:

haFHwAo.jpg

I have changed that default number to 50 in my prefs, which I find a better overall beginning setting for my files, but that might vary according to your shooting style. Whatever, it is something to be aware of.

On the whole PN and Fuji together seem to do a good job on colour balance, but if there’s a lot of green in shot you’ll probably have to do a custom WB and knock excessive magenta compensation out of the default. I didn't mess with WB in this case, though, although it could be improved a bit I suppose. For comparison purposes I also thought a constant WB might be more useful. I would have warmed it up, although in this case the cool tone serves to locate the scene on the cusp of winter during a cold (6°C) day rather effectively.

Next in the main panel is the primary adjustment menu - “Exposure and detail”.

These are the settings it opened the sample image with:

rq0f27q.jpg

As can be seen, there’s a bit going on at the right of the histogram that’ll need hauling into line (clipped highlights indicated with the red line).

The first thing to keep in mind is to try to work from the top down in this panel. The Illumination and Exposure offset sliders directly affect one another and should be worked in concert, keeping an eye on the highlight clipping indication in the preview image as well as watching the histogram. In this case in order to haul the highlights back it will be necessary to further reduce Exposure, then return the image to its original overall brightness with the Illumination slider. (If the image is underexposed to the left of the histogram, then the opposite movements of these two sliders will be required, and contrast increases in that case).

zudh180.jpg

As can be seen, the image no longer spills to the right, and the histogram light tones are a bit more centralised and the clipped highlights are recovered. The visual effect will be to have slightly flattened the contrast of the image, and as there is no need to adjust shadows as they are are not falling off the left of the histogram the Shadows and the Black sliders can be skipped and the Contrast slider gently bumped up until the shadows just start to block, and then backed off a bit. In this case enough punch was added back by shifting Contrast to +7.

The final slider in this panel is the Detail slider and this must be approached with the utmost caution with X-Trans files. With Bayer files it is relatively gentle but with Fuji X it is vicious and some real artefacting can occur. I’ve found that maximum setting of +4 is all I can use before things get choppy.

This slider can be used to the negative side with great effect to reduce grain noise, however, and sometimes works better than third party NR programs, or Noise Ninja itself, for that matter.

Next comes the Color enhancement window. This has three presets in a drop-down menu - “Plain" (obvious as to effect), “Portrait” (which darkens/dulls green and blue but lightens/accentuates yellows and reds) and “Scenic” which saturates all colours.

My default opening settings for this image:

F52a37y.jpg

I have set my prefs to open this in Portrait mode as above, and will then use the fine-tuning sliders to alter the depth and saturation of individual colours as indicated in the colour boxes above the sliders. Select a box (green in this case) and adjust the Hue and Hue affinity sliders to bring back the brightness to the greens that the “Portrait” preset had killed a bit much.

IWw2Aqh.jpg

The rest of the control panels are more targeted and to be honest I rarely use them as I have other programs that do the job better. Occasionally I'll use the vignette for effect or the Chromatic aberration if processing a file taken with an older Nikon AI-s wide-angle, but the Fuji lenses really don't have any aberrations to worry about - at least none of mine do. Even the little Samyang 8mm fisheye is amazingly free or fringing.

For sharpening I use Helicon Filter as a Photoshop plug-in, specifically the “sharpen fine details” slider in the sharpening panel, which usually gets best results between +15 & +25, and it has the least halo effect of any sharpener I have used.

So here’s the finished processed shot

9hhIoV8.jpg

And here’s a set of 100% sections of the before, the after, and one final one with +15 Helicon Filter sharpening as well.

Default:

gHTwMIs.jpg

Processed:

IsyIqoP.jpg

Processed and Helicon Sharpen Fine Details +15:

uY3NBQB.jpg

The final version here might be a bit over-sharpened for screen, but is about what I find prints best on my Epson 7800 using Innova Smooth Cotton High White and Ilford Gallerie Gold Fibre Silk.

Once familiar with the program, running through these adjustments takes only a few seconds, and from that point of view it is much quicker than other dcraw-based processors I've tried (Windows - I don't use Mac). But getting quick at it does take practice, as with anything.

Postscript:

As always we'll be compromised by the ancient web colour space of sRGB and jpeg compression. Of course this image was processed in 16-bit Pro Photo colour space, and saved so tagged as an uncompressed TIFF, which means it probably looks a whole lot different to what you may be seeing on your monitor. One day the Web will catch up, maybe after it is done trying to be a phone app and gets back to being something worthwhile.

  • Like 2

Comments

Recommended Comments



  • Contributor

Question: Why do you use the builtin Profile for your sensor and not profile your camera with a target?

BIG Thank You!!!!

Dallas? Article?

 

Built-in, Frank. They got it right for the X-T1.

Link to comment
Share on other sites

I tried builtin vs. measured with the X100T. Much better colors to start with.

There are some things in your report I triald and errored already. Some things are new and very helpful to me. Some things I learned from AndreaB's general PN tutorial and some things I can add to what you said.

Esp helpful is the "careful with the details slider" and your Helicon Sharpener tipp. I will sure try Helicon vs. NIK output sharpener wich I found already more useful than Unsharp Mask, wich is obviously more usefull for Bayer patterns.

i never used the color enhancements so I will dig into this too.

Link to comment
Share on other sites

  • Contributor

Frank, both the Nik raw pre-sharpener and the output sharpener are very good, I just find the Helicon product to be quicker and simpler to use, although I confess that from time to time I still use the Nik product for its finer control. They both beat Smart Sharpen and Unsharp Mask in its various forms in many programs - Helicon filter have a version of USM in their "advanced" sharpening panel so take note that it is different to the "Sharpen Fine Details" slider.

 

I'm not sure as to whether HF supports demosaic of the X100T, but it also has the option of using dcraw as a demosaic tool for X-Trans - it works more purely with dcraw giving you access to the command-line switches that Dave Coffin originally wrote into the program. Photo Ninja and most other dcraw-based programs don't give this base level access and supply a basic default demosaic with minimal switching inputs, but you don't have hands-on access like you do with Helicon Filter.

 

Normally this isn't important, but on very rare occasions (as with many mixed light sources or unusual lighting) you might want to start with just a most basic demosaic and HF gives you that option. A side effect of this is that dcraw is self contained in the program folder without modification so if dcraw gets updated and you want immediate access to that update it is as simple as replacing the dcraw folder in the HF program folder with the new version. This does not work with Photo Ninja - you have to wait for their version update.

 

Of course Nik is free, whereas HF costs, so there might not be enough to buy HF for some, But I use it as a matter of course now so it has well paid for itself by now.

 

As always, keep looking for other people's experiences with PN - I don't profess to be an expert, but I do have a lot of experience with processing the X-Trans with many processors since early 2012 brought about by my initial intense dislike for the first Adobe demosaic offering, which nearly sank the X-Trans as people simply refused to blame Adobe and directly laid the blame on Fuji.

 

Time has proved them wrong, fortunately, because I can't imagine how miserable I would be with my photography by now had I given up, sold the Fuji and continued to struggle with a Nikon line-up that I was getting increasingly disenchanted with, despite that I had been one of those who had lusted after Nikon when at university but simply couldn't afford it, and had jumped at the chance of buying a complete new F4 outfit a couple of decades later when my financial status had improved and it was a deductible business expense. The F4 kept me loyal - serving me faithfully and fuss-free for over a decade without missing a beat, but my experience with their digital products became increasingly jaded as my equipment spent more and more time in the repair facilities, and usually involved an argument over liability for the breakdown with Nikon Australia.

 

As I've mentioned before, the Fuji X system has rekindled my love for taking photographs (both as a profession and a hobby) in a way that my Hasselblads and that bullet-proof F4 had supplied. Photo Ninja has been a welcome part of that rekindling, getting the most out of my X-Trans raw files.

  • Like 1
Link to comment
Share on other sites

Photo Ninja does a great job with the X-Trans files for sure! And it was very enjoyable to see how someone else makes use of PN. I also have the Color Recovery slider set to 50. Then the Highlights slider works better it seems.

 

The X-Trans files do certainly record massive amounts of detail in a lovely way. I like the version just before the final one for viewing here on a monitor (understanding that by necessity we must 'oversharpen' a little bit for printing as in the final version).

 

A reminder that commonly used settings can be saved as a Preset which helps cut down on editing time.

 

And the color patches on the Color Enhancement panel are well worth exploring in depth.

Currently I've been working on how & when to reset the reference hue sliders. Problem is that PN does not supply a colour sampler to measure a colour area in a foto that you might want to change. So setting resetting the reference hue sliders is a bit hit and miss.

Link to comment
Share on other sites

Andrea:

Could you copy your PN preset recommodation here? I printed it for reference because I consider it very helpful.

What is your experience with builtin vs. measured color reference?

Link to comment
Share on other sites

I have about 30 Presets based on different cameras and which light was illuminating the subject (UV, IR, Sunlight, etc.) and other factors. These Presets usually incorporate Light Source profiles I've built in Photo Ninja.

 

I'm not liking Photo Ninja's current interpretation of the daylight D810 colours. But for the older cams like D3S, D700, D300, D200 the built-in daylight colour profiles seem right on target. And I've found that PN is good enough at interpreting the in-camera white balance settings for ordinary work ("ordinary" for me = non-UV photos).

 

The built-in daylight profiles probably improve with subsequent releases because the PN team receives a lot of samples from users and continually upgrades the built-in profiles?? (Either I read that somewhere or was told that by one of the PN team members.)

 

But really, it is so simple to record a Color Checker Passport at the beginning of each shoot to use to make a profile in PN, that I hardly use of the built-ins anymore. Just open the photo of the CC Passport, spread the grid and push the button.

Link to comment
Share on other sites

  • Contributor

I have saved a number of situational presets (in forest blue sky, In forest overcast etc) but rarely use them. Somehow things seem quicker if I process one photo, hit done and copy and paste those settings to the following similar photos, then start again when the next set of similar photos different to the first batch presents. Given the compactness and setting out of the panels, I mostly just use the first three, with most time spent on the middle "Exposure and detail" panel, the first "Color correction" and third "Color enhancement" each dealt with in a few seconds. This is the fastest raw processor I have used once I got familiar with what things were for and how they affected the image.

 

I am wondering what the promised PN V2.0 will be like, although they've been threatening that for a year or more now and still no announcement of a definite date or even a public beta yet. There are a couple of stability issues I have on my machine when Bridge and Photoshop are open and I use Bridge to open a RAF file, which launches Photoshop which then launches PN, which then inevitably crashes PN, Ps or both. So I just launch from Explorer which then opens PN only, and nothing crashes, even if I have Ps running but minimised, so it's no big deal.

 

The V2.0 allegedly is a major rewrite - I hope that doesn't completely upend the controls layout and menus because I am now very familiar with things and I'd hate to have to start from scratch.

Link to comment
Share on other sites

I have to agree that PN handles x-trans raw files very well.  It is my favorite for my X100T because of the color, detail and dynamic range

 

18043852678_0464122b58_k.jpg

 

Please click to view larger

 

 

  • Like 3
Link to comment
Share on other sites

Guest Lars Hansen

Posted (edited)

Great guide Alan. I will definitely try this at home..

I use Capture One for my X-Trans files but I'm very curious to see how Photo Ninja compares to Capture One.

Edited by Lars Hansen
Link to comment
Share on other sites

The V2.0 allegedly is a major rewrite - I hope that doesn't completely upend the controls layout and menus because I am now very familiar with things and I'd hate to have to start from scratch.
 
I also hope it does not "ruin" what we Photo Ninja users love about this app!!
 
*****
 
Alan & other X-Trans users, you might enjoy Michael Johnston's column about his X-Trans: http://theonlinephotographer.typepad.com/the_online_photographer/2015/05/open-mike-why-i-chose-fuji.html I always enjoy his writing.
 
Also on that blog is a guest column by a Kevin Purcell about the X-Trans: http://theonlinephotographer.typepad.com/the_online_photographer/2015/05/noise-for-headroom-fujis-x-trans-sensor.html

The following quote from Purcell's column is somewhat mysterious to me given the photo Alan has just posted above:
 

The X-Trans color filter array actually reduces acuity. Yes, really it does! So, as many people have found out, it's not great for images with lots of very fine repetitive detail (such as leaves in landscapes).

I can't imagine why this fellow writes that !!! Methinks that perhaps he does not edit his images properly? Oh well, not everyone likes everything - especially when cameras are involved. :P But I want to drag this person over here to Fotozones and point out the above fine leaf detail. :D
 
I just had a successful LensRental.com experience with the new Nikon Coolpix P900 and its huge "2000mm equivalent" zoom. So I'm thinking that next up on the rental list should be one of the X-Trans cams. At this point I really need/want to try it myself.

  • Like 2
Link to comment
Share on other sites

I have only the 23mm and 14mm lenses, which are fine.  

Reports are that the 16-55 is very good.

My understanding is that unlike the 14mm and 23mm, the zooms will employ software correction of distortion, which, if present, could affect the look of the pictures.   

I am unclear if the correction is necessarily baked into raw files, or only JPEGs.

Perhaps Alan could tell us what he has found re: the effect of in-camera distortion correction on the Fuji files.

Edited by pluton
Link to comment
Share on other sites

What is a good lens to rent with the X-T1? (....and thanks...)

I was thinking perhaps the Fuji 16-55/2.8 ??

 

I think I'll try the smaller 18-55/2.8-4.0.  And I"m dying to try that 56/1.2. 

 

I've been very impressed with Lensrental's system and service.  The first couple of times I rented from them I had to wait at home to sign for the delivery.  Now I have it delivered to the FedEx office near work, and I pick it up on my way home.

Link to comment
Share on other sites

  • Contributor

 

The following quote from Purcell's column is somewhat mysterious to me given the photo Alan has just posted above:

Quote

The X-Trans color filter array actually reduces acuity. Yes, really it does! So, as many people have found out, it's not great for images with lots of very fine repetitive detail (such as leaves in landscapes).

I can't imagine why this fellow writes that !!! Methinks that perhaps he does not edit his images properly? Oh well, not everyone likes everything - especially when cameras are involved. :P But I want to drag this person over here to Fotozones and point out the above fine leaf detail. :D

 

 

Pointing to a DPReview jpeg (they only shoot jpeg, as evidence of an acuity test is shaky ground indeed to be judging the actual acuity performance of a sensor (in this case it's the camera's Silky Pix version of X-Trans processing OOC reduced to 8 bits and lossy compressed). I bet he also uses Lightroom to process his own RAFs, if indeed he's ever processed one. I would draw that conclusion as well given these parameters. Anyhow, regarding the universal DPR test photo, a flatly lit studio shot of a bunch of coloured objects, resolution charts, bottles, crayons, balls of thread with a DR of maybe 6 or 7 is hardly the "real life" situation that might actually tax a sensor.

 

I also tend to immediately dismiss any X-Trans "review" wherein the method used to demosaic isn't mentioned, or indeed if either Lightroom or ACR are named. People get up in arms at this and say they're "satisfied" and "like" the results from those processors, or that they "like" using them, but these are just personal feelings. I have literally reams of files here where I have over and over and over again tried to better, or even equal results from processors such as Photo Ninja by using ACR, and have yet to achieve a positive result. While I sometimes have come close, the pertinent common thing is that to do so with ACR/LR requires a whole lot more messing about than a simple, straightforward processing using just one or two panels and maybe four or so slider movements in Photo Ninja. Hence my heels are dug in on this, but I still don't outright tell people not to use the Adobe product, they're of course free to produce photographs processed to well below their potential if they wish. :D

 

I repeat my often stated opinion that the respect given to the majority of online reviewers and bloggers is entirely misplaced - most haven't the first clue or personal experience of what they're talking about, largely recirculating reworded opinion they've read somewhere else. This opinion is indeed mine, isn't reworded or recirculated, and I am convinced is actually a lot closer to the truth than most of the "facts" sprouted by these seekers of their 15 minutes of fame.

 

The wording of any opinion I express regarding things photographic, however, such as this very article, goes to lengths to point out that I don't claim to be an expert, don't claim that my results are conclusive, and don't suggest that readers blindly follow what I say, but encourages that people do instigate further research for themselves. If I report results, they'll be from experience with my own camera and my own computer, although if I find an online source with graphs and the like (not photos, I do those) that I do not have the equipment to produce I will use them to illustrate the point.

 

I don't need, or want, the 15 minutes of fame that some seem to crave - there are far more interesting things to do with life than chase that, which is why I don't have a website, don't write blogs, but do write stuff like this if I think something I've learned along the way can be useful or even helpful to others, and maybe save them some of their own life's precious time by not having to reinvent the wheel.

 

It's also why I write that sort of thing here in Fotozones, because this place is populated by people who listen rather than argue, yet will make counter points without aggression if they think I'm mistaken. Civilized argument is actually enjoyable, but the aggressive, testosterone-charged nonsense that goes on in so many other forums seems to me to give a good indication of where so much of the "expert" opinion of reviewers and bloggers comes from. :D

  • Like 2
Link to comment
Share on other sites

  • Contributor

Great guide Alan. I will definitely try this at home..

I use Capture One for my X-Trans files but I'm very curious to see how Photo Ninja compares to Capture One.

 

Please show the results here, Lars, I don't use C-1, but did try it once a long time ago (before I had used PN), a result of which my computer is now disabled from running any newer demos, so I'd have to buy the program to try it out. If you (or anyone else) wants the raw file for the photo I produced here to compare with I can dropbox it.

Link to comment
Share on other sites

  • Contributor

What is a good lens to rent with the X-T1? (....and thanks...)

I was thinking perhaps the Fuji 16-55/2.8 ??

 

If you're trying an X-T1 for the first time, get the 18-55/2.8-4 - it gives a better rendition of the Fuji small/light/compact ethos than the 16-55/2.8, which is more a token to appease the Nikon/Canon 24-70/2.8 rusted-on users. The 18-55 is not weather resistant, but a small plastic baggie does the job just fine, or the camera/lens combo is small enough to slip into a rain jacket pocket anyway.

 

The 18-55/2.8-4 is only marginally slower at the long end, but it does have OIS (good for 4-5 stops, or down to as low as 1/15 sec, whichever comes first) which makes it a faster lens effectively than the 16-55/2.8, which doesn't have OIS. Optically the 18-55 is no slouch - while the focal lengths covered aren't the most visually exciting, the image quality is right up there with all the other Fuji XF zooms, which is to say that it is bloody good.

Link to comment
Share on other sites

  • Administrators

I don't need, or want, the 15 minutes of fame that some seem to crave - there are far more interesting things to do with life than chase that, which is why I don't have a website, don't write blogs, but do write stuff like this if I think something I've learned along the way can be useful or even helpful to others, and maybe save them some of their own life's precious time by not having to reinvent the wheel.

 

It's also why I write that sort of thing here in Fotozones, because this place is populated by people who listen rather than argue, yet will make counter points without aggression if they think I'm mistaken. Civilized argument is actually enjoyable, but the aggressive, testosterone-charged nonsense that goes on in so many other forums seems to me to give a good indication of where so much of the "expert" opinion of reviewers and bloggers comes from. :D

 

Thank you for saying these things, Alan. This is the ethos of what I am trying to accomplish with Fotozones. As I have mentioned in the recently updated foot notes that appear on each page, unlike 99% of the other photography sites and forums out there, this one doesn't create content for the purpose of assisting retailers to move product by means of affiliate advertising. What we want here is the truth about the stuff we use, how it works and how others can benefit from using it. 

 

Fotozones is going exactly where I want it to go and thanks to the contributions that yourself and others are making, I will continue to get up every morning and steer the ship and stoke the burners because this is what I had in mind when I first started a photography forum back in 2006. A place of reality (long before those "real world" bloggers had even figured out how to use WordPress). :)

  • Like 1
Link to comment
Share on other sites




Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×
×
  • Create New...

Important Information

By visiting this website you are agreeing to our Terms of Use, Privacy Policy & Guidelines.