Sony Lens Quality

Marc Heijligers, 06-02-2016

Recently I bought a Sony A7RII camera, and I considered a couple of lenses to build up a system. The lenses I’ve considered are:

  • Sony FE 35mm F2.8 - compact, and reported to be very sharp.
  • Sony FE 28mm F2.0 - reported to render nicer than the 35mm F2.8, but less compact.
  • Sony FE 55mm F1.8 - reported to be ultra sharp, and a very nice bokeh.
  • Sony FE 35mm F1.4 - bulky and heavy, but adored about its bokeh and rendering.

thelenses

To determine which lens to keep, I’ve compared properties like sharpness, the nature of the bokeh, and the way the region between a sharp and unsharp region smoothens. Compared to what you see on other sites that compare lenses, the pictures I made are not so interesting from photographic view, but they are easy to reproduce in moderate controlled conditions, and contain sufficient properties to compare the above ingredients. The

During the comparison of various lenses under similar conditions, I found out that there is a huge variation in field sharpness with similar lenses. So for example, with the 35mm F2.8 lens, for one particular lens the left side of the field is more blurred, whereas with another copy of the same lens the right side of the field is blurred. Another noticable difference was the amount of color fringing. This raises the suspicion that internal lens elements are titled/skewed.

Test Conditions

The first test is to test the field sharpness of the lens. For this I use a bookshelf, which has a flat surface and a lot of books where the text on the book spines can used to test the subjective sharpness at a distance of 1.5 to 2m (not fully scientific, but sufficient for the practical use cases of most of us). The camera is put on a tripod, where care is taken that the camera is perpendicular to the bookshelf (using the level indicator of the camera, visually checking the camera is in the middle and the bookshelf plates are symmetrical, and double check with LensALign that the book spines are within the DoF range). The focus point for all photos is always in the centre (though other focus points have been checked for sanity, as ell as multiple pictures to exclude focus differences). Photos have been made with Steadyshot OFF, Silent Shooting ON, and a timer (but the differences are hardly visible with other settings in this setup). Pictures are taken in RAW, and processed in Lightroom with the Camera Neutral setting, and the Lens corrections enabled (also a default use-case for most - for sanity I’ve checked the difference between JPG, and RAW with corrections turned off, but the conclusions also hold under those conditions). Three regions are considered in the tests, one in the centre, one at the bottom-left, and one at the top-right. To investigate color fringing, tests have also been done closer to books with a high level of contrast.

The second test is to test the lens for sharpness at further distance. This also rules out the problem with the camera might not be absolutely perpendicular to the bookshelf. For this purpose I photographed a (boring) village scene from the balcony. Also here three regions are considered the centre, the left, and the right side.
Stacks Image 2189
Stacks Image 2191
Although the above tests are not scientifically set up, and hence absolute statements on the amount of sharpness cannot be given, the setup is constant when exchanging lenses, and therefore relative difference between lenses are conclusive, which is the purpose of this test.

Expectations

No lens is perfect, hence we cannot expect ultimate sharpness overall. On the web, test sites like SLRgear, DXOmark or DPreview use better test conditions, and give a good indication about the expected performance.

The figures underneath give the field response for different lenses from SLRgear at open aperture and at F5.6 (where most lenses should be decently sharp over the whole field, with a rare exception of the 35mm F2.8, which on other sites like DPreview improves when stopping down, so also here we see sample variations). The graphs from SLRgear already hint at some field variations (e.g. for the 35mm@f5.6, one can see in one corner a blur factor of 3 pixels, whereas in another corner it is just underneath 2 pixels):

28mm F2

Stacks Image 2210

35mm F2.8

Stacks Image 2212

55mm F1.8

Stacks Image 2221

35mm F1.4

Stacks Image 2229

Results

The summarized observations per lens type are shown below:
28mm F2 
Stacks Image 672
28mm F2.0: The first sample of the 28mm lens is very blurred in the corners for open apertures, and still to a lesser extent at f5.6. As this is not expected performance according to SLRgear, I did compare it to a second copy with shows much better behavior. One top-right crop of the bookshelf and one left crop of the city view are shown below. It is clear that first sample on the left side has a problem, whereas the second sample on the right side has decent sharpness. I made several photos of the scene to rule out movement of focus problems, the results are consistent. For more details, see the 28mm F2.0 lens quality page…
Bookshelf Top-Right, 28mm @ f2.0 - Sample 1 is very hazy
Stacks Image 2242
Stacks Image 2244
City View, Left 28mm @ f2.0 - Quite a blurring with sample 1
Stacks Image 2249
Stacks Image 2251
35mm F2.8 
Stacks Image 697
35mm F2.8: The first sample suffers from quite some color fringing. At short distances the first sample has a better corner sharpness, but at long distances this sample is less sharp. The first sample also shows a significant higher amount of color fringing (or axial chromatic aberrations), at short as well as long distance. At infinity, sample 1 is also less sharp. Below are two examples, both taken at f2.8 to show those issues. For more details, see the 35mm F2.8 lens quality page…

As for my use-cases for a 35mm it is important to have a more consistent field sharpness at further distances, I consider the second sample to be the overall better lens. Nevertheless, for a €799 lens I expect a better consistent performance all over the field.
Bookshelf Centre, 35mm @ f2.8 - Sample 1 suffers from quite some color fringing:
Stacks Image 2339
Stacks Image 2342
City View, 35mm @ f2.8 - Sample 1 also reveals color fringing at longer distances, where a purple haze is visible at the top of the roof skylight or at the tweaks of the trees on the background:
Stacks Image 2348
Stacks Image 2351
55mm F1.8 
Stacks Image 725
55mm F1.8: One sample blurs on the right side (compared to the sharpness in the centre and the other lens sample), whereas the other lens sample has the same issue on the left side. This hints at a tilted/skewed internal lens element, and also hints that there is not issue with the lens mount on the A7RII.

For the first sample, the overall sharpness is a bit better, so that is the one I kept. In practice the lens makes good and sharp pictures, just need to stop it down when you want to make pictures of flat surfaces.

For more details, see the 55mm F1.8 lens quality page…
Bookshelf Left, 55mm @ f1.8 - Sample 1 is sharp, sample 2 is a little bit blurred (see the National Geographic text on the book spines):
Stacks Image 2521
Stacks Image 2524
Bookshelf Left, 55mm @ f1.8 - Sample 2 is sharp, sample 1 is a little bit blurred:
Stacks Image 2530
Stacks Image 2533
City Right, 55mm @ f5.6 - At long distances the differences is still pretty visible at the right side of the field. Sample 1 is definitely less sharp on the sun-shades (it wasn’t that sunny btw :-)):
Stacks Image 2569
Stacks Image 2572
35mm F1.4 
Stacks Image 711
35mm F1.4: This copy is definitively flawed, with skewed/tilted/assymetric internal lens elements, and should be returned to Sony. It shows an immense blurring problem at the right side of the lens. I did not have a second sample for comparison, but the pictures speak for themselves. This is in line with other observations on the web, i.e. lens rental (“the variance is WITHIN a copy, not just copy-to-copy, none of the 10 copies we tested had even corners”), diglloyd and various forum topics, e.g. dpreview and fredmiranda (for a 55mm).

For more details, see the 35mm F1.4 lens quality page…
Bookshelf Left side and Right side for the same lens, 35mm @ f1.8 - The right side is blurred unacceptably:
Stacks Image 2430
Stacks Image 2433

Conclusions

It is obvious that there are quite some variations per lens, which given the price level of those lenses is a bit surprising. I would expect a better quality control with less variations. My recommendation is to always quickly check your lens directly after you bought it, and make sure you have a dealer who provides good service in cases you want to exchange a lens.