Cutouts that hold up: selections, quick masks and edge work

Every cutout fails in the same place: the boundary. Ten seconds of selection and thirty minutes of edge work is the normal ratio, and the tools only help if you know which one produces a usable starting point.

Pick the selection tool by contrast, not by subject

• Magic wand — for hard edges against flat backgrounds: product shots on white, screenshots, logos. Set tolerance low and turn anti-aliasing on.
• Quick selection — for subjects with clear tonal separation from the background. Brush over the subject; the tool grows to the nearest edge.
• Polygonal lasso — for architectural and geometric edges where you can place vertices precisely.
• Freehand lasso — for rough work you intend to refine; never for final edges.
• Colour range — for skies, skin, or any region that is coherent in colour but not in shape.

For hair, fur and foliage, none of these produce a finished result. Select a generous region, then refine — the expensive part is always the refinement.

Why a quick mask is the right container

A selection is binary in practice: in or out. A mask stores 0–255 per pixel, which is what soft edges actually are. Converting the selection to a mask immediately gives you:

• The ability to paint the transition by hand with a soft brush.
• Reversibility — every stroke can be undone or repainted, and the pixels were never destroyed.
• Reusability — the mask can be duplicated to another layer, inverted, or blurred later.

The shortcut worth learning: enter quick-mask mode with Q, paint the correction with black and white, exit, and the selection is refined. In an editor with real masks, skip the mode and paint on the layer mask directly.

The four-step edge routine

1. Coarse selection. Get 90% of the boundary right and do not chase detail yet.
2. Convert to a mask, then blur by one or two pixels. A hard mask edge is the single biggest tell of an amateur cutout; real objects have a soft optical boundary.
3. Refine with a soft brush at 100% zoom. Paint white to reveal, black to hide, at low flow so mistakes are gradual.
4. Composite against the real destination. Put the subject on the background it will actually sit on — dark, light, patterned — and fix the halos that only appear there.

Step four is where most people stop early. A cutout that looks perfect on white can show a one-pixel light fringe on black, because the original background bled into the edge pixels.

Decontaminating the fringe

When the subject was shot on white and is going onto a dark page, edge pixels carry white contamination. Three mitigations, cheapest first:

• Contract the mask by one pixel so the contaminated ring is excluded.
• Paint the edge colour in on a new layer clipped to the subject, using a brush at low opacity.
• Re-shoot or re-render with more separation, if the source is under your control.

What to test in any editor

Cutout quality is a good proxy for how seriously an editor implements masking. Test it in one pass:

1. Make a quick selection of a soft subject.
2. Turn it into a layer mask.
3. Blur the mask by two pixels, then paint a correction with a soft brush.
4. Duplicate the layer, invert the mask, and check that the edge behaves.

If any of those steps is unavailable or lossy, the editor cannot do production cutouts. In the PhotoPSD editor layer masks are non-destructive and brushable; the layers and masks article explains the mechanics behind what you are testing.