Jump to content
NickC2020

Jagged edges when using elliptical marquee

Recommended Posts

Doing a very simple selection using the elliptical marquee tool to cut a portion out. The problem is the edges are much more jagged as compared to doing the same function in Photoshop. The rasterize function did not help. I have feather set to zero, but it is also set to zero in Photoshop. I am using the same .jpg in both programs and I am using the same marquee size setting between both programs. Attached are two photos; AF test is the Affinity photo and PS is Pho toshop. I can probably go through steps to refine the edge after the fact, but I would rather have the marquee selection tool have edges similar to what I have been using in Photoshop. I am a rookie with Affinity so it is probably a simple setting I am not seeing. Thanks for the help!

PS Test.jpg

AF test.jpg

Share this post


Link to post
Share on other sites

Make sure you are viewing the selection at 100% because anything another obviously constitutes zooming in and will ultimately reveal pixelation.

An alternative to the selection tool is to clip the image using a shape like the Ellipse shape. This has the benefit of being nice and smooth and also easily editable. You create an ellipse shape using the ellipse tool and then place (nest) the image in the Ellipse shape.

788697324_ScreenShot2020-02-24at23_49_50.png.0005c5aecd426563d5e7cf96da8261f2.png


iMac 27" Late 2015 Fully Loaded, iMac 27" Mid 2011 both running High Sierra 10.13.6 - Affinity Designer/Photo & Publisher - Illustrator CC, Inkscape, Blender, Sketchup, Pepakura Designer, MTC, Pixelmator & Pixelmator Pro + more... XP-Pen Artist-22E, - iPad Pro 12.9 B|  

Affinity Help - Affinity Desktop Tutorials - Feedback - FAQ - most asked questions

Share this post


Link to post
Share on other sites
11 hours ago, NickC2020 said:

The problem is the edges are much more jagged

In my opinion, this is expected and "desirable" because Marque's role is to select the entire existing pixel content.
Therefore, it should not create any smoothing (aliasing) and change the content of the selected pixels. There are other tools, such as masking or clipping, as firstdefence writes.


Affinity Store: Affinity Suite (ADe, APh, APu) 1.8.0.585.
Windows 10 Pro, Version 1909, Build 18363.720.
Dell Latitude E5570, i5-6440HQ 2.60 GHz, 8 GB, Intel HD Graphics 530, 1920 x 1080.
Dell OptiPlex 7060, i5-8500 3.00 GHz, 16 GB, Intel UHD Graphics 630, Dell P2417H 1920 x 1080.
Intel NUC5PGYH, Pentium N3700 2.40 GHz, 8 GB, Intel HD Graphics, EIZO EV2456 1920 x 1200.

Share this post


Link to post
Share on other sites
58 minutes ago, Pšenda said:

Therefore, it should not create any smoothing (aliasing) and change the content of the selected pixels.

Doesn't that rather depend on the preferred options (readily availabe when you make a marquee selection, so the options are really part of the tool)?

marquee_selection.jpg.4c5f7c6a8865895b3b305a39b757b1fe.jpg

OP's oval selection is not hard edged, but it does not seem to be a pure result of standard antialiased selection, either. Or perhaps there are just additional jaggies and JPG artifacts because of being posted as JPG.

I compared the antialiased edge with that of Photoshot and they appear to be pretty similar (2-3 px wide). As feathering is also immediately accessible, it would be easy to add smoothness.

 

Share this post


Link to post
Share on other sites
3 hours ago, Lagarto said:

depend on the preferred options

Yes, but OP does not mention turning on Aliasing in its contribution. With aliasing off, I expect the selection to be "jagged".

Edit: The Aliasing option does not work as expected.
"Must" be selected before selection is made. If it is selected after the selection is made, it is not accepted - the selection is still jagged.
Maybe that's why @NickC2020image is so jagged.

Edited by Pšenda

Affinity Store: Affinity Suite (ADe, APh, APu) 1.8.0.585.
Windows 10 Pro, Version 1909, Build 18363.720.
Dell Latitude E5570, i5-6440HQ 2.60 GHz, 8 GB, Intel HD Graphics 530, 1920 x 1080.
Dell OptiPlex 7060, i5-8500 3.00 GHz, 16 GB, Intel UHD Graphics 630, Dell P2417H 1920 x 1080.
Intel NUC5PGYH, Pentium N3700 2.40 GHz, 8 GB, Intel HD Graphics, EIZO EV2456 1920 x 1200.

Share this post


Link to post
Share on other sites
39 minutes ago, Pšenda said:

"Must" be selected before selection is made.

This is probably by design. Photoshop works similarly, and IMO that is just good. (EDIT: This way you can accumulate the selection alternating the setting.)

Share this post


Link to post
Share on other sites
26 minutes ago, Pšenda said:

Yes, but OP does not mention turning on Aliasing in its contribution. With aliasing off, I expect the selection to be "jagged".

Hard to say what is the cause but it is not a non-antialiased selection as the edges do not seem hard. Or perhaps it is a JPG compression thing. The antialiased selection, however, works pretty much similarly in Photo as it does in Photoshop.

Share this post


Link to post
Share on other sites
4 hours ago, Lagarto said:

but it is not a non-antialiased selection as the edges do not seem hard

Realy???
image.png.fd4ce5156055f5841aa382d46817c735.png

 

I imagine a smooth selection somewhat differently.
image.png.a19e5364100a904518d1ae6fe07f63f0.png

This is with anti-aliasing off, which seems to me much like the OP image.

image.png.7ec323e0c3939f32a957a2168ffa297e.png


Affinity Store: Affinity Suite (ADe, APh, APu) 1.8.0.585.
Windows 10 Pro, Version 1909, Build 18363.720.
Dell Latitude E5570, i5-6440HQ 2.60 GHz, 8 GB, Intel HD Graphics 530, 1920 x 1080.
Dell OptiPlex 7060, i5-8500 3.00 GHz, 16 GB, Intel UHD Graphics 630, Dell P2417H 1920 x 1080.
Intel NUC5PGYH, Pentium N3700 2.40 GHz, 8 GB, Intel HD Graphics, EIZO EV2456 1920 x 1200.

Share this post


Link to post
Share on other sites
4 hours ago, Lagarto said:

This is probably by design.

This is possible, but there is nothing in the help about the necessity of choosing before selecting, which is confusing for the user.
image.png.b5431c8eb1bcd659fa39a47eb83b4557.png

English is not my native language, but I would say it is not described correctly.
The above wording suggests that "after" selecting Antialias, applying transparency will smooth the edges of the selection already made.


Affinity Store: Affinity Suite (ADe, APh, APu) 1.8.0.585.
Windows 10 Pro, Version 1909, Build 18363.720.
Dell Latitude E5570, i5-6440HQ 2.60 GHz, 8 GB, Intel HD Graphics 530, 1920 x 1080.
Dell OptiPlex 7060, i5-8500 3.00 GHz, 16 GB, Intel UHD Graphics 630, Dell P2417H 1920 x 1080.
Intel NUC5PGYH, Pentium N3700 2.40 GHz, 8 GB, Intel HD Graphics, EIZO EV2456 1920 x 1200.

Share this post


Link to post
Share on other sites

First off, thanks for the numerous replies, I appreciate it and I learned more.

So it was because I had antialias turned off (default) while it was turned on (default) in PS. Also the fact I didn't turn this on PRIOR to selecting also threw me for a loop. I was always selecting it after the selection. Thanks to @Pšenda for pointing this out! Like I said, rookie mistake by me.

Share this post


Link to post
Share on other sites
1 hour ago, Pšenda said:

I imagine a smooth selection somewhat differently.

You do not need to imagine, just zoom in close enough, and you can see that the edge is not hard. But it was blurred because of compression artifacts and save-time antialiasing, and not because of poorly done Photo antialiasing, as OP thought. Here is an actual 1200% zoom enlargement of the photo in the original post, and non-antialiased cut made of the same spot. When the edge is hard, you can zoom as close as you wish and the edige will never get blurred:

alias_antialias.png.37ddc60a7ca9f7dfb9f7bdc01ca3afef.png

For comparison, here is the 1200% enlargement of the same spot in the OP's Photoshop version with antialiased marquee cut applied:

 ps_antialias.png.5499057d4a0cd9591687659b10aca773.png

Anyway, the problem got solved, antialias was not properly applied, even if the screenshot was blurred and not clear-cut and could well have been interpreted to be a result of lousy antialiasing algorithm.

 

 

Share this post


Link to post
Share on other sites

Hi @NickC2020, I was glad to help :-)

Even if Serif better described it in application help.


Affinity Store: Affinity Suite (ADe, APh, APu) 1.8.0.585.
Windows 10 Pro, Version 1909, Build 18363.720.
Dell Latitude E5570, i5-6440HQ 2.60 GHz, 8 GB, Intel HD Graphics 530, 1920 x 1080.
Dell OptiPlex 7060, i5-8500 3.00 GHz, 16 GB, Intel UHD Graphics 630, Dell P2417H 1920 x 1080.
Intel NUC5PGYH, Pentium N3700 2.40 GHz, 8 GB, Intel HD Graphics, EIZO EV2456 1920 x 1200.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.


×
×
  • Create New...

Important Information

Please note the Annual Company Closure section in the Terms of Use. These are the Terms of Use you will be asked to agree to if you join the forum. | Privacy Policy | Guidelines | We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.