Machine Learning: Object Selection Tool

[AiDon]

2 hours ago, Patrick Connor said:

Did you ask the beta to import your release settings the very first time you ran the beta?

No Patrick I didn't.

[bestman 8]

I personally think that installing the models separately is great but it would be even better if it was part of the installer if possible or a prompt on first opening like do you want to install these features you can always change it later. 

[Affinity Info Bot]

The issue "Object Selection icon not appearing in customised toolbar after update" (REF: AF-4825) has been fixed by the developers in the latest beta build (2.6.0.2861). The fix is planned for inclusion in the next customer release.
Customer beta builds are announced here and you can participate by following these instructions.
If you still experience this problem once you are using that build version (or later) please reply to this thread including @Affinity Info Bot to notify us.

[AiDon]

Hi,

Although this isn't a particularly difficult subject of a woman sitting in a rowboat, the Object Selection tool won't allow me to add the woman's legs either below or above the railing - does not even recognize them as a object to add but will let me select the dark areas below the leg. Even using Refine doesn't help ... note that the Subject Selection tool also fails in the same way. 100% view added below.

 

 

[j3rry]

I have a similar problem with ML Selection. Some parts of the sculpture are simply not recognised and therefore not selected.

For testing purposes I have attached the whole image.

Affinity Photo 2.6.0 (2861) MacOSX Sequoia 15.1

 

[pruus]

27 minutes ago, j3rry said:

I have a similar problem with ML Selection. Some parts of the sculpture are simply not recognised and therefore not selected.

For testing purposes I have attached the whole image.

Affinity Photo 2.6.0 (2861) MacOSX Sequoia 15.1

 

Just tried to make a selection box around the object, the selection was almost good:

[Torstein]

So far, I have never made any AI selection without the need to add or remove with the good old selection brush tool. Still the Object Selection Tool can save a little time, giving a rough start to adjust. 

[j3rry]

1 hour ago, pruus said:

Just tried to make a selection box around the object, the selection was almost good:

 

Thank you @pruus, I tried your proposal and it works. I don't expect ML Selection to solve all the problems around selections, but most of them ... 🙂

 

[pruus]

@j3rry refine the selection and the result is better. That is something I also have to do after ML. 

[j3rry]

37 minutes ago, pruus said:

@j3rry refine the selection and the result is better. That is something I also have to do after ML. 

@pruus, I have the selection refined, but I see a lot of artifacts around the object. Do you have any ideas on how I can eliminate or better prevent this?

[HCl]

.

[j3rry]

1 hour ago, Return said:

Try out the other output options.
https://affinity.help/photo2/English.lproj/pages/Selections/selections_modify.html

Thanks, I will do it. 

[Photos by Jack]

I think you guys are on to something with this new Selection Tool. I have been experimenting with this tool on some of my photo editing projects. There are a few glitches that have cropped up on occasion, but I'm still working with them to see if I can isolate the cause.

Jack Olson's Images in the Wilderness

[FullGrim]

I cannot use this feature on large and complex files. For example, my file below is A3 size and 600 DPI. When I click to make a selection with the Object Selection tool, it gets stuck at the calculation step as shown below. In the meantime, CPU usage continuous at 100% and the process does not finish even if I wait for minutes. I can only close Affinity Photo from the task manager.

My system: CPU: i3-12100F, RAM: 32 GB DDR 4 3200, GPU: RTX 4060, SSD: Gen3 M2, OS: Win 10 Pro (22H2)

 

[alanj49]

Are the Machine Learning tools going to be made available on Mac Intel? All other AI tools work on my IMac so why not Afinity?

[RichardMH]

Another crash. Doing a selection on a focus stack.

 

db35c093-46e0-42d7-814f-cd0c756d5804.dmp 

 

[Hangman]

Hi @RichardMH,

Can you upload the stacked image so we can see if we can replicate the crash?

Apologies if you've already provided this info previously but can you let us know the spec of your machine and which version of Windows you're running and also confirm whether you have Inference set to CPU Only or CPU and GPU under the Machine Learning Settings...

[RichardMH]

Here it is. Windows 11, Nvidia GeForce RTX 3060. Hardware Acceleration on. I've deleted the files I used in the stack. Only have the tiff as I do the fancy edits in Capture One and just send it a tiff from Photo.

 

Stack2.tiff

[HCl]

.

[Alien_x]

On 10/21/2024 at 2:42 PM, Patrick Connor said:

 

All of the above functionality is also available on iPad.

COMPATIBILITY: Sorry but due to the functions we need to run the Object Selection and Subject Selection functionality, the Machine Learning features only available on Apple Silicon iPads and macOS devices (and those need to be running on a recent macOS, as Catalina, Big Sur and Monterey do not support the required calls). Machine Learning will run on both Windows x64 and Arm64 hardware running Windows 10 or Windows 11.

 

Hello,

What do you consider exactly as Apple Silicon? All (current) Apple devices have Apple developed CPU/GPU. So you mean only "M" chips? the new iPad mini 7 has a very powerful chip, will that suffice the criteria to run AI tools?  

[Hangman]

23 minutes ago, RichardMH said:

Here it is. Windows 11, Nvidia GeForce RTX 3060. Hardware Acceleration on. I've deleted the files I used in the stack. Only have the tiff as I do the fancy edits in Capture One and just send it a tiff from Photo.

Certainly no issues here on my Mac, as in no crashes. Object selection does fail to differentiate the background areas between the insect's legs so I had to use the Object Selection Brush in Subtract Mode to exclude those areas...

Interestingly (or not as the case may be) Select Subject fails completely, though I guess there are perhaps not many of these wee beasties in the ML training model...

[Keithscatch]

On 10/22/2024 at 1:53 PM, 4dimage said:

Oh dear 😉

Actually a great feature. But a few extra laps on the training track are still required. The three real-life examples were already cut out on white or transparency. So the tool should be able to recognize the shapes even better. Product shots like these are part of everyday layout work.

 

 

Affinity Photo has always been horrific at this. It is discouraging too. Photoshop is far better at selecting backgrounds even on simple images like you showed. I wish that Serif would improve this feature as it is NEEDED BADLY. It makes it cumbersome to have to clean up so much of the masked area all the time. Ugghh.

[Keithscatch]

On 11/15/2024 at 8:14 AM, j3rry said:

Thanks, I will do it. 

Did it help you? The refine tool doesn't work well for me. I don't like how Affinity Photo handles masking at all. I have to resort to using the eraser tool and clean uip the edges on everything. Very frustrating that they can't get this better.

[j3rry]

1 hour ago, Keithscatch said:

Did it help you? The refine tool doesn't work well for me. 

With the help of the refine tool I could master most of the selection problem and the artefacts. 

[Seasonall]

I am excited to test this feature because I think it will be very useful for some of the work I do - especially considering these tools do not call into any third-party services over the internet. 
 

One concern I will be testing for is the installation path. Some of my production environments are not internet-facing. Will there be a way to install the models without an internet connection (download separately, copy onto machine, install from copy)?