Jump to content

Machine Learning: Object Selection Tool


Recommended Posts

Thanks. It's fine working for now, but it's not perfect either, it needs to be improved, especially for the detail selection.

The bugs I saw at first:
>> I change Inference to 'CPU Only' in Settings and restart the software. However, after the restart, it automatically sets to 'CPU and GPU' again.
>> When I use the Object Selection Tool or Select Subject, the program's RAM usage increases by at least 10 times and does not decrease again. CPU usage also increases and does not decrease completely even if I do not do any process.

ss2.PNG

ss.PNG

Edited by FullGrim
Typo
Link to comment
Share on other sites

I can't get the Machine Learning models to download without bombing both Photo and Pub on completionĀ 

Affinity Photo 2 Beta-2024-10-23-122459.ips

Daz1.png

Mac Pro Cheese-grater (Early 2009)Ā 2.93 GHz 6-Core Intel XeonĀ 48 GB 1333 MHz DDR3 ECC Ram, Sapphire Pulse Radeon RX 580 8GB GDDR5,Ā Ugee 19" Graphics Tablet Monitor TripleĀ boot via OCLP 1.4.3 - Mac OS MontereyĀ 12.7.3, Sonoma 14.1.1 and MojaveĀ 10.14.6

Affinity Publisher,Ā Designer andĀ PhotoĀ 1.10.5 - 2.4.0 Betas 2.5.0(2430)

www.bingercreative.co.uk

Ā 

Ā 

Ā 

Ā 

Ā 

Link to comment
Share on other sites

2 hours ago, EmT said:

There is a known issue on Mac and iOS where the app can crash if the install button is pressed more than once or if both models are installed at the same time.Ā 
Can you try installing one model and then the other and it should be fine.Ā 

I've tried this but it still bombs on completion of download

Daz1.png

Mac Pro Cheese-grater (Early 2009)Ā 2.93 GHz 6-Core Intel XeonĀ 48 GB 1333 MHz DDR3 ECC Ram, Sapphire Pulse Radeon RX 580 8GB GDDR5,Ā Ugee 19" Graphics Tablet Monitor TripleĀ boot via OCLP 1.4.3 - Mac OS MontereyĀ 12.7.3, Sonoma 14.1.1 and MojaveĀ 10.14.6

Affinity Publisher,Ā Designer andĀ PhotoĀ 1.10.5 - 2.4.0 Betas 2.5.0(2430)

www.bingercreative.co.uk

Ā 

Ā 

Ā 

Ā 

Ā 

Link to comment
Share on other sites

25 minutes ago, Dazmondo77 said:

I've tried this but it still bombs on completion of download

Funny thing is I clicked one of the install buttons for one model and let it sit and with one button, both models installed - and that worked just fine - but all three beta apps are crashing for me after being open for a few minutes regardless of what I do or don't in the apps.

They are still trying to download the content from the account page, so guessing something with the download may be causing it, but in the meantime the current betas are all but useless to me under macOS as I can't spend much time on anything before they crash. Ā (I did report this in the bug section, btw, and it was acknowledged and passed on to the developers).

Link to comment
Share on other sites

3 hours ago, fde101 said:

the current betas are all but useless to me under macOS

Are you running on Intel? If that's the case perhaps try that "CPU only" option. I'm also on macOS but no issues so far.

Affinity 2.6.0 Beta | macOS Sequoia 15.1 | MacBook Pro 14" M1 Pro/16GB (2021) | XPPenĀ Artist Pro 16 (Gen 2)

Link to comment
Share on other sites

Very cool feature! I noticed however that it sometimes fails to recognise a selection as legitimate. For instance, every part of this I was able to select individually like the pants, shirt, pearls, and wall behind the person by holding down alt, except for the actual hand itself. You have to be very finicky with where you put your cursor to select specific pieces of your image.Ā image.png.39f1d4ae7155caf73c5d870083fce167.png

It would be cool as well if it was possible to select even more specific pieces like the red nail polish on the thumb or the colour of the lips, etc. Right now it seems to only allow for picking the larger areas like the face and not more specific things on the subject.

Link to comment
Share on other sites

I have purposely used two difficult images to try this out. Ā I Ā used both the Object Selection Tool by itself, and with the Object Selection Tool plus Select Subject plus Refine on the baby lions, With either method, there was not much difference from the Selection Brush Tool, except SPEED. Ā Which is lovely.

For the Horse, I used the Refine tool for each. Ā Again, not much difference, except SPEED. Ā 

I did find that the Hold Alt plus select components command was very uneven with the baby lions image. Ā The green diagonal bits kept flashing on and off and it was only until I clicked on REFINE that I was able to determine that I actually had all parts of both lions selected. Ā A bit unnerving.

I definitely concur with @carl123Ā that Refine is an extremely useful step!

Screenshot2024-10-24at16_35_13.thumb.png.384867b0f42fdedff2ba4f26eae69ec3.png

Ā 

Screenshot2024-10-24at16_24_42.thumb.png.b172b7af303da370ca4be8a5908c6dc5.png


24" iMACĀ Apple M1 chip,Ā 8-core CPU, 8-core GPU, 16 GB unified memory, 1 TB SSD storage, Ventura 13.6.7. Ā Photo, Publisher, Designer 1.10.5, and 2.5.5.
MacBook Pro 13" 2020, Apple M1 chip,Ā 16GB unified memory, 256GB Ā SSD storage
,Ā  Ventura 13.6.7. Ā  Publisher, Photo, Designer 1.10.5, and 2.1.1. Ā 
Ā iPad Pro 12.9 2020 (4th Gen. IOS 16.6.1); Apple pencil. Ā 
Wired and bluetooth miceĀ and keyboards.9_9

Link to comment
Share on other sites

On 10/23/2024 at 11:59 AM, nezumi said:

I love the fact that these are optional. I hope it will be kept that way and there will be choice of modules we want to install or keep it light and old school. If yes - thats absolutely fantastic solution.

Fully optional? Can we get the next versions without any AI/ML feature (if chosen so), or will there be integrated parts yes or yes? (I ask because I truly don't know)

AD, AP and APubĀ V2.5.x. Windows 10 and Windows 11.Ā 
Ā 

Ā 

Link to comment
Share on other sites

9 minutes ago, SrPx said:

Fully optional?

These two functions are fully optional. You must decide to download/install the models if you want the functions, and you must then decide to use the Object Selection Tool or the Select Subject function on a project if you want to use them.Ā 

Either don't install the models, or don't use the functions on a particular project, and they're not used.

-- Walt
Designer, Photo, and Publisher V1 and V2 at latest retail and beta releases
PC:
Ā Ā  Ā Desktop: Ā Windows 11 Pro 23H2, 64GB memory, AMD Ryzen 9 5900 12-Core @ 3.00 GHz, NVIDIA GeForce RTX 3090Ā 

Ā  Ā  Laptop:Ā  Windows 11 Pro 23H2, 32GB memory, Intel Core i7-10750H @ 2.60GHz, Intel UHD Graphics Comet Lake GT2 and NVIDIA GeForce RTX 3070 Laptop GPU.
Ā Ā Ā  Laptop 2: Windows 11 Pro 24H2,Ā  16GB memory, Snapdragon(R) X Elite - X1E80100 - Qualcomm(R) Oryon(TM) 12 Core CPU 4.01 GHz, Qualcomm(R) Adreno(TM) X1-85 GPU
iPad: Ā iPad Pro M1, 12.9": iPadOS 18.1, Apple Pencil 2, Magic KeyboardĀ 
Mac:Ā  2023 M2 MacBook Air 15", 16GB memory, macOS Sequoia 15.0.1

Link to comment
Share on other sites

20 minutes ago, walt.farrell said:

These two functions are fully optional. You must decide to download/install the models if you want the functions, and you must then decide to use the Object Selection Tool or the Select Subject function on a project if you want to use them.Ā 

Either don't install the models, or don't use the functions on a particular project, and they're not used.

I was worried about if at some point the models would get bundled in or something (in the future).Ā  Doesn't seem they will (hopefully).

Thank you.Ā  Ā :)Ā 

AD, AP and APubĀ V2.5.x. Windows 10 and Windows 11.Ā 
Ā 

Ā 

Link to comment
Share on other sites

3 hours ago, jmwellborn said:

Ā 

I have purposely used two difficult images to try this out. Ā I Ā used both the Object Selection Tool by itself, and with the Object Selection Tool plus Select Subject plus Refine on the baby lions, With either method, there was not much difference from the Selection Brush Tool, except SPEED. Ā Which is lovely.

Ā 

I agree. Itā€™s not really a better selection, as far as detecting the edges of an object, than the existing tool, but itā€™s faster and the conditional selection mode, where you can decide which part to select, is nice.Ā 
Ā 

I'm happy that the feature is available, though, and I appreciate the work Serif put into it. I hope it augurs the arrival of more improvements, like improved models for object selection and (most importantly to me) better object removal aā€™la the inpainting brush.Ā 

Link to comment
Share on other sites

Love the feature! Great work on all the generative fill features etc lately.

One comment: This feature seems to take up an absolute ton of memory. 5gb every time it processes a layer on my 1024x720 file. It also doesn't seem to ever release that memory. So on a 16gb machine, I can use this feature exactly twice before rebooting the app.

I'm planning to upgrade RAM soon, but that'll only help incrementally. Ideally when I switch tools it could dump the allocated memory for the object selection, or even a manual button for clearing the cache.

Link to comment
Share on other sites

  • Staff
47 minutes ago, Barrcodes said:

Great work on all the generative fill features etc lately.

Huh? What does this mean?

Patrick Connor
Serif Europe Ltd

"There is nothing noble in being superior to your fellow man. True nobility lies in being superior to your previous self."Ā  W. L. Sheldon

Ā 

Link to comment
Share on other sites

5 hours ago, Barrcodes said:

So on a 16gb machine, I can use this feature exactly twice

Before what problem occurs?

Memory is there to be used. Ā Allocating memory can be slow, so in some cases apps are designed to track memory use internally and not release it to the OS until there is a need for it from somewhere else; they can reuse the memory that way without needing to go through the slow process of asking for it again.

Just because the memory is not being quickly released to the OS does not in and of itself constitute a problem.

Are you experiencing an actual problem because the memory is not being released?

Link to comment
Share on other sites

What are the sizes of the downloaded files? And is it possible to have them located/installed on a different drive?Ā 

--------------------

New: 2023 Mac Studio M2 MAX 12-Core CPU/38-Core GPU 64GB Memory ā€¢ 5k Studio Display ā€¢ Sonoma
Prev: 2020 iMac 27 i7 (5k Rez), 72GB, AMD Radeon Pro 5700XT 16GB ā€¢ Sonoma
MacBook Pro, 13", M1 2020 ā€¢ 16 GB ā€¢ macOS Sonoma
iPad Air 2022

Link to comment
Share on other sites

2 hours ago, Return said:

404mb and most likely not to be installed anywhere else

Supposed to be 362 from the screenshot in the first post.

-- Walt
Designer, Photo, and Publisher V1 and V2 at latest retail and beta releases
PC:
Ā Ā  Ā Desktop: Ā Windows 11 Pro 23H2, 64GB memory, AMD Ryzen 9 5900 12-Core @ 3.00 GHz, NVIDIA GeForce RTX 3090Ā 

Ā  Ā  Laptop:Ā  Windows 11 Pro 23H2, 32GB memory, Intel Core i7-10750H @ 2.60GHz, Intel UHD Graphics Comet Lake GT2 and NVIDIA GeForce RTX 3070 Laptop GPU.
Ā Ā Ā  Laptop 2: Windows 11 Pro 24H2,Ā  16GB memory, Snapdragon(R) X Elite - X1E80100 - Qualcomm(R) Oryon(TM) 12 Core CPU 4.01 GHz, Qualcomm(R) Adreno(TM) X1-85 GPU
iPad: Ā iPad Pro M1, 12.9": iPadOS 18.1, Apple Pencil 2, Magic KeyboardĀ 
Mac:Ā  2023 M2 MacBook Air 15", 16GB memory, macOS Sequoia 15.0.1

Link to comment
Share on other sites

18 hours ago, walt.farrell said:

Supposed to be 362 from the screenshot in the first post.

Aha! Just saw that now, Walt! Old age and going blind I guess!Ā šŸ˜†

--------------------

New: 2023 Mac Studio M2 MAX 12-Core CPU/38-Core GPU 64GB Memory ā€¢ 5k Studio Display ā€¢ Sonoma
Prev: 2020 iMac 27 i7 (5k Rez), 72GB, AMD Radeon Pro 5700XT 16GB ā€¢ Sonoma
MacBook Pro, 13", M1 2020 ā€¢ 16 GB ā€¢ macOS Sonoma
iPad Air 2022

Link to comment
Share on other sites

  • Staff

Sorry but due to the functions we need to run the Object Selection and Subject Selection functionality (on macOS) we are going to have to make Machine Learning only available on Apple Silicon machines running on a recent macOS, so in the next build the Machine Learning libraries will not be available to download so it cannot crash. Sorry this limitations was not already in for the start of the beta. I have added a section on Compatibility to the initial post in this thread

Patrick Connor
Serif Europe Ltd

"There is nothing noble in being superior to your fellow man. True nobility lies in being superior to your previous self."Ā  W. L. Sheldon

Ā 

Link to comment
Share on other sites

What are the practical implications of this message?
I have an M1 Cpu and Sequoia.
Ā 

24" iMACĀ Apple M1 chip, iPad 8, MACOS Sonoma & iPadOS, Affinity V2-UniversallizenzĀ 

Link to comment
Share on other sites

56 minutes ago, j3rry said:

What are the practical implications of this message?
I have an M1 Cpu and Sequoia.

Patrick's post (scroll down to the Compatibility section) states that Apple Silicon chips (M1, M2, M3, M4...) with OS versions newer than Monterey will work so your computer makes the cut.

https://forum.affinity.serif.com/index.php?/topic/220858-machine-learning-object-selection-tool/

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
×
×
  • Create New...

Important Information

Terms of Use | Privacy Policy | Guidelines | We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.