Does MEP have any AI-Plugins that remove people from video footage?

Apollo89x wrote on 12/3/2021, 11:08 AM

Hello, I just wondered if there are any plug-ins available for MEP which allow you to remove (erase) a person from video footage?

I've seen that there are a few for Adobe After-Effects, and so worst case I will have to use AE & those for this editing;
However I'd much prefer to use MEP for this stage of the editing, as it's far more user-friendly vs AE.

*Specifically I'd be seeking a feature which was easy & simple to deploy; So basically just draw a box around the subject you want erased, and it to then be tracked & erased from the video-footage accordingly.

Comments

Former user wrote on 12/3/2021, 11:25 AM

@Apollo89x The only one i know of is Boris Mocha Pro, but that isn't cheap £500 & it doesn't work in MEP. I have it for Vegas & it works in other hosts like Adobe AE like you say, I have the standalone version too where you don't need a host but that really isn't cheap £1100.

CubeAce wrote on 12/3/2021, 12:49 PM

@Apollo89x @Former user

Hi.

ProDad Hide works but the type of clips it will work with is limited because it must also have access to the background behind the object within a given amount of frames so as to replace the missing object or person.

It is very processor intensive and can take hours to render at any sort of higher resolution.

It may well be possible to get better results than I did with a more powerful system or taking more time.

Ray.

Apollo89x wrote on 12/3/2021, 1:44 PM

Ahh no that's a shame! :(

But no worries, I will just use AE's built-in eraser feature then for this.

Thankyou anyways though for the info

Former user wrote on 12/3/2021, 2:15 PM

@CubeAce @Apollo89x Mocha is the same, you need the person to be moving so it can see & replicate the background, you can fill in areas that aren't seen using a captured image (cleanplate), then erase & fill in the missing bits in Photoshop etc & mocha will refer to that instead. but same as you say, Mocha uses loads of power.

Former user wrote on 12/3/2021, 2:21 PM

@Apollo89x is the camera moving?

Apollo89x wrote on 12/3/2021, 6:29 PM

So I tried After-Effects built-in eraser tool, however it's not AI-automated (nor even has auto-tracking capability like MEP does for masks), so you would basically have to manually drag the mask along every frame of the footage, to keep it tracking & removing the subject... :|

I have found software that seems to do the job perfectly: https://github.com/zllrunning/video-object-removal

However sadly there are no instructions of how to convert/install that code/files into being usable features on AE or MEP! :(

CubeAce wrote on 12/3/2021, 7:48 PM

@Apollo89x @Former user

Hi.

Not being funny but the results posted there are worse than I can do with ProDad Hide.

Once you know what to look for any wobble becomes amazingly annoying, and looks like a wonky heat haze, and looking at the examples on that site it has the same restrictions I described earlier. There must be a clear view of the background for at least half as many frames in front and behind for the object to move into so it can be removed by the program.It needs to calculate what pixels will go where to fill in the missing segment. That background must have no noticeable counter movement within it. Worse, that program one can only remove square sections.

Trust me, anything like this is a lot of work sometimes involving using multiple overlapping masks, and the higher quality you want the result to be the longer the rendering time involved. Honestly the tank section of the video you saw at the end of my last video took 16 hours to render as most of the processing has to be done by a CPU and not a GPU. This is where a large, many core Ryzen processor would win out over any Intel one.

Ray.