Interpolate intermediate frames

Comments

CubeAce wrote on 11/26/2021, 2:11 PM

@Derek-McArthur @johnebaker @Scenestealer

Hi Derek.

Both your screen grabs were exactly 1920 x 1080 so effective enough for comparison and use as overlays and meaning you are working from a monitor of the same resolution as I am. I should be able to see a difference in those images if you can. Which can only mean one of two things. There is enough difference in the monitor(s) or the graphics card(s) powering it (them) to visualize a difference if there is one.

Ray.

 

Windows 10 Enterprise. Version 22H2 OS build 19045.5737

Direct X 12.1 latest hardware updates for Western Digital hard drives.

Asus ROG STRIX Z390-F Gaming motherboard Rev 1.xx with Supreme FX inboard audio using the S1220A code. Driver No 6.0.8960.1 Bios version 1401

Intel i9900K Coffee Lake 3.6 to 5.1GHz CPU with Intel UHD 630 Graphics .Driver version Graphics Driver 31.0.101.2135 for 7th-10th Gen Intel® with 64GB of 3200MHz Corsair DDR4 ram.

1000 watt EVGA modular power supply.

1 x 250GB Evo 970 NVMe: drive for C: drive backup 1 x 1TB Sabrent NVMe drive for Operating System / Programs only. 1X WD BLACK 1TB internal SATA 7,200rpm hard drives.1 for internal projects, 1 for Library clips/sounds/music/stills./backup of working projects. 1x500GB SSD current project only drive, 2x WD RED 2TB drives for latest footage storage. Total 31TB of 10 external WD drives for backup.

ASUS NVIDIA GeForce RTX 3060 12GB. nVidia Studio driver version 572.60 - 3584xCUDA cores Direct X 12.1. Memory interface 192bit Memory bandwidth 360.05GB/s 12GB of dedicated GDDR6 video memory, shared system memory 16307MB PCi Express x8 Gen3. Two Samsung 27" LED SA350 monitors with 5000000:1 contrast ratios at 60Hz.

Running MMS 2024 Suite v 23.0.1.182 (UDP3) and VPX 14 - v20.0.3.180 (UDP3)

M Audio Axiom AIR Mini MIDI keyboard Ver 5.10.0.3507

VXP 14, MMS 2024 Suite, Vegas Studio 16, Vegas Pro 18, Vegas Pro 21,Cubase 4. CS6, NX Studio, Mixcraft 9 Recording Studio. Mixcraft Pro 10 Studio. CS6 and DXO Photolab 8, OBS Studio.

Audio System 5 x matched bi-wired 150 watt Tannoy Reveal speakers plus one Tannoy 15" 250 watt sub with 5.1 class A amplifier. Tuned to room with Tannoy audio application.

Ram Acoustic Studio speakers amplified by NAD amplifier.

Rogers LS7 speakers run from Cambridge Audio P50 amplifier

Schrodinger's Backup. "The condition of any backup is unknown until a restore is attempted."

CubeAce wrote on 11/26/2021, 2:42 PM

@Derek-McArthur @Scenestealer @johnebaker

Hi Derek.

Have finished my own comparison on my machine. If you can, try doing the same on your machine please. You too please Peter.

I selected a frame from one of my 4K video clips in MEP 2022 and exported a BMP file with interpolation and one without.

I then imported them both into Photoshop exactly aligned to the pixel.

I then zoomed into various parts of the image to 1,200% where individual pixels become very visible.

By turning the top layer on and off and looking at individual and blocks of pixels I looked for changes across the image. I could find none. No stretching as in the previous experiment. Perfect match.

If you are seeing differences then I can only assume this is down to a graphics card difference in the handling of the two states of the images or something similar.

Ray.

 

Windows 10 Enterprise. Version 22H2 OS build 19045.5737

Direct X 12.1 latest hardware updates for Western Digital hard drives.

Asus ROG STRIX Z390-F Gaming motherboard Rev 1.xx with Supreme FX inboard audio using the S1220A code. Driver No 6.0.8960.1 Bios version 1401

Intel i9900K Coffee Lake 3.6 to 5.1GHz CPU with Intel UHD 630 Graphics .Driver version Graphics Driver 31.0.101.2135 for 7th-10th Gen Intel® with 64GB of 3200MHz Corsair DDR4 ram.

1000 watt EVGA modular power supply.

1 x 250GB Evo 970 NVMe: drive for C: drive backup 1 x 1TB Sabrent NVMe drive for Operating System / Programs only. 1X WD BLACK 1TB internal SATA 7,200rpm hard drives.1 for internal projects, 1 for Library clips/sounds/music/stills./backup of working projects. 1x500GB SSD current project only drive, 2x WD RED 2TB drives for latest footage storage. Total 31TB of 10 external WD drives for backup.

ASUS NVIDIA GeForce RTX 3060 12GB. nVidia Studio driver version 572.60 - 3584xCUDA cores Direct X 12.1. Memory interface 192bit Memory bandwidth 360.05GB/s 12GB of dedicated GDDR6 video memory, shared system memory 16307MB PCi Express x8 Gen3. Two Samsung 27" LED SA350 monitors with 5000000:1 contrast ratios at 60Hz.

Running MMS 2024 Suite v 23.0.1.182 (UDP3) and VPX 14 - v20.0.3.180 (UDP3)

M Audio Axiom AIR Mini MIDI keyboard Ver 5.10.0.3507

VXP 14, MMS 2024 Suite, Vegas Studio 16, Vegas Pro 18, Vegas Pro 21,Cubase 4. CS6, NX Studio, Mixcraft 9 Recording Studio. Mixcraft Pro 10 Studio. CS6 and DXO Photolab 8, OBS Studio.

Audio System 5 x matched bi-wired 150 watt Tannoy Reveal speakers plus one Tannoy 15" 250 watt sub with 5.1 class A amplifier. Tuned to room with Tannoy audio application.

Ram Acoustic Studio speakers amplified by NAD amplifier.

Rogers LS7 speakers run from Cambridge Audio P50 amplifier

Schrodinger's Backup. "The condition of any backup is unknown until a restore is attempted."

Derek-McArthur wrote on 11/26/2021, 3:01 PM

Hi Ray

It's weird as some frames are perfect and some frames are quite far off, here is a split screen jpg of a frame which is off

The left is without interpolation and the right has it on by default

johnebaker wrote on 11/26/2021, 3:15 PM

@CubeAce

Hi Ray

I suspect you are not seeing any difference when exporting as BMP, or any other image format, due to the technique of creating a still image from video.

The general technique, as I understand it, and applies to other video editors, relies on combining several frames eg I, and/or B, and/or P frames to build a composite image which is an average representation of the point on the timeline where the cursor is, if it falls on an I frame then that frame may potentially used, for other video formats that do not use I,B and P frames, in principle a similar method is used.

Whether the Interpolation option takes part in this I do not know, however I would suspect not as the rebuild already involves interpolation irrespective of the option setting.

John EB

VPX 16, Movie Studio 2025, and earlier versions 2015 and 2016, Music Maker Premium 2024.

PC - running Windows 11 23H2 Professional on Intel i7-8700K 3.2 GHz, 16GB RAM, RTX 2060 6GB 192-bit GDDR6, 1 x 1Tb Sabrent NVME SSD (OS and programs), 2 x 4TB (Data) internal HDD + 1TB internal SSD (Work disc), + 6 ext backup HDDs.

Laptop - Lenovo Legion 5i Phantom - running Windows 11 24H2 on Intel Core i7-10750H, 16GB DDR4-SDRAM, 512GB SSD, 43.9 cm screen Full HD 1920 x 1080, Intel UHD 630 iGPU and NVIDIA GeForce RTX 2060 (6GB GDDR6)

Sony FDR-AX53e Video camera, DJI Osmo Action 3 and Sony HDR-AS30V Sports cams.

Scenestealer wrote on 11/26/2021, 3:16 PM

@Derek-McArthur @CubeAce @johnebaker

Gee...Derek and I must have really good monitors or eyes or something, because the effect is very obvious in the grass in the bottom left quarter of the frame where the grass is moving in the wind creating the movement I alluded to, across the frame.

Another way that might make it more obvious is to slomo some footage with rapid movement then step through after exporting and bringing it back into the timeline.

as looking at a single frame, or stepping through frame by frame, is very much like looking at a single frame of a movie on 65 - 75 mm film - apparent lower quality.

To be fair a lot of that lower quality is caused by not having the benefit of the random nature of the film grain combining for a perceived smoothing of the grain effect when projected. Digital progressive frames should not suffer from this.

Peter

 

Last changed by Scenestealer on 11/26/2021, 6:01 PM, changed a total of 1 times.

System Specs: Intel 6th Gen i7 6700K 4Ghz O.C.4.6GHz, Asus Z170 Pro Gaming MoBo, 16GB DDR4 2133Mhz RAM, Samsung 850 EVO 512GB SSD system disc WD Black 4TB HDD Video Storage, Nvidia GTX1060 OC 6GB, Win10 Pro 2004, MEP2016, 2022 (V21.0.1.92) Premium and prior, VPX7, VPX12 (V18.0.1.85). Microsoft Surface Pro3 i5 4300U 1.9GHz Max 2.6Ghz, HDGraphics 4400, 4GB Ram 128GB SSD + 64GB Strontium Micro SD card, Win 10Pro 2004, MEP2015 Premium.

CubeAce wrote on 11/26/2021, 3:42 PM

@johnebaker

Hi John.

I chose BMP over jpeg or png due to the lack of compression of that format.

If what you are saying is true and as I can't tell if I have an I frame or not then in theory no still image should be showing a difference that people are saying they can see between the images previously shown.

Perhaps you are correct and a video clip is in order but I can't see a difference between clips on my system anyway.

To me there are too many variables in the problem to be sure what is happening. Does turning interpolation switch which GPU shows the image during playback or export for instance? I don't know.

There are also so many options on exporting that can make a video better or worse image quality wise that I wonder what amount of difference this one option makes. Also to what end is the final videos' proposed use? What restraints are there in bits used or effects / colour correction / sharpening /noise reduction, making?

Ray.

 

 

 

 

Windows 10 Enterprise. Version 22H2 OS build 19045.5737

Direct X 12.1 latest hardware updates for Western Digital hard drives.

Asus ROG STRIX Z390-F Gaming motherboard Rev 1.xx with Supreme FX inboard audio using the S1220A code. Driver No 6.0.8960.1 Bios version 1401

Intel i9900K Coffee Lake 3.6 to 5.1GHz CPU with Intel UHD 630 Graphics .Driver version Graphics Driver 31.0.101.2135 for 7th-10th Gen Intel® with 64GB of 3200MHz Corsair DDR4 ram.

1000 watt EVGA modular power supply.

1 x 250GB Evo 970 NVMe: drive for C: drive backup 1 x 1TB Sabrent NVMe drive for Operating System / Programs only. 1X WD BLACK 1TB internal SATA 7,200rpm hard drives.1 for internal projects, 1 for Library clips/sounds/music/stills./backup of working projects. 1x500GB SSD current project only drive, 2x WD RED 2TB drives for latest footage storage. Total 31TB of 10 external WD drives for backup.

ASUS NVIDIA GeForce RTX 3060 12GB. nVidia Studio driver version 572.60 - 3584xCUDA cores Direct X 12.1. Memory interface 192bit Memory bandwidth 360.05GB/s 12GB of dedicated GDDR6 video memory, shared system memory 16307MB PCi Express x8 Gen3. Two Samsung 27" LED SA350 monitors with 5000000:1 contrast ratios at 60Hz.

Running MMS 2024 Suite v 23.0.1.182 (UDP3) and VPX 14 - v20.0.3.180 (UDP3)

M Audio Axiom AIR Mini MIDI keyboard Ver 5.10.0.3507

VXP 14, MMS 2024 Suite, Vegas Studio 16, Vegas Pro 18, Vegas Pro 21,Cubase 4. CS6, NX Studio, Mixcraft 9 Recording Studio. Mixcraft Pro 10 Studio. CS6 and DXO Photolab 8, OBS Studio.

Audio System 5 x matched bi-wired 150 watt Tannoy Reveal speakers plus one Tannoy 15" 250 watt sub with 5.1 class A amplifier. Tuned to room with Tannoy audio application.

Ram Acoustic Studio speakers amplified by NAD amplifier.

Rogers LS7 speakers run from Cambridge Audio P50 amplifier

Schrodinger's Backup. "The condition of any backup is unknown until a restore is attempted."

johnebaker wrote on 11/26/2021, 3:56 PM

@Derek-McArthur, @Scenestealer

Derek

Thanks for the video clips - definitely noticeable on the Interpolated video.

Peter

. . . . Derek and I must have really good monitors or eyes or something, because the effect is very obvious in the grass in the bottom left quarter of the frame where the grass is moving in the wind creating movement I alluded to, across the frame. . . .

I agree the grass could be moving causing the effect, however due to the 'twist' in the fence posts further back in the scene cast doubt on the movement theory hence my question to Derek on how the images were 'captured'.

The videos however are even better- see about between 3 and 4 secs in when the guy front left raises his hat.

John EB

Last changed by johnebaker on 11/26/2021, 3:57 PM, changed a total of 1 times.

VPX 16, Movie Studio 2025, and earlier versions 2015 and 2016, Music Maker Premium 2024.

PC - running Windows 11 23H2 Professional on Intel i7-8700K 3.2 GHz, 16GB RAM, RTX 2060 6GB 192-bit GDDR6, 1 x 1Tb Sabrent NVME SSD (OS and programs), 2 x 4TB (Data) internal HDD + 1TB internal SSD (Work disc), + 6 ext backup HDDs.

Laptop - Lenovo Legion 5i Phantom - running Windows 11 24H2 on Intel Core i7-10750H, 16GB DDR4-SDRAM, 512GB SSD, 43.9 cm screen Full HD 1920 x 1080, Intel UHD 630 iGPU and NVIDIA GeForce RTX 2060 (6GB GDDR6)

Sony FDR-AX53e Video camera, DJI Osmo Action 3 and Sony HDR-AS30V Sports cams.

CubeAce wrote on 11/26/2021, 4:06 PM

@Derek-McArthur @Scenestealer @johnebaker

Hi Derek.

OK I can see differences between the two and the one without is definitely sharper. No question.

That Then led me to look at the clips media info and there are slight variations in the average bit depths between the two with the interpolated video being very slightly smaller. Enough to make that much difference? possibly not. Enough to say the processing changed? probably.

The next step for me then is to replicate your findings and look at the MediaInfo data.

Out of interest what are your export settings as I don't use any of MEPs or VPXs presets but tend to rely on my own tweaked versions. Maybe that is the difference.

Ray.

Last changed by CubeAce on 11/26/2021, 4:08 PM, changed a total of 1 times.

 

Windows 10 Enterprise. Version 22H2 OS build 19045.5737

Direct X 12.1 latest hardware updates for Western Digital hard drives.

Asus ROG STRIX Z390-F Gaming motherboard Rev 1.xx with Supreme FX inboard audio using the S1220A code. Driver No 6.0.8960.1 Bios version 1401

Intel i9900K Coffee Lake 3.6 to 5.1GHz CPU with Intel UHD 630 Graphics .Driver version Graphics Driver 31.0.101.2135 for 7th-10th Gen Intel® with 64GB of 3200MHz Corsair DDR4 ram.

1000 watt EVGA modular power supply.

1 x 250GB Evo 970 NVMe: drive for C: drive backup 1 x 1TB Sabrent NVMe drive for Operating System / Programs only. 1X WD BLACK 1TB internal SATA 7,200rpm hard drives.1 for internal projects, 1 for Library clips/sounds/music/stills./backup of working projects. 1x500GB SSD current project only drive, 2x WD RED 2TB drives for latest footage storage. Total 31TB of 10 external WD drives for backup.

ASUS NVIDIA GeForce RTX 3060 12GB. nVidia Studio driver version 572.60 - 3584xCUDA cores Direct X 12.1. Memory interface 192bit Memory bandwidth 360.05GB/s 12GB of dedicated GDDR6 video memory, shared system memory 16307MB PCi Express x8 Gen3. Two Samsung 27" LED SA350 monitors with 5000000:1 contrast ratios at 60Hz.

Running MMS 2024 Suite v 23.0.1.182 (UDP3) and VPX 14 - v20.0.3.180 (UDP3)

M Audio Axiom AIR Mini MIDI keyboard Ver 5.10.0.3507

VXP 14, MMS 2024 Suite, Vegas Studio 16, Vegas Pro 18, Vegas Pro 21,Cubase 4. CS6, NX Studio, Mixcraft 9 Recording Studio. Mixcraft Pro 10 Studio. CS6 and DXO Photolab 8, OBS Studio.

Audio System 5 x matched bi-wired 150 watt Tannoy Reveal speakers plus one Tannoy 15" 250 watt sub with 5.1 class A amplifier. Tuned to room with Tannoy audio application.

Ram Acoustic Studio speakers amplified by NAD amplifier.

Rogers LS7 speakers run from Cambridge Audio P50 amplifier

Schrodinger's Backup. "The condition of any backup is unknown until a restore is attempted."

Derek-McArthur wrote on 11/27/2021, 4:46 AM

It was just a quick preset MPEG-4 export

Scenestealer wrote on 11/27/2021, 5:17 AM

@Derek-McArthur @johnebaker @CubeAce

Hi

Attached is a clip that was recorded 3840 x 2160 25p then slowed down to 6.25 fps with interpolate checked in the object properties (leading to the check mark appearing in the speed effect) and exported to the same format at 25P.

The result is a mess with a complete image only every 4 frames and the other 3 being some sort of half images that don't seem to even be in the proper sequence.

Below is the same clip with Interpolate unchecked.

The same 25P clip with interpolate exported to 50fps exibits the same double imaging on fast moving elements as in Dereks sample but of course only every second frame.

I will go as far as to say the effect during MEP / VPX preview does not appear unless the project frame rate is different to the clip rate, or during export if the speed effect FR differs from the export FR.

Once the undesired effect is present in the exported clip ie it is baked in, it is visible on my Plasma TV in MEP and MS Film and TV Player.

Peter

System Specs: Intel 6th Gen i7 6700K 4Ghz O.C.4.6GHz, Asus Z170 Pro Gaming MoBo, 16GB DDR4 2133Mhz RAM, Samsung 850 EVO 512GB SSD system disc WD Black 4TB HDD Video Storage, Nvidia GTX1060 OC 6GB, Win10 Pro 2004, MEP2016, 2022 (V21.0.1.92) Premium and prior, VPX7, VPX12 (V18.0.1.85). Microsoft Surface Pro3 i5 4300U 1.9GHz Max 2.6Ghz, HDGraphics 4400, 4GB Ram 128GB SSD + 64GB Strontium Micro SD card, Win 10Pro 2004, MEP2015 Premium.