Benchmark Test for 2023

CubeAce wrote on 2/19/2023, 4:05 PM

I last ran a benchmark test in 2020. There were not that many people who took up the task then and it fizzled out a bit.

So I will re-open the same test I did back then to anyone who wants to either try it again on the newer versions of the software or for the first time.

However, if possible I would ask the mods to delete any replies here that do not have just the test results and verifications I expect to see and I will now go through the rules and eligibility requirements.

First it will be the same project as before. I have checked that there are no effects used then that will not load now. All still seems to be compatible with the newest versions of the programs of both Movie Studio and Video Pro X.

Second there is little advantage to be gained by having an Intel inboard GPU. At most I have observed a 5% usage tops for very limited time periods throughout the project. I hope this will even things out a bit for those using AMD processors.

To be able to get the files please make your request on this topic and not here.

No person shall receive files until all their relevant computer specs are listed in their Signatures.

They can also if they wish upload a picture but do not include any personal information such as Computer ID, Serial Number.

You may want to make a folder to download the files to first as for some reason the link will allow a download of all the files but not the folder I think.

There will only be one MVD file. Click on it to open or right click it to 'Open with' if you are going to test it on more than one program.

Do Not allow proxy files to be made on import.

Do Not create a preview render or enable any part of the blue lightning for the first test of playback.

You May alter sound buffers or optimise the Import, Processing, and Export settings if that helps but you must include these settings anyway in your reported findings. Images are acceptable. Also include any drives used either for where the project was placed or the exported render is sent to. Do not use your desktop to place your files on to. That may skew the results due to it's protected status.

If you miss anything don't worry. I will PM you at some point requesting the specific missing information.

If for any reason you cannot or have difficulty complying with any of the above please enquire in the registration topic link to be discussed.

On the playback test just note any juddering that may occur or pausing. Note at what point such events occur. It may help to have Task Manager open to see if a drive, GPU, CPU, or memory maxes out when it happens. Never 'Save Project' on closing the program.

For now only bother to render the project to MP4 and again to HEVC using the project default settings. HEVC will need help.

For HEVC Choose the same 4K resolution as before for MP4 but in the frame rate box alter the frame rate from 25fps to 50fps and in the Maximum GOP length section alter the GOP to 50. Leave everything else the same and the sections should look like these.

4K exporting referred to in this instance is UHD (3840 x 2160), not full 4K (4096 x 2160).

HEVC

MP4

Please note that although my settings show 'export selected range only' box is ticked, if the project is not touched the whole project will be exported anyway. If worried, please untick your box on the 'export selected range only.'

Keep both files for later verification. Make a note of the export times.

Come back to this Topic to post export time results for each format including which version of the program used. Just MEP 2017-18-19-whatever or VPX -11-12, 13, and not the build unless not a fully patched copy but still include the basic program version please. I will ask the mods to please delete any post here not relating to results to keep the results tidy. If you wish you can also try additional exports to a lower resolution but stick to 50fps and a GOP of 50 please.

[Addendum]

It was brought to my attention last night that HEVC at 50 fps and the '4K' setting was not possible. It was remiss of me not to add that information other than in the image provided above. Simply use the HEVC 25 fps setting but manually change the frame and GOP settings to 50.

For general discussion please use the registration topic.

Thank you.

Below I will add those who have had file links sent to them.

Ray.

Marc-Goder.... John Brown,,,, Gid.,,,, MarcinKrk,,,,, John Baker,,,,, Gerrit-Paul,,,,, Willi333

 

Results verified :

Marc-Goder: John Brown: John Baker: MarkinKrk:

Last changed by CubeAce

 

Windows 10 Enterprise. Version 22H2 OS build 19045.4894

Direct X 12.1 latest hardware updates for Western Digital hard drives.

Asus ROG STRIX Z390-F Gaming motherboard Rev 1.xx with Supreme FX inboard audio using the S1220A code. Driver No 6.0.8960.1 Bios version 1401

Intel i9900K Coffee Lake 3.6 to 5.1GHz CPU with Intel UHD 630 Graphics .Driver version Graphics Driver 31.0.101.2130 for 7th-10th Gen Intel® with 64GB of 3200MHz Corsair DDR4 ram.

1000 watt EVGA modular power supply.

1 x 250GB Evo 970 NVMe: drive for C: drive backup 1 x 1TB Sabrent NVMe drive for Operating System / Programs only. 1X WD BLACK 1TB internal SATA 7,200rpm hard drives.1 for internal projects, 1 for Library clips/sounds/music/stills./backup of working projects. 1x500GB SSD current project only drive, 2x WD RED 2TB drives for latest footage storage. Total 21TB of 8 external WD drives for backup.

ASUS NVIDIA GeForce RTX 3060 12GB. nVidia Studio driver version 560.81 - 3584xCUDA cores Direct X 12.1. Memory interface 192bit Memory bandwidth 360.05GB/s 12GB of dedicated GDDR6 video memory, shared system memory 16307MB PCi Express x8 Gen3. Two Samsung 27" LED SA350 monitors with 5000000:1 contrast ratios at 60Hz.

Running MMS 2024 Suite v 23.0.1.182 (UDP3) and VPX 14 - v20.0.3.180 (UDP3)

M Audio Axiom AIR Mini MIDI keyboard Ver 5.10.0.3507

VXP 14, MMS 2024 Suite, Vegas Studio 16, Vegas Pro 18, Cubase 4. CS6, NX Studio, Mixcraft 9 Recording Studio. Mixcraft Pro 10 Studio.

Audio System 5 x matched bi-wired 150 watt Tannoy Reveal speakers plus one Tannoy 15" 250 watt sub with 5.1 class A amplifier. Tuned to room with Tannoy audio application.

Ram Acoustic Studio speakers amplified by NAD amplifier.

Rogers LS7 speakers run from Cambridge Audio P50 amplifier

Schrodinger's Backup. "The condition of any backup is unknown until a restore is attempted."

Comments

CubeAce wrote on 2/19/2023, 7:06 PM

Last time I ran the project I think I was using MEP 2019 and only tested rendering to MP4.

My best time for an export then was 13 minutes 1 second.

My system specs have only changed from 32 GB of ram to 64GB of ram now. The project hardly uses more than 7GBs of ram so I don't personally think it made a difference.

It has been interesting running the test again using MEP 2022 and VPX 14. It has shown me that although I have complained about the performance of VPX not giving me as smooth a playback as VPX 12 that the overall performance of both MEP 2022 and VPX 14 has got better.

So for Movie Edit Pro 2022 my export time for the MP4 export was 9 minutes 54 secs. HEVC export was a nearly identical time of 9 minutes 56 seconds. Import, Processing, and Export settings were all set to the nvidia card.

In VPX 14, export time for MP4 was 7 minutes 17 seconds and for HEVC it was 7 minutes 7 seconds . All tests were done in 4K only.

In MEP 2022 I had juddery playback during the expanding and contracting opening yellow titles. with no sign of any part of the system maxing out. I also got a slight pause and a sharp spike in the drive speed reading during the swirl blend between the two video sections. I also had slight stuttering during the closing graphics section.

VPX 14 playback was flawless.

Ray.

Last changed by CubeAce on 2/21/2023, 2:21 AM, changed a total of 3 times.

 

Windows 10 Enterprise. Version 22H2 OS build 19045.4894

Direct X 12.1 latest hardware updates for Western Digital hard drives.

Asus ROG STRIX Z390-F Gaming motherboard Rev 1.xx with Supreme FX inboard audio using the S1220A code. Driver No 6.0.8960.1 Bios version 1401

Intel i9900K Coffee Lake 3.6 to 5.1GHz CPU with Intel UHD 630 Graphics .Driver version Graphics Driver 31.0.101.2130 for 7th-10th Gen Intel® with 64GB of 3200MHz Corsair DDR4 ram.

1000 watt EVGA modular power supply.

1 x 250GB Evo 970 NVMe: drive for C: drive backup 1 x 1TB Sabrent NVMe drive for Operating System / Programs only. 1X WD BLACK 1TB internal SATA 7,200rpm hard drives.1 for internal projects, 1 for Library clips/sounds/music/stills./backup of working projects. 1x500GB SSD current project only drive, 2x WD RED 2TB drives for latest footage storage. Total 21TB of 8 external WD drives for backup.

ASUS NVIDIA GeForce RTX 3060 12GB. nVidia Studio driver version 560.81 - 3584xCUDA cores Direct X 12.1. Memory interface 192bit Memory bandwidth 360.05GB/s 12GB of dedicated GDDR6 video memory, shared system memory 16307MB PCi Express x8 Gen3. Two Samsung 27" LED SA350 monitors with 5000000:1 contrast ratios at 60Hz.

Running MMS 2024 Suite v 23.0.1.182 (UDP3) and VPX 14 - v20.0.3.180 (UDP3)

M Audio Axiom AIR Mini MIDI keyboard Ver 5.10.0.3507

VXP 14, MMS 2024 Suite, Vegas Studio 16, Vegas Pro 18, Cubase 4. CS6, NX Studio, Mixcraft 9 Recording Studio. Mixcraft Pro 10 Studio.

Audio System 5 x matched bi-wired 150 watt Tannoy Reveal speakers plus one Tannoy 15" 250 watt sub with 5.1 class A amplifier. Tuned to room with Tannoy audio application.

Ram Acoustic Studio speakers amplified by NAD amplifier.

Rogers LS7 speakers run from Cambridge Audio P50 amplifier

Schrodinger's Backup. "The condition of any backup is unknown until a restore is attempted."

Marc-Goder wrote on 2/19/2023, 8:24 PM

Hello,
These are my results. All settings as described by CubeAce.

Important : this Test was done with a laptop that was plugged in during the test.
Without a connection to the power supply, the performance of the laptop is around 40% lower.

Windows is up to date.
NVidia RTX 3060 Mobile (TDP=130 Watt) (6GB)
Arbeitsspeicher RAM 16GB,
Windows 10 (22H2)

NVidia Driver Version 497.29
Intel I-GPU HD630 is DISABLE in the Bios
Resizable BAR (rBAR) =ON

Import , Processing and Export all RTX 3060
Playback plays completely smooth
Screencast from Playback:
https://drive.google.com/file/d/1VXioufD8Thw7-zRGSSXoyzn8jX_vGQI2/view?usp=share_link

Export AVCHD H264 - 5:54 Minuten
Export HEVC H265 - 5:56 Minuten

Here are the Media Info Files:
AVCHD H264:

HEVC H265:

Addendum:
In a second test, I changed the average bit rate for H264 to 28 MB and the maximum bit rate to 48 MB and CPB Kilobytes = 0 (for automatic)

At H265 average bitrate 24MB and maximum bitrate to 32MB as well as CPB Kilobytes =0 (for automatic)
Time:
H264 = 5:56 Min.
H265 = 5:57.5 Min.

The time difference is about 2 seconds.
-----------------------------------------------------------------------------
Thanks to CubeAce for his effort, which makes something like this possible.

Last changed by Marc-Goder on 2/22/2023, 8:09 AM, changed a total of 6 times.

Magix Video Deluxe 2022 Premium (2.138)

Rechner: MSI Leopard GP76 , Intel I7-10870H,

NVidia RTX 3060 Mobile (TDP=130 Watt) (6GB),
Treiber-Version 31.0.15.5222

Arbeitsspeicher RAM 16GB,

Intel HD 630 On-Board I-GPU= deaktiviert.

Windows 10 (Auto-Update + Manuell) Ver.19045.4355

Weitere Video Software: CAPCUT
Konverter: Handbrake

Since 03.02.2024 experementil successfull with K-Lite-Codec Pack.

( Windows 11 kann ich nicht. Krieg ich Blähungen und Bluthochdruck von )

 

MarcinKrk wrote on 2/20/2023, 4:23 PM

My setup:

OS: Windows 11 Pro, 22H2

Motherboard: Gigabyte Z390 Aorus Rog

RAM: 32.0 GB

CPU: Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz   3.60 GHz

GPU: NVIDIA GeForce GTX 1070Ti, Driver version: 528.49, Release date: 02/08/2023

Running: MAGIX Movie Studio 2023 Suite

 

My results were as follow:

MP4  -  6:28
HEVC -  6:38

Interestingly enough, neither my CPU nor GPU was maxing out (few screenshots below):


 

Playback of the first 5 seconds was quite bumpy and stuttered. It also was the most time-consuming part of the movie to encode.

I've also noticed, that during the playback (through out the project), the timeline marker wasn't moving smoothly. It looked like if it was getting stuck every ~1sec, and then was catching up again, to get stuck - and so on.

Also after jumping to a random place on the timeline rendering video preview is not immediate - it takes a small lag for the video preview to refresh...

 

 

Last changed by MarcinKrk on 2/25/2023, 2:59 AM, changed a total of 1 times.

OS: Windows 11 Pro, 22H2

Motherboard: Gigabyte Z390 Aorus Rog

RAM: 32.0 GB

CPU: Intel(R) Core(TM) i7-9700K CPU @ 3.60GHz   3.60 GHz

GPU: NVIDIA GeForce GTX 1070Ti

Running: MAGIX Movie Studio 2023 Suite

 

browj2 wrote on 2/22/2023, 11:48 AM

@CubeAce

Device name    John-ROG
Processor    Intel(R) Core(TM) i7-10700K CPU @ 3.80GHz   3.79 GHz
Installed RAM    32.0 GB (31.8 GB usable)
System type    64-bit operating system, x64-based processor
Pen and touch    No pen or touch input is available for this display

Edition    Windows 10 Pro
Version    22H2
Installed on    ‎2021-‎11-‎10
OS build    19045.2604
Experience    Windows Feature Experience Pack 120.2212.4190.0

NVIDIA GeForce RTX 3060 - 12GB


I used the Studio Driver for first tests. The Game Ready Driver shaved off about 6 seconds from the first test below.

Playback stutters for first 21-22 seconds, more evident at the transition at about 22 seconds. Also the last 8 seconds suttered. For both cases, export slowed down significantly.

TEST 1 - VPX14 20.0.3.176

Device Options:

  • Import: Intel UHD Graphics 630
  • Processing: NVIDIA GeForce RTX 3060
  • Export: NVIDIA GeForce RTX 3060

The load was shared by Intel and NVIDIA.

Nothing significant on the disk drives.

Results

  • MP4 Export time: 11:05
  • HEVC Export time: 11:20

General
Complete name                            : O:\Magix\Video projects\VPX\2 Minute Tech Tips Audio Master1.mp4
Format                                   : MPEG-4
Format profile                           : Base Media
Codec ID                                 : isom (isom/avc1)
File size                                : 1.33 GiB
Duration                                 : 2 min 21 s
Overall bit rate mode                    : Variable
Overall bit rate                         : 80.4 Mb/s
Encoded date                             : UTC 2023-02-21 15:23:21
Tagged date                              : UTC 2023-02-21 15:23:21

Video
ID                                       : 1
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L5.2
Format settings                          : CABAC / 4 Ref Frames
Format settings, CABAC                   : Yes
Format settings, Reference frames        : 4 frames
Format settings, GOP                     : M=3, N=50
Codec ID                                 : avc1
Codec ID/Info                            : Advanced Video Coding
Duration                                 : 2 min 21 s
Bit rate                                 : 80.2 Mb/s
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 50.000 FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0
Bit depth                                : 8 bits
Scan type                                : Progressive
Bits/(Pixel*Frame)                       : 0.193
Stream size                              : 1.32 GiB (100%)
Language                                 : English
Encoded date                             : UTC 2023-02-21 15:23:21
Tagged date                              : UTC 2023-02-21 15:23:21
Codec configuration box                  : avcC

Audio
ID                                       : 2
Format                                   : AAC LC
Format/Info                              : Advanced Audio Codec Low Complexity
Codec ID                                 : mp4a-40-2
Duration                                 : 2 min 21 s
Bit rate mode                            : Variable
Bit rate                                 : 196 kb/s
Channel(s)                               : 2 channels
Channel layout                           : L R
Sampling rate                            : 48.0 kHz
Frame rate                               : 46.875 FPS (1024 SPF)
Compression mode                         : Lossy
Stream size                              : 3.31 MiB (0%)
Language                                 : English
Encoded date                             : UTC 2023-02-21 15:23:21
Tagged date                              : UTC 2023-02-21 15:23:21
mdhd_Duration                            : 141525

TEST 2 - VPX14 20.0.3.176

Device Options:

  • Import: Intel UHD Graphics 630
  • Processing: Intel UHD Graphics 630
  • Export: Intel UHD Graphics 630

Results

MP4 Export time: 14:47

Did not test HEVC

TEST 3 - VPX14 20.0.3.176

Device Options:

  • Import: Intel UHD Graphics 630
  • Processing: Intel UHD Graphics 630
  • Export: NVIDIA GeForce RTX 3060

Results

MP4 Export time: 14:16

Did not test HEVC

TEST 4 - Movie Studio Suite 2023 - 22.0.3.167

Device Options:

  • Import: Intel UHD Graphics 630
  • Processing: NVIDIA GeForce RTX 3060
  • Export: NVIDIA GeForce RTX 3060

Results

  • MP4 Export time: 10:59
  • HEVC Export time: 11:08

John CB

Last changed by browj2 on 2/22/2023, 11:58 AM, changed a total of 2 times.

John C.B.

VideoPro X(16); Movie Studio 2024 Platinum; MM2024 with MM2023 Premium Edition; Samplitude Pro X8 Suite; see About me for more.

Desktop System - Windows 10 Pro 22H2; MB ROG STRIX B560-A Gaming WiFi; Graphics Card Zotac Gaming NVIDIA GeForce RTX-3060, PS; Power supply EVGA 750W; Intel Core i7-10700K @ 3.80GHz (UHD Graphics 630); RAM 32 GB; OS on Kingston SSD 1TB; secondary WD 2TB; others 1.5TB, 3TB, 500GB, 4TB, 5TB, 6TB, 8TB; three monitors - HP 25" main, LG 4K 27" second, HP 27" third; Casio WK-225 piano keyboard; M-Audio M-Track USB mixer.

Notebook - Microsoft Surface Pro 4, i5-6300U, 8 GB RAM, 256 SSD, W10 Pro 20H2.

YouTube Channel: @JCBrownVideos

johnebaker wrote on 2/23/2023, 4:39 AM

@CubeAce

Hi Ray

Results from my laptop.

Test 1

Device options set to RTX 2060 ( driver version 528.49 - 31.0.15.2849) and running in balanced power mode so not high performance mode plugged in.

  • MP4 export time 12.16     CPU ave 32%  RTX 30%
     
  • HEVC export time 11:59     CPU ave 45%  RTX 45%

Will add more tests particularly in Performance mode as I get them done.

John EB

VPX 16, Movie Studio 2025, and earlier versions 2015 and 2016, Music Maker Premium 2024.

PC - running Windows 11 23H2 Professional on Intel i7-8700K 3.2 GHz, 16GB RAM, RTX 2060 6GB 192-bit GDDR6, 1 x 1Tb Sabrent NVME SSD (OS and programs), 2 x 4TB (Data) internal HDD + 1TB internal SSD (Work disc), + 6 ext backup HDDs.

Laptop - Lenovo Legion 5i Phantom - running Windows 11 23H2 on Intel Core i7-10750H, 16GB DDR4-SDRAM, 512GB SSD, 43.9 cm screen Full HD 1920 x 1080, Intel UHD 630 iGPU and NVIDIA GeForce RTX 2060 (6GB GDDR6)

Sony FDR-AX53e Video camera, DJI Osmo Action 3 and Sony HDR-AS30V Sports cams.

Reyfox wrote on 2/27/2023, 10:13 AM

Hi Ray,

I finally did it today. Here are the results, and my specs are in my signature.

MEP 2022 Plus, computer is stock with no overclocking.

There was slight stuttering with timeline playback of the opening and closing titles, but not in it's entirety.

Computer specs: AMD Ryzen 9 3900X, AMD RX 6700XT (22.5.1 driver), 32GB DDR4 3200 RAM

OS Build: Win11 Pro 22H2 (OS Build 22621.1265)

MP4 export time: 8:15. CPU average 8%, GPU when not doing the titles, 32%

HEVC export time: 8:15. CPU and GPU similar to MP4 export

AAProds wrote on 5/20/2023, 1:35 AM

On my new machine (i7-13700K, RTX 3060Ti Windforce 8gb, RAM 64gb DDR4 3200).

Single monitor plugged into the motherboard (UHD 770).

Using MMS 2023, files on HDD exporting to an SSD

MP4

All on CPU: 40:00 (CPU never got above 10%!).

All on UHD 770: 8:45

All on 3060: 4:29

HEVC

All on 3060: 5:30.

As noted above, slow encoding at start and finish with GPU not doing much, nor CPU. In the middle, GPU was on 100% and I couldn't read the frames readout.

Interestingly, dragging along the timeline in the middle was jerky, regardless of graphics config, but at the start and the end there was instant response to dragging.

Having the Resizeable BAR enabled made zero difference.

Last changed by AAProds on 5/20/2023, 4:34 AM, changed a total of 3 times.

All my forum comments are based on or refer to my System 1.

My struggle is over! I built my (now) system 2 in 2011 when DV was king and MPEG 2 was just coming onto the scene and I needed a more powerful system to cope. Since then we've advanced to MP4 and to bigger and bigger resolutions. I was really suffering, not so much in editing (with proxies) but in encoding, which just took ages. A video, with Neat Video noise reduction applied, would encode at 12% of film speed. My new system 1 does the same job at 160% of film speed. Marvellous. I'm keeping my old system as a capture station for analogue video tapes and DV.

System 1

Windows 11 v23H2 severely modified by Openshell and ExplorerPatcher

Power supply: 850W Cooler Master (should have got modular)

CPU: Intel i7 13700K running at 3400mhz, cooled by a Kraken 2x140mm All In One liquid cooler.

RAM: 64gb (2x32gb sticks) G.Skill "Ripjaws" DDR4 3200Mhz

GPU 1: iGPU UHD 770

GPU 2: NVidia RTX 3060Ti Windforce 8gb

C drive: NVME 500gb

Various other SSD and HDDs.

Monitor: 27"/68cm Samsung, 2560 x 1440, 43 pixels/cm.

MEP 2021 version 20.0.1.80

Movie Studio 2023 version 22.0.3.172

Magix Video Easy version 7.0.1.145

System 2

(Still in use for TV and videotape capture)

Windows 10 v22H2

CPU: i5-750 at 2670mhz with 12gb RAM

Onboard IEEE1394 (Firewire) port

GPU: ATI Radeon HD 4770 (512mb) which is ignored by MEP

Hard drives: C Drive 256gb SSD, various other HDDs.

Monitor: Dell 22"/56cm, 1680x1050, 35 pixels/cm

MEP 2021 version 20.0.1.80

Movie Studio 2023 version 22.0.3.172

VPX 12