Video Support

From CockosWiki

(Difference between revisions)
Jump to: navigation, search
(Rendering video (Reaper 4))
(FFMPEG libraries)
 
(29 intermediate revisions not shown)
Line 2: Line 2:
=Video support in REAPER=
=Video support in REAPER=
-
 
-
This page will be updated as Reaper v5 progresses.
 
:REAPER supports inserting video items in your project. The item will display the waveform of any audio contained in the video file. For longer videos it could take a bit more time than usual to generate that overview, as the entire video file has to be traversed and its, usually compressed, audio decoded.
:REAPER supports inserting video items in your project. The item will display the waveform of any audio contained in the video file. For longer videos it could take a bit more time than usual to generate that overview, as the entire video file has to be traversed and its, usually compressed, audio decoded.
Line 9: Line 7:
:Video items are handled like any other item, though it is recommended you edit video items only along the frame edges, which means having a SMPTE timeruler active with the frame rate that matches that of the video.
:Video items are handled like any other item, though it is recommended you edit video items only along the frame edges, which means having a SMPTE timeruler active with the frame rate that matches that of the video.
-
:Most of the basic settings for video are handled in '''Preferences / Media / Video/REX/Misc''' .
+
:Basic settings for video are handled in '''Preferences / Media / Video/REX/Misc''' .
 +
 
 +
==Playback in Reaper 5 and 6==
 +
:Reaper 5/6 supports playback of almost any video out there by using the '''VLC playback engine''' or the '''FFMPEG libraries'''. On OSX it may also use the AVFoundation libraries that come with OSX. The effect plugin "Video processor" provides many different video effects as well. There are some online tutorials available that are just a Youtube search away.
 +
 
 +
:'''Windows'''
 +
::VLC , '''recommended!''' v3.0.8 as of April 19th 2020 , FFMpeg(shared binary DLL files)or system playback(same as version Reaper v4).
 +
 
 +
:'''Mac OSX'''
 +
::Video playback is provided by the '''AVFoundation''' libraries that come '''preinstalled in all OSX systems starting with v10.7 (Lion)'''. This system library is a lot more efficient than the FFMPEG libraries are. The user can also use an installed VLC player to play either all or just selected video formats, such as MKV containers, WMV files or WEBM videos.
==Playback in Reaper 4==
==Playback in Reaper 4==
-
:Version 4 of Reaper can the video playback systems of the operating system, but for Reaper 4 it is best to rely on the preinstalled FFMPEG libraries and augment those with an installation of the '''Video Lan Client player''', which extends the playback capabilities of Reaper considerably.
+
:Reaper v4 comes with preinstalled FFMPEG libraries that support only free formats. The user can download FFMPEG binaries that support non-free formats such as MP4 as well. The '''Video Lan Client player''' can be installed as used too, which extends the playback capabilities of Reaper considerably, but you may have to rely on an older version of VLC to work well enough in Reaper v4.
:The easiest method is to simply install the Video Lan Client player on either Windows or OSX. Be sure to install the 32-bit version of the Video Lan Client (VLC) player for the 32-bit version of Reaper. Install the 64-bit version of VLC for use in the 64-bit version of Reaper. The latest version of VLC is always available [https://videolan.org here] and [http://download.videolan.org/pub/videolan/vlc/last/ here].
:The easiest method is to simply install the Video Lan Client player on either Windows or OSX. Be sure to install the 32-bit version of the Video Lan Client (VLC) player for the 32-bit version of Reaper. Install the 64-bit version of VLC for use in the 64-bit version of Reaper. The latest version of VLC is always available [https://videolan.org here] and [http://download.videolan.org/pub/videolan/vlc/last/ here].
Line 18: Line 25:
:Tell Reaper to use the VLC player as a video playback method by accessing the '''''Preferences''''' of Reaper and selecting the video page. In the dropdown menu titled ''Preferred video decoding engine'' select '''VLC'''.
:Tell Reaper to use the VLC player as a video playback method by accessing the '''''Preferences''''' of Reaper and selecting the video page. In the dropdown menu titled ''Preferred video decoding engine'' select '''VLC'''.
-
==Playback in Reaper 5==
 
-
:Reaper 5 is in beta status at this time ( December 29th 2014 ), but the basic video features are said to be done. Reaper 5 might have some video effects capability, but those will be the subject of a different WIKI entry. Only the basic playback will be covered here.
 
-
:'''Windows'''
+
==Downloads==
-
::FFMpeg libraries in the form of VLC or library binaries, as well as system playback, i.e. functionaly the same as version 4 of Reaper.
+
===VLC Download Links ===
 +
:[http://www.videolan.org/vlc/download-windows.html Windows] (Reaper and Windows)
 +
:[http://www.videolan.org/vlc/download-macosx.html MacOS]
-
:'''Mac OSX'''
+
:Find the most recent versions either on the main webpage of VLC
-
::Video playback is provided by the AVFoundation libraries that come preinstalled in all OSX systems starting with v10.7 (Lion). This system library is a lot more efficient than the FFMPEG libraries are, plus the user gains playback of formats like Quicktime ProRes. The user can also use an installed VLC player to play either all or just selected video formats, such as MKV containers, WMV files or WEBM videos.
+
-
===Playback method per video format (Reaper 5 only)===
+
:or go [http://download.videolan.org/pub/videolan/vlc/ here] for an overview of all versions for all systems.
-
::Reaper 5 supports a selectable playback method per format. The user can choose a default playback method and provide overrides for specific formats.
+
-
::At the time of writing (29.12.2014) this is handled via a line of text entered in a box on the Video/REX/Misc page of the preferences.
+
:Windows users need to remember to download 64-bit version if you're using the 64-bit version of Reaper.
-
::Default in Reaper v5.0pre1 for Windows is:
+
===FFMPEG libraries===
-
:::'''<code>libav vlc qt:mov,qt,m4v,mp4 dshow:!mov qt</code>'''
+
:They are required for encoding video to non-free formats on Windows. MacOS does come with an encoding library AVFoundation already, so give that a go first.
-
::'''''libav, vlc, qt and dshow''''' are decoding methods. The first one is used before the second and so on.
+
:Windows users require the full ffmpeg libraries to produce non-free formats such as MP4 containers with H264 video and AAC audio. The Windows version of Reaper v6 and up supports FFMPEG v4.3.1 as of 5.1.2021 (January 5th 2021)
-
::Decoding overrides for specific formats are used like so :
+
::'''Downloading and installing the libraries'''
-
::'''''method:extension-of-video,another-extension,...'''''
+
-
::Example:  '''''vlc:webm'''''  (WEBM files are decoded with VLC)
+
-
::Methods can also be excluded from decoding a specific format like so :
+
::[https://ffmpeg.org Visit the FFMPEG Homepage]
-
::'''''method:!extension-of-video'''''
+
-
::Example: '''''vlc:!mov'''''  (excludes VLC from being used to decode Quicktime files)
+
 +
::Visit the downloads section, then the Windows section. Click on the link to the BtbN builds. They're tested to work. Feel free to try other builds.
 +
::On that webpage version, architecture and linking(static or shared) need to be chosen.
 +
:::'''Version''' : Avoid the nightly builds. Pick the stable builds which will be a version number such as '''4.3.1''' in this case.
 +
:::'''Architecture''' : Windows users, remember to choose the 64-bit or 32-bit to match the kind of Reaper version you're using.
-
==Rendering video ==
+
:::'''Linking''' : Always choose Shared.  The static build only contain the commandline executables.
-
: REAPER supports rendering to common video formats on OS X "out of the box" by using AVFoundation.
+
::Download the package, unpack it by double-clicking on the file or using your preferred tool for this, such as 7-Zip for example.
 +
:::The '''.dll''' files for Windows will usually be found in a directory called '''bin'''.
-
: For Windows, REAPER includes a minimal version of FFmpeg that supports loading and rendering into AVI and MKV (Matroska) files. The supported codecs are [http://en.wikipedia.org/wiki/DV DV], [http://en.wikipedia.org/wiki/FFV1 FFV1] (lossless) and [http://en.wikipedia.org/wiki/Huffyuv Huffyuv] (lossless).
+
:::Locate that resource directory via the Options menu of Reaper. Choose the menu item '''Show Reaper resource path in explorer/finder'''. Copy those files in to the '''userplugins''' directory of your Reaper resource directory.
-
:If the full FFmpeg libraries are installed, a lot more video rendering formats will be available. The ones included with Reaper only provide encoding and decoding of the free formats mentioned above.
+
==Configurable Playback Method per video format (Reaper 5 and up)==
 +
:Reaper 5 supports a selectable playback method '''per format'''. The user can choose a default playback method and provide overrides for specific formats.
-
:[[Image:ffmpeg2-screenshot.jpg]]
+
::This is handled via a line of text entered in a box on the '''Video/REX/Misc''' page of the '''preferences'''.
-
::Note that when rendering video using the DV codec format, the video width and height have to be of a suppported DV profile. The 2 most common DV profiles are DV PAL (720x576@25fps) and DV NTSC (720x480@29.97fps).
+
:Default in Reaper v5 for Windows is:
 +
::'''<code>libav vlc qt:mov,qt,m4v,mp4 dshow:!mov qt</code>'''
-
:'''Reaper 64-bit version, Windows(x64 only)''', recommended FFMPEG library :
+
::'''''libav, vlc, qt and dshow''''' are decoding methods. The first one is used before the second and so on.
-
::https://ffmpeg.zeranoe.com/builds/win64/shared/ffmpeg-3.0.1-win64-shared.7z
+
-
::Unpack the file with [http://7-zip.org/ 7-zip], Winrar or similar.
+
-
::There are a bunch of files that have the '''''DLL''''' extension in the directory '''''ffmpeg-3.0.1-win64-shared\bin\'''''. Copy those files to '''''Your-Reaper-Resource-Direcory\UserPlugins\'''''.
+
:Decoding overrides for specific formats are used like so :
 +
::'''''method:extension-of-video,another-extension,...'''''
 +
::Example:  '''''vlc:webm''''' (WEBM files are decoded with VLC)
-
::You'll need to first tell Reaper to use the FFMPEG libraries you just installed in the Video/REX/Misc page of the preferences, and then restart Reaper for the change to take effect.
+
:Methods can also be excluded from decoding a specific format like so :
 +
::'''''method:!extension-of-video'''''
 +
::Example: '''''vlc:!mov'''''  (excludes VLC from being used to decode Quicktime files)
-
::To check whether the installation works, place a video on to the timeline and check the Source Properties of the video item (default shortcut CTRL+F2). If the FFMPEG libraries are being used to decode the video, those libaries will show up in the descriptions of the source properties, telling you what is being used for decoding.
+
==Rendering video ==
-
:::[[Image:ffmpeg-screenshot.jpg]]
+
: Windows,  can use the preinstalled FFMPEG libraries to render to free formats and codecs. The supported codecs are [http://en.wikipedia.org/wiki/DV DV], [http://en.wikipedia.org/wiki/FFV1 FFV1] (lossless) and [http://en.wikipedia.org/wiki/Huffyuv Huffyuv] (lossless).
 +
: MacOS, use the AVFoundation libraries that are preinstalled in the operating system, or use the FFMPEG libraries instead.
-
:'''Reaper 32-bit version, Windows''', recommended FFMPEG library :
 
-
::https://ffmpeg.zeranoe.com/builds/win32/shared/ffmpeg-3.0.1-win32-shared.7z
 
-
::There are a bunch of files that have the '''''DLL''''' extension in the directory '''''ffmpeg-3.0.1-win32-shared\bin\'''''. Copy those files to '''''Your-Reaper-Resource-Direcory\UserPlugins\'''''.
+
:Install the full FFmpeg libraries to have more rendering format options.
-
::You'll need to first tell Reaper to use the FFMPEG libraries you just installed in the Video/REX/Misc page of the preferences, and then restart Reaper for the change to take effect.
+
::[[Image:ffmpeg2-screenshot.jpg]]
-
::To check whether the installation works, place a video on to the timeline and check the Source Properties of the video item (default shortcut CTRL+F2). If the FFMPEG libraries are being used to decode the video, those libaries will show up in the descriptions of the source properties, telling you what is being used for decoding.
 
-
:::[[Image:ffmpeg-screenshot.jpg]]
+
==Decoding video with FFMPEG libraries==
 +
:For decoding, you'll need to first tell Reaper to use the FFMPEG libraries you just installed in the Video/REX/Misc page of the preferences, and then restart Reaper for the change to take effect.
 +
:To check whether the installation works, place a video on to the timeline and check the '''Source Properties''' of the video item (default shortcut '''CTRL/CMD+F2'''). If the FFMPEG libraries are being used to decode the video, those libaries will show up in the descriptions of the source properties, telling you what is being used for decoding.
-
:'''Reaper , OSX''', recommended FFMPEG library :
+
::[[Image:ffmpeg-screenshot.jpg]]
-
:: Unknown at this time. It is recommended you try the 5.0 pre-release instead, as it lets you decode and encode video much more efficiently with the OSX-onboard AVFoundation libaries.
+
-
==Rendering video (Reaper 5)==
+
==Formats for Post Production==
-
:'''Windows'''
+
-
::The same method that is used for Reaper 4 is used for Reaper 5 at the time of writing.
+
-
:'''OSX'''
+
:'''Quicktime''' container, using the '''PhotoJPEG''' codec at 40-75% quality
-
::Reaper 5 uses the AVFoundation libraries built in to OSX 10.7 and higher by default to decode and encode video. This is significantly more efficient for most necessary formats. If you wish to encode WEBM videos however, you'll need to aquire a compiled version of the FFMPEG library once again.
+
-
==Recommended formats for post production==
+
:'''Quicktime or MKV''' container, using the '''Prores Proxy''' codec at quality 20(suggested)
-
:Quicktime container, using the PhotoJPEG codec at 40-75% quality
 
-
:This format can easily be produced with the free application [http://www.squared5.com/ MPEG Streamclip], free and available for both OSX and Windows. Windows users should download the 1.2.1b6 beta.
+
:These formats can easily be produced with at least two free applications
-
:OSX users can probably use ProRes as well, since the AVFoundation libraries support that format, but this is not yet tested.
+
::[https://sourceforge.net/projects/tencoder/ '''TEncoder''']
 +
::Free, open source and available for Windows in both installable and portable format. This program does not require Quicktime to be installed, and can produce Prores Proxy files in either a Quicktime or MKV container, both of which Reaper can play back.
 +
::[http://www.squared5.com/ '''MPEG Streamclip''']
 +
::Free and available for both MacOS and Windows. Windows users should download the 1.2.1b6 beta.
-
==Reaper 5 advantages and differences for video==
+
:MacOS users can probably use ProRes in any case, since the AVFoundation libraries support that format.
 +
 
 +
==Reaper 5+ advantages and differences for video==
:Note that these features may change to a small degree, but these features are part of Reaper 5.0 with a high degree of certainty, and have been tested to work at least on Windows at the time of writing.
:Note that these features may change to a small degree, but these features are part of Reaper 5.0 with a high degree of certainty, and have been tested to work at least on Windows at the time of writing.
-
:*Reaper 5 handles the frame rates setting of the project a little differently than Reaper 4 does. The '''project settings''' now determine the video output frame rate, so set that to what you need. Video now has its own page in the project settings.
+
:*Frame rate settings of the projects are kept in the '''project settings''' in Reaper 5 and up. Video now has its own page in the project settings.
-
:*The timeruler has been fixed to handle 29.97 dropframe video accurately. The timeruler now displays sensible values that are more useful to the user. Most of those fixes will likely be ported back to Reaper 4.
+
:*The timeruler has been fixed to handle 29.97 dropframe video accurately. The timeruler now displays sensible values that are more useful to the user.
-
:*OSX users can now use the AVFoundation libraries built in to OSX 10.7 and higher, which are more efficient and give the user a good batch of encoding features as well.
+
:*MacOS users can now use the AVFoundation libraries built in to OSX 10.7 and higher, which are more efficient and give the user a good batch of encoding features as well.
:*The video window can be docked now.
:*The video window can be docked now.
-
 
==Tutorials for Reaper 4==
==Tutorials for Reaper 4==
-
A '''video tutorial''' on how to sync up audio recordings to a video shot with any video camera and render it out can be found at the Homebrewed Music site : http://www.homebrewedmusic.com/2010/07/15/syncing-audio-to-video-in-reaper/
+
:A '''video tutorial''' on how to sync up audio recordings to a video shot with any video camera and render it out can be found at the Homebrewed Music site : http://www.homebrewedmusic.com/2010/07/15/syncing-audio-to-video-in-reaper/
-
More information and a discussion of the tutorial can be found here at the Reaper forums: http://forum.cockos.com/showthread.php?t=61484
+
:More information and a discussion of the tutorial can be found here at the Reaper forums: http://forum.cockos.com/showthread.php?t=61484
=More information=
=More information=

Latest revision as of 18:30, 6 January 2021

Main Page > REAPER Documentation, going quite a lot further

Contents

Video support in REAPER

REAPER supports inserting video items in your project. The item will display the waveform of any audio contained in the video file. For longer videos it could take a bit more time than usual to generate that overview, as the entire video file has to be traversed and its, usually compressed, audio decoded.
Video items are handled like any other item, though it is recommended you edit video items only along the frame edges, which means having a SMPTE timeruler active with the frame rate that matches that of the video.
Basic settings for video are handled in Preferences / Media / Video/REX/Misc .

Playback in Reaper 5 and 6

Reaper 5/6 supports playback of almost any video out there by using the VLC playback engine or the FFMPEG libraries. On OSX it may also use the AVFoundation libraries that come with OSX. The effect plugin "Video processor" provides many different video effects as well. There are some online tutorials available that are just a Youtube search away.
Windows
VLC , recommended! v3.0.8 as of April 19th 2020 , FFMpeg(shared binary DLL files)or system playback(same as version Reaper v4).
Mac OSX
Video playback is provided by the AVFoundation libraries that come preinstalled in all OSX systems starting with v10.7 (Lion). This system library is a lot more efficient than the FFMPEG libraries are. The user can also use an installed VLC player to play either all or just selected video formats, such as MKV containers, WMV files or WEBM videos.

Playback in Reaper 4

Reaper v4 comes with preinstalled FFMPEG libraries that support only free formats. The user can download FFMPEG binaries that support non-free formats such as MP4 as well. The Video Lan Client player can be installed as used too, which extends the playback capabilities of Reaper considerably, but you may have to rely on an older version of VLC to work well enough in Reaper v4.
The easiest method is to simply install the Video Lan Client player on either Windows or OSX. Be sure to install the 32-bit version of the Video Lan Client (VLC) player for the 32-bit version of Reaper. Install the 64-bit version of VLC for use in the 64-bit version of Reaper. The latest version of VLC is always available here and here.
Tell Reaper to use the VLC player as a video playback method by accessing the Preferences of Reaper and selecting the video page. In the dropdown menu titled Preferred video decoding engine select VLC.


Downloads

VLC Download Links

Windows (Reaper and Windows)
MacOS
Find the most recent versions either on the main webpage of VLC
or go here for an overview of all versions for all systems.
Windows users need to remember to download 64-bit version if you're using the 64-bit version of Reaper.

FFMPEG libraries

They are required for encoding video to non-free formats on Windows. MacOS does come with an encoding library AVFoundation already, so give that a go first.
Windows users require the full ffmpeg libraries to produce non-free formats such as MP4 containers with H264 video and AAC audio. The Windows version of Reaper v6 and up supports FFMPEG v4.3.1 as of 5.1.2021 (January 5th 2021)
Downloading and installing the libraries
Visit the FFMPEG Homepage
Visit the downloads section, then the Windows section. Click on the link to the BtbN builds. They're tested to work. Feel free to try other builds.
On that webpage version, architecture and linking(static or shared) need to be chosen.
Version : Avoid the nightly builds. Pick the stable builds which will be a version number such as 4.3.1 in this case.
Architecture : Windows users, remember to choose the 64-bit or 32-bit to match the kind of Reaper version you're using.
Linking : Always choose Shared. The static build only contain the commandline executables.
Download the package, unpack it by double-clicking on the file or using your preferred tool for this, such as 7-Zip for example.
The .dll files for Windows will usually be found in a directory called bin.
Locate that resource directory via the Options menu of Reaper. Choose the menu item Show Reaper resource path in explorer/finder. Copy those files in to the userplugins directory of your Reaper resource directory.

Configurable Playback Method per video format (Reaper 5 and up)

Reaper 5 supports a selectable playback method per format. The user can choose a default playback method and provide overrides for specific formats.
This is handled via a line of text entered in a box on the Video/REX/Misc page of the preferences.
Default in Reaper v5 for Windows is:
libav vlc qt:mov,qt,m4v,mp4 dshow:!mov qt
libav, vlc, qt and dshow are decoding methods. The first one is used before the second and so on.
Decoding overrides for specific formats are used like so :
method:extension-of-video,another-extension,...
Example: vlc:webm (WEBM files are decoded with VLC)
Methods can also be excluded from decoding a specific format like so :
method:!extension-of-video
Example: vlc:!mov (excludes VLC from being used to decode Quicktime files)

Rendering video

Windows, can use the preinstalled FFMPEG libraries to render to free formats and codecs. The supported codecs are DV, FFV1 (lossless) and Huffyuv (lossless).
MacOS, use the AVFoundation libraries that are preinstalled in the operating system, or use the FFMPEG libraries instead.


Install the full FFmpeg libraries to have more rendering format options.
Ffmpeg2-screenshot.jpg


Decoding video with FFMPEG libraries

For decoding, you'll need to first tell Reaper to use the FFMPEG libraries you just installed in the Video/REX/Misc page of the preferences, and then restart Reaper for the change to take effect.
To check whether the installation works, place a video on to the timeline and check the Source Properties of the video item (default shortcut CTRL/CMD+F2). If the FFMPEG libraries are being used to decode the video, those libaries will show up in the descriptions of the source properties, telling you what is being used for decoding.
Ffmpeg-screenshot.jpg

Formats for Post Production

Quicktime container, using the PhotoJPEG codec at 40-75% quality
Quicktime or MKV container, using the Prores Proxy codec at quality 20(suggested)


These formats can easily be produced with at least two free applications
TEncoder
Free, open source and available for Windows in both installable and portable format. This program does not require Quicktime to be installed, and can produce Prores Proxy files in either a Quicktime or MKV container, both of which Reaper can play back.
MPEG Streamclip
Free and available for both MacOS and Windows. Windows users should download the 1.2.1b6 beta.
MacOS users can probably use ProRes in any case, since the AVFoundation libraries support that format.

Reaper 5+ advantages and differences for video

Note that these features may change to a small degree, but these features are part of Reaper 5.0 with a high degree of certainty, and have been tested to work at least on Windows at the time of writing.
  • Frame rate settings of the projects are kept in the project settings in Reaper 5 and up. Video now has its own page in the project settings.
  • The timeruler has been fixed to handle 29.97 dropframe video accurately. The timeruler now displays sensible values that are more useful to the user.
  • MacOS users can now use the AVFoundation libraries built in to OSX 10.7 and higher, which are more efficient and give the user a good batch of encoding features as well.
  • The video window can be docked now.

Tutorials for Reaper 4

A video tutorial on how to sync up audio recordings to a video shot with any video camera and render it out can be found at the Homebrewed Music site : http://www.homebrewedmusic.com/2010/07/15/syncing-audio-to-video-in-reaper/
More information and a discussion of the tutorial can be found here at the Reaper forums: http://forum.cockos.com/showthread.php?t=61484

More information

Personal tools