Open source tip: FFmpeg – the multimedia powerhouse running in the background
In the multimedia field, FFmpeg is one of the most important open-source packages out there. The framework is used in countless programs, from video converters to streaming services. Here’s what FFmpeg can do, and why version 9.0, Lei, is a milestone.
FFmpeg is a classic example of software that almost everyone uses, but hardly anyone knows about. Although it can be used on its own, it is usually integrated into other programs. If you’ve ever converted a video, recorded a podcast or streamed a movie, FFmpeg was most likely involved – perhaps even without you realising it. The open-source framework runs in the background; it’s the hidden engine behind countless applications, ranging from video converters like HandBrake to streaming services and cloud platforms. What makes FFmpeg so special is its versatility: it can read, write, convert, stream and filter virtually any audio and video format.
An open-source project with global reach
The story of FFmpeg began in 2000, when French developer Fabrice Bellard launched the project. The abbreviation stands for fast-forward and MPEG, the video standard. What began as a personal project is now one of the most widely used open-source packages ever.
FFmpeg is maintained by an international community of developers and used by countless companies and projects. The software is available under the LGPL licence, meaning it may also be used in commercial products – as long as the libraries are dynamically linked. This has contributed significantly to FFmpeg’s widespread use today.
All the things FFmpeg can do
If you only know FFmpeg as a video converter, you definitely haven’t seen everything it has to offer. The framework can do much more than just move files from A to B. For example, it can extract audio from a video file to create an MP3 – or save every single frame of a video as a still image. FFmpeg can stream live via HTTP, RTMP and other protocols, and it can apply filters to crop, scale, rotate and flip videos, as well as adjust their colours.
FFmpeg’s true strength lies in the fact that it’s built into countless other apps. Video converter HandBrake uses FFmpeg libraries for almost all of its encoding tasks. Media player VLC relies on FFmpeg for decoding audio and video streams, while recording and streaming software OBS Studio uses FFmpeg for all its multimedia processing. Even video editor Shotcut owes its broad format support to FFmpeg.
MKVToolNix, on the other hand, is a special case. Its graphical user interface uses the Qt framework, which in turn can use FFmpeg for preview playback and for audio/video operations. However, actual command-line tools like mkvmerge don’t require FFmpeg – they simply bundle existing streams without encoding or decoding them.
But you can also use FFmpeg on its own. Here’s a practical example. Say you want to convert a Blu-ray disc containing HDR content for your archive or media player while saving space and preserving quality at 2160p resolution. You could use a command like this one:
ffmpeg -i bluray_quelle.m2ts -map 0:v:0 -map 0:a -map 0:s -c:v libx265 -crf 22 -preset slow -pix_fmt yuv420p10le -colorspace bt2020nc -color_trc smpte2084 -color_primaries bt2020 -x265-params "hdr10=1:repeat-headers=1" -c:a copy -c:s copy output_h265_4k_hdr.mkv
FFmpeg does most of its work via the command line – an upside, not a downside. This feature allows it to be integrated into scripts and automation. If you ever want to convert an entire directory full of videos to a different format, you can do it with a single command. If you want to dive deeper, you’ll find comprehensive documentation and thousands of tutorials online.
FFmpeg 9.0 Lei – a milestone
On 4 August 2026, FFmpeg 9.0 was released, codenamed Lei. The name honours Chinese developer Lei Xiaohua, who passed away in 2016 at the age of 25 after making significant contributions to the FFmpeg community. This is the first time a major FFmpeg release has been named after someone not from the Western scientific community.
The new version introduces a number of important new features. FFmpeg can now natively decode animated WebP files without relying on external libraries, paving the way for technically obsolete GIFs to be phased out.
GPU support has been significantly expanded. NVIDIA users benefit from new CUDA filters for GPU-accelerated image transformations; AMD expands its Advanced Media Framework with new filters for HDR conversion and frame rate conversion; and Apple users gain access to VideoToolbox-accelerated ProRes RAW decoding. In addition, there’s the new v360_vulkan filter, enabling the processing of 360° and panoramic videos directly on the GPU.
The integration of AI into the video pipeline is particularly exciting. The DNN backend now supports ONNX Runtime with GPU execution providers, meaning that AI models for super-resolution, upscaling and noise reduction can be executed directly in the video pipeline on the GPU. In addition, it supports SMPTE 2094-50 dynamic HDR metadata and the ability to split Dolby Vision HEVC streams.
Since the last version, more than 2,200 code changes have been incorporated by over 160 developers – FFmpeg 9.0 is one of the most extensive updates in years.
If you’d like to try FFmpeg for yourself, you can find it for all major operating systems on the download page. The official builds already include all common codecs – no separate installation necessary.
I find my muse in everything. When I don’t, I draw inspiration from daydreaming. After all, if you dream, you don’t sleep through life.
Practical solutions for everyday problems with technology, household hacks and much more.
Show all
