Implementing Filtergraph in Streaming with NGINX RTMP

In my previous tutorial, I have explained on How to Build NGINX RTMP, Setup Live Streaming with NGINX RTMP, Create Adaptive Streaming with NGINX RTMP.  Please read it before start to learn this tutorial.

Deinterlace

To prevent flicker and reducing transmission bandwidth, all analog camcorders, VCRs, broadcast television systems use interlaced scan. So, deinterlacing video is in practice the process of converting interlaced video into progressive video.

Please type this command on terminal to implement deinterlace:

ffmpeg -i adam_levine.mp4 -vf "yadif=0:0:0" -vcodec libx264 -acodec aac -strict -2 -b:v 256k -b:a 32k -f flv rtmp://192.168.135.128:1935/myapp/mystream

Pic 1. Deinterlace result

Turn Video to Black and White

If you need to turn video into black and white then this is the command

ffmpeg -i storm_spirit.mp4 -vf "yadif=0:0:0, hflip, hue=s=0" -vcodec libx264 -acodec aac -strict -2 -b:v 256k -b:a 32k -f flv rtmp://192.168.135.128:1935/myapp/mystream

Pic 2. Turn Video to Black and White

Split Screen

To make split screen, you can implement with this command

ffmpeg -i storm_spirit.mp4 -s 850x480 -vf "scale=850:240 [inScale]; color=c=black@1.0:s=850x480:r=29.97:d=30.0 [bg]; movie=adam_levine.mp4, scale=850:240 [vid2]; [bg][vid2] overlay=0:0 [basis1]; [basis1][inScale] overlay=0:240" -vcodec libx264 -acodec aac -strict -2 -b:v 256k -b:a 32k -f flv rtmp://192.168.135.128:1935/myapp/mystream

Pic 3. Split Screen

Overlay

To implement overlay image in your stream, you can do with this command

ffmpeg -i adam_levine.mp4 -vf "movie=addies.jpg [over]; [in][over]overlay=main_w-overlay_w-10:main_h-overlay_h-10" -vcodec libx264 -acodec aac -strict -2 -b:v 256k -b:a 32k -f flv rtmp://192.168.135.128:1935/myapp/mystream

Pic 4. Overlay Image

Picture in Picture (PiP)

This is the way to implement Picture in Picture (PiP). The command as below

ffmpeg -i storm_spirit.mp4 -i adam_levine.mp4 -i Slash.mp4 -filter_complex "[1:v]scale=iw/5:ih/5:flags=lanczos[pip1];[2:v]scale=iw/5:ih/5:flags=lanczos[pip2];[0:v][pip1]overlay=main_w-overlay_w-100:main_h-overlay_h-100[bg1];[bg1][pip2]overlay=main_w-overlay_w*4-100:main_h-overlay_h-100" -vcodec libx264 -acodec aac -strict -2 -b:v 256k -b:a 32k -f flv rtmp://192.168.135.128:1935/myapp/mystream

Pic 5. Picture in Picture (PiP)

Please change red color IP address rtmp://192.168.135.128:1935/myapp/mystream to your NGINX RTMP IP address

Thank you




Other Topics:

How to build NGINX RTMP module, Setup Live Streaming with NGINX RTMP module, Publishing Stream with Open Broadcaster Software (OBS), Create Adaptive Streaming with NGINX RTMP, Implementing Filtergraph in Streaming with NGINX RTMP, How to Implement Running Text in Streaming with NGINX RTMP, How to build OpenSceneGraph with Code::Blocks, How to build OpenSceneGraph with Visual Studio 2010, Building Geometry Model, How to run OpenSceneGraph with Netbean IDE 8.2 C++, Rendering Basic Shapes, Using OSG Node to Load 3D Object Model, Rendering 3D Simulator with OpenSceneGraph, How to compile wxWidgets with Visual Studio 2010

Create Adaptive Streaming with NGINX RTMP

In my previous articles How to build NGINX RTMP module, Setup Live Streaming with NGINX RTMP module and Publishing Stream with Open Broadcaster Software (OBS), I have examined how to stream a video file with FFmpeg encoder without any conversion. The streaming output is the same as the input sources.

For converting live streams into several streams resolution for adaptive streaming purpose, we need to make sure server have enough CPU for the workload. This is to prevent live streaming from continuous delays and even worst, server become unresponsive and hang. To prevent this case happen then we need to think about the resolution that will be offering for adaptive streaming. Normally, there are 4 variants that we can use for adaptive streaming consist of

1. 240p Low Definition stream at 288kbps

2. 480p Standard Definition stream at 448kbps

3. 540p Standard Definition stream at 1152kbps

4. 720p High Definition stream at 2048kbps

You may refer to youtube help for live encoder settings, bitrates and resolutions

Configure nginx.conf for Adaptive Live Streaming

Here is my own configuration (simple configuration). In this configuration, I used resolution 240p, 480p, 720p.

#user  nobody;

worker_processes  1;

error_log  logs/error.log debug;

events {

    worker_connections  1024;

}

http {

    include       mime.types;

    default_type  application/octet-stream;

    sendfile        on;

    keepalive_timeout  65;

    server {

        listen       8080;

        server_name  localhost;

        

        # rtmp stat

        location /stat {

            rtmp_stat all;

            rtmp_stat_stylesheet stat.xsl;

        }

        location /stat.xsl {

            # you can move stat.xsl to a different location

            # in my case, i used /home/addies/build/nginx-rtmp-module

            root /home/addies/build/nginx-rtmp-module;

        }

        location /hls {

                add_header 'Cache-Control' 'no-cache';

                add_header 'Access-Control-Allow-Origin' '*' always;

                add_header 'Access-Control-Expose-Headers' 'Content-Length,Content-Range';

                add_header 'Access-Control-Allow-Headers' 'Range';

                if ($request_method = 'OPTIONS') {

                       add_header 'Access-Control-Allow-Origin' '*';

                       add_header 'Access-Control-Allow-Headers' 'Range';

                       add_header 'Access-Control-Max-Age' 1728000;

                       add_header 'Content-Type' 'text/plain charset=UTF-8';

                       add_header 'Content-Length' 0;

                       return 204;

                }

                #serve HLS fragments

                types {

                       application/dash+xml mpd;

                       application/vnd.apple.mpegurl m3u8;

                       video/mp2t ts;

                }

                root /home/addies/live/;

                add_header Cache-Control no-cache;            

        }

        # rtmp control

        location /control {

            rtmp_control all;

        }

        error_page   500 502 503 504  /50x.html;

        location = /50x.html {

            root   html;

        }

    }

}

rtmp {

    server {

        listen 1935;

        ping 30s;

        notify_method get;

        application live {

            live on;     

            exec_pull ffmpeg -re -i http://your_ip_source/$app/$name

 -vcodec libx264 -threads 0 -vprofile baseline -acodec aac -strict -2 -b:v 1920k -b:a 128k -vf "scale=1280:trunc(ow/a/2)*2" -tune zerolatency -preset veryfast -crf 23 -f flv rtmp://localhost:1935/show/${name}_720

-vcodec libx264 -threads 0 -vprofile baseline -acodec aac -strict -2 -b:v 1024k -b:a 128k -vf "scale=854:trunc(ow/a/2)*2" -tune zerolatency -preset veryfast -crf 23 -f flv rtmp://localhost:1935/show/${name}_480

 -vcodec libx264 -threads 0 -vprofile baseline -acodec aac -strict -2 -b:v 300k -b:a 96k -vf "scale=426:trunc(ow/a/2)*2" -tune zerolatency -preset veryfast -crf 23 -f flv rtmp://localhost:1935/show/${name}_240;

        }

       application show {

            live on;

            hls on;

            hls_path /home/addies/live/hls;

            hls_nested on;

            record off;

            

            # Instruct clients to adjust resolution according to bandwidth

            hls_variant _720 BANDWIDTH=2048000; # High bitrate, HD 720p resolution

            hls_variant _480 BANDWIDTH=448000; # Medium bitrate, SD resolution

            hls_variant _240 BANDWIDTH=288000; # Low bitrate, sub-SD resolution

        }

    }

}

After finished the configuration then you need to create folder for hls files that created by nginx
cd ~
mkdir live
cd ~/live
mkdir hls
cd ~
chmod -R 755 /home/addies/live

To test your configuration then you need to open linux terminal and type command

ffmpeg -re -i /home/addies/stream/any_files_for_testing.mp4 -vcodec libx264 -threads 0 -vprofile baseline -acodec aac -strict -2 -b:v 1920k -b:a 128k -vf "scale=1280:trunc(ow/a/2)*2" -tune zerolatency -preset veryfast -crf 23 -f flv rtmp://localhost:1935/live/any_name  -vcodec libx264 -threads 0 -vprofile baseline -acodec aac -strict -2 -b:v 1024k -b:a 128k -vf "scale=854:trunc(ow/a/2)*2" -tune zerolatency -preset veryfast -crf 23 -f flv rtmp://localhost:1935/live/any_name  -vcodec libx264 -threads 0 -vprofile baseline -acodec aac -strict -2 -b:v 300k -b:a 96k -vf "scale=426:trunc(ow/a/2)*2" -tune zerolatency -preset veryfast -crf 23 -f flv rtmp://localhost:1935/live/any_name 

Next, you can play from vlc player by inputing the stream url:

http://your_server/hls/any_name.m3u8

Other Topics:

How to build NGINX RTMP module, Setup Live Streaming with NGINX RTMP module, Publishing Stream with Open Broadcaster Software (OBS), Create Adaptive Streaming with NGINX RTMP, Implementing Filtergraph in Streaming with NGINX RTMP, How to Implement Running Text in Streaming with NGINX RTMP, How to build OpenSceneGraph with Code::Blocks, How to build OpenSceneGraph with Visual Studio 2010, Building Geometry Model, How to run OpenSceneGraph with Netbean IDE 8.2 C++, Rendering Basic Shapes, Using OSG Node to Load 3D Object Model, Rendering 3D Simulator with OpenSceneGraph, How to compile wxWidgets with Visual Studio 2010

Publishing Stream with Open Broadcaster Software (OBS)

Previously I have explained on how to publish your streaming by using ffmpeg readmore. 

Now, I would like to explain on how to publish your streaming with Open Broadcaster Software (OBS) 

OBS is one of the best free and open source software for video and live streaming. You can share any videos, games, images, etc with OBS. It is cross platform and it can be run in Linux, Windows and Mac.  Before we start, you need to setup your nginx rtmp server as following my previous guidance on how to build nginx rtmp module and how to setup live streaming with nginx rtmp module.

Assumption that you have installed NGINX RTMP server. In my case, I have installed my NGINX RTMP server in virtual machine with Ubuntu-14.04.5-server-amd64 (just for my own experiment) and run it from terminal with command sudo /usr/local/nginx/sbin/nginx .

Next, download the OBS and installed it on your local computer. Here is an graphical user interface of open broadcaster software.

Pic 1. OBS Graphical User Interface

In Sources, please add (+) Video Capture Device and just click OK then OBS will capture your webcam and you will get result like picture below

Pic 2. Add Video Capture Device

Then click Settings and add the url stream. In my case, URL is rtmp://192.168.135.128:1935/myapp and Stream key is mystream , then click OK

Pic 2. add URL and Strem key

Once the settings is finished then click Start Streaming. To check your streaming, please open your vlc player and input the stream url then play.

Pic 3. Input URL stream in VLC player

Finally, you will get your streaming that play by vlc player. OBS as an input via webcam and stream through NGINX RTMP and VLC as an output to display the result.

Pic 4. Result OBS as an Input and VLC as an Output 

Note:
You can use any kind of input through OBS for example VLC as an input, Image, Animation, Mic, etc and stream through NGINX RTMP.

That's it and hope you enjoy it




Other Topics:

How to build NGINX RTMP module, Setup Live Streaming with NGINX RTMP module, Publishing Stream with Open Broadcaster Software (OBS), Create Adaptive Streaming with NGINX RTMP, Implementing Filtergraph in Streaming with NGINX RTMP, How to Implement Running Text in Streaming with NGINX RTMP, How to build OpenSceneGraph with Code::Blocks, How to build OpenSceneGraph with Visual Studio 2010, Building Geometry Model, How to run OpenSceneGraph with Netbean IDE 8.2 C++, Rendering Basic Shapes, Using OSG Node to Load 3D Object Model, Rendering 3D Simulator with OpenSceneGraph, How to compile wxWidgets with Visual Studio 2010

Setup Live Streaming with NGINX RTMP module

It is a lot of fun to implement live streaming with nginx rtmp module since you can stream movies, live games competition, live news, live music event, etc that it can be seen other people in different place in real time. 

In this project, I used nginx rtmp module that you can get free to build your own live streaming server. Let's start on how to implement live streaming...

First you need to build the nginx rtmp module that you can find the guidance here

Configuring nginx.conf

Next, you need to configure nginx.conf by adding rtmp{} section. Original nginx.conf contains only http{} section.

Here is an example for simple nginx.conf configuration

#user  nobody;

worker_processes  1;

error_log  logs/error.log debug;

events {

    worker_connections  1024;

}

http {

    include       mime.types;

    default_type  application/octet-stream;

    sendfile        on;

    keepalive_timeout  65;

    server {

        listen       8080;

        server_name  localhost;

        

        # rtmp stat

        location /stat {

            rtmp_stat all;

            rtmp_stat_stylesheet stat.xsl;

        }

        location /stat.xsl {

            # you can move stat.xsl to a different location

            # in my case, i used /home/addies/build/nginx-rtmp-module

            root /home/addies/build/nginx-rtmp-module;

        }

        # rtmp control

        location /control {

            rtmp_control all;

        }

        error_page   500 502 503 504  /50x.html;

        location = /50x.html {

            root   html;

        }

    }

}

rtmp {

    server {

        listen 1935;

        ping 30s;

        notify_method get;

        application myapp {

            live on;        

        }

    }

}

Then you can start nginx with command:

sudo /usr/local/nginx/sbin/nginx -s stop

sudo /usr/local/nginx/sbin/nginx

Publishing

Here is the way that we can do publishing the streaming

1. publishing with ffmpeg

2. publishing with Open Broadcaster Software (OBS)

This time, I will use publishing with ffmpeg.

Next section, I will create another tutorial for publishing with Open Broadcaster Software (OBS)

Publishing with ffmpeg

Now, we will do stream test with file location in /home/addies/stream/any_files_for_testing.mp4 

Assumption, you have installed nginx rtmp server (this can be done in virtual machine just for testing if you don't have VPS). In my case, I used virtual machine with Ubuntu-14.04.5-server-amd64 to implement this...just for my own experiement.

Open linux terminal in nginx rtmp server and type command:

ffmpeg -re -i /home/addies/stream/any_files_for_testing.mp4 -c copy -f flv rtmp://localhost:1935/myapp/mystream 

If you use terminal in different computer, then you must change the localhost to your nginx rtmp IP address.

Note:

-i              :  input streaming location

myapp      : routing nginx.conf that you provide in rtmp{} section

mystream : stream key (you can use any name for it)

if you don't have ffmpeg then you must install it by using command 

sudo apt-get install ffmpeg

see on how to install ffmpeg here

Pic 1. ffmpeg stream file is running

then you can see the streaming by using rtmp player. In my case, I used vlc player since vlc support rtmp (you can use other rtmp player).

Open and input the stream url as following picture below

      rtmp://192.168.135.128:1935/myapp/mystream

Please change the IP Address 192.168.135.128 to your IP Address

 Pic 2. Input stream url into vlc

Finally, you will get the streaming result as below

Pic 3. Streaming result

The above sample is just streaming without any conversion. I use any_files_for_testing.mp4 codecs are compatible with rtmp.

If you need streaming and encoding audio (AAC) and video (H264), need libx264 and libfaac  then here is the command:
ffmpeg -re -i  /home/addies/stream/any_files_for_testing.mp4  -c:v libx264 -c:a libfaac -ar 44100 -ac 1 -f flv rtmp://localhost/myapp/mystream

Thank you for reading my tutorial and hope you enjoy it.

See you in next tutorial

Other Topics:

How to build NGINX RTMP module, Setup Live Streaming with NGINX RTMP module, Publishing Stream with Open Broadcaster Software (OBS), Create Adaptive Streaming with NGINX RTMP, Implementing Filtergraph in Streaming with NGINX RTMP, How to Implement Running Text in Streaming with NGINX RTMP, How to build OpenSceneGraph with Code::Blocks, How to build OpenSceneGraph with Visual Studio 2010, Building Geometry Model, How to run OpenSceneGraph with Netbean IDE 8.2 C++, Rendering Basic Shapes, Using OSG Node to Load 3D Object Model, Rendering 3D Simulator with OpenSceneGraph, How to compile wxWidgets with Visual Studio 2010

How to build NGINX RTMP module

This project was implemented in Ubuntu-14.04.5-server-amd64

Preparation in build utilities by typing command as below

sudo apt-get install build-essential libpcre3 libpcre3-dev libssl-dev

Create build folder. In my case, I created in /home/addies/build

sudo mkdir ~/build

cd ~/build

Download and Unpack nginx-rtmp-module

sudo git clone git://github.com/arut/nginx-rtmp-module.git

Download and Unpack nginx source

sudo wget http://nginx.org/download/nginx-1.10.2.tar.gz

sudo tar xzf  nginx-1.10.2.tar.gz

cd nginx-1.10.2

Build nginx and add rtmp module

sudo ./configure --with-http_ssl_module --add-module=../nginx-rtmp-module

sudo make

sudo make install

Pic 1. Result  configure nginx rtmp

Pic 2. Result make nginx rtmp

Pic 3. Result make install nginx rtmp

Start nginx server

sudo /usr/local/nginx/sbin/nginx

Reload nginx server

sudo /usr/local/nginx/sbin/nginx -s reload

Stop nginx server

sudo /usr/local/nginx/sbin/nginx -s stop

Other Topics:

How to build NGINX RTMP module, Setup Live Streaming with NGINX RTMP module, Publishing Stream with Open Broadcaster Software (OBS), Create Adaptive Streaming with NGINX RTMP, Implementing Filtergraph in Streaming with NGINX RTMP, How to Implement Running Text in Streaming with NGINX RTMP, How to build OpenSceneGraph with Code::Blocks, How to build OpenSceneGraph with Visual Studio 2010, Building Geometry Model, How to run OpenSceneGraph with Netbean IDE 8.2 C++, Rendering Basic Shapes, Using OSG Node to Load 3D Object Model, Rendering 3D Simulator with OpenSceneGraph, How to compile wxWidgets with Visual Studio 2010