WebRTC streaming of raspicam

[mpromonet]

Hi,

I was searching about a way to stream the raspicam using WebRTC, trying to learn a bit more about WebRTC stuff.
In the different things I read, I notice these articles :

• an interesting tutorial building-a-raspberry-pi-2-webrtc-camera using janus-gateway
• the unofficial v4l2 driver uv4l that provides an webrtc-extension
• an old blog explaining that it is possible to stream from a C++ application to a browser webrtc-native-to-browser-video-streaming-example

The janus-gateway solution is very-nice using h264 stream compressed by the GPU, but using raspivid piped to gstreamer is awkward and inefficient.
The uv4l is nice but closed source.

Then sometimes ago, I started to build a WebRTC streamer based on the WebRTC project.
There is still works to do, like improve sound support, work with datachannels, bring interoperability with Jitsi...
But as it is starts to work, maybe it could be interesting for others developpers.

The project for Raspberry Pi can be built using an Ubuntu trusty proceeding like this :

• Install raspberry cross-compiler:

  Code: Select all

  git clone --depth 1 https://github.com/raspberrypi/tools.git rpi_tools
  export PATH=$PATH:$(pwd)/rpi_tools/arm-bcm2708/gcc-linaro-arm-linux-gnueabihf-raspbian-x64/bin
  

• Get & Build WebRTC for Raspberry Pi

  Code: Select all

  git clone --depth 1 https://chromium.googlesource.com/chromium/tools/depot_tools.git
  export PATH=$PATH:$(pwd)/depot_tools
  mkdir webrtc
  pushd webrtc
  GYP_DEFINES="target_arch=arm" fetch --no-history webrtc
  pushd src
  gn gen out/Release --args='is_debug=false rtc_use_h264=true ffmpeg_branding="Chrome" rtc_include_tests=false rtc_enable_protobuf=false is_clang=false target_cpu="arm" treat_warnings_as_errors=false' 
  ninja -C out/Release
  popd
  popd
  

• Get & Build & pkg WebRTC Streamer

  Code: Select all

  git clone https://github.com/mpromonet/webrtc-streamer
  cd webrtc-streamer
  make CROSS=arm-linux-gnueabihf- SYSROOT=$(pwd)/../webrtc/src/build/linux/debian_jessie_arm-sysroot tgz
  

Raspberry Pi tgz cross compiled with this procedure is available from github latest

After copy and extract the tgz to a Raspberry Pi, you can simply run :

Code: Select all

./webrtc-streamer

Then you should be able to access WebRTC streams captured from the V4L2 capture device using the url http://<raspberry>:8000.

This works with V4L2 capture devices that supports standard YUV format for capture, like raspicam, but also with USB webcam.

Best Regards,

Michel.

[marty-sullivan]

Very cool, and works right out of the box! Is there a built-in way to configure the settings for the stream or do I need to fiddle with the source?

[RpiName]

[*]the unofficial v4l2 driver uv4l that provides an webrtc-extension

The janus-gateway solution is very-nice using h264 stream compressed by the GPU, but using raspivid piped to gstreamer is awkward and inefficient.
The uv4l is nice but closed source.

Just to be precise with regard to UV4L, the WebRTC module is an extension of the UV4L Streaming Server not of the "unofficial v4l2 driver". In facts, WebRTC works with any input drivers supported by the UV4L (rpi cameras, UVC-based webcams, raspidisp, etc...)

The UV4L Server also provides a Restful API over HTTP or HTTPS to simplify the interaction with Janus:
https://www.linux-projects.org/documentation/rest-api/

[mpromonet]

The UV4L Server also provides a Restful API over HTTP or HTTPS to simplify the interaction with Janus:
https://www.linux-projects.org/documentation/rest-api/

If you are interested connected a WebRTC stream to Janus Gateway, there is a demo page janusvideoroom.html to publish WebRTC stream to Janus. I made this try using javascript page, but this could be implemented in any language sending HTTP requests.

I saw also connection between UV4L and Jitsi that is an interesting feature.

A thing that could be interesting with the project WebRTC-streamer is that it could publish an RTSP source, this is probably doable with UV4L developping an RTSP consumer to feed WebRTC.

UV4L is really interesting, but it seems closed source, maybe I am wrong ?

[slingkid]

I like the rasp-pi to stream video via Peer to Peer to a mobile device. I don't want to open any ports in my home network. How do I achieve this? Will webrtc-streamer be able to achieve what I want? If yes, can you provide more directions?

[lekozak]

Hi,
I'm not very used to building code, so this error stops me...

Makefile:94 : la recette pour la cible « src/PeerConnectionManager.o » a échouée
make: *** [src/PeerConnectionManager.o] Erreur 1

can you help me, please ?

[mpromonet]

@lekozak

In order to help you, you need to give a mre detailled information (for instance what makes the target fails). Did you build WebRTC library ?

If you are not interested building software, you get download the lates release from https://github.com/mpromonet/webrtc-streamer/releases or use the docker image https://hub.docker.com/r/mpromonet/webrtc-streamer.

Best Regards,

Michel.

[encore-lab]

@mpromonet

Thank you very much for your contribution. It is really awesome.

In a PC it works like a charm but I am experiencing performance issues in Android devices. I believe that these devices cannot decode the video on time because it is too heavy for them so it plays laggy. Can you tell me how can I change video resolution, framerate and bitrate please?

Thanks in advance!

[mpromonet]

@encore-lab

There is an option that I didnot test really to set bitrate of the PeerConnection.
When calling connect of WebRtcStreamer, you can set option bitrate=<target bps>, or using options in url like

Code: Select all

 https://webrtc-streamer.herokuapp.com/?options=bitrate%3d100000

Best Regards,
Michel.

[codeforge]

Hi,
i follow the info for making webrtc for arm (raspberry pi 3) and when i run this command:

Code: Select all

make CROSS=arm-linux-gnueabihf- WEBRTCROOT=/home/osboxes/webrtc WEBRTCBUILD=Release SYSROOT=/home/osboxes/webrtc/src/build/linux/debian_jessie_arm-sysroot

i get this:

Code: Select all

...
src/rtspvideocapturer.o:(.rodata+0x340): undefined reference to `non-virtual thunk to cricket::VideoCapturer::AddOrUpdateSink(rtc::VideoSinkInterface<webrtc::VideoFrame>*, rtc::VideoSinkWants const&)'
src/rtspvideocapturer.o:(.rodata+0x344): undefined reference to `non-virtual thunk to cricket::VideoCapturer::RemoveSink(rtc::VideoSinkInterface<webrtc::VideoFrame>*)'
src/rtspvideocapturer.o:(.rodata+0x380): undefined reference to `rtc::MessageQueue::Quit()'
src/rtspvideocapturer.o:(.rodata+0x384): undefined reference to `rtc::MessageQueue::IsQuitting()'
src/rtspvideocapturer.o:(.rodata+0x388): undefined reference to `rtc::MessageQueue::Restart()'
src/rtspvideocapturer.o:(.rodata+0x38c): undefined reference to `rtc::MessageQueue::IsProcessingMessages()'
src/rtspvideocapturer.o:(.rodata+0x390): undefined reference to `rtc::MessageQueue::Get(rtc::Message*, int, bool)'
src/rtspvideocapturer.o:(.rodata+0x394): undefined reference to `rtc::MessageQueue::Peek(rtc::Message*, int)'
src/rtspvideocapturer.o:(.rodata+0x398): undefined reference to `rtc::MessageQueue::Post(rtc::Location const&, rtc::MessageHandler*, unsigned int, rtc::MessageData*, bool)'
src/rtspvideocapturer.o:(.rodata+0x39c): undefined reference to `rtc::MessageQueue::PostDelayed(rtc::Location const&, int, rtc::MessageHandler*, unsigned int, rtc::MessageData*)'
src/rtspvideocapturer.o:(.rodata+0x3a0): undefined reference to `rtc::MessageQueue::PostAt(rtc::Location const&, long long, rtc::MessageHandler*, unsigned int, rtc::MessageData*)'
src/rtspvideocapturer.o:(.rodata+0x3a4): undefined reference to `rtc::MessageQueue::PostAt(rtc::Location const&, unsigned int, rtc::MessageHandler*, unsigned int, rtc::MessageData*)'
src/rtspvideocapturer.o:(.rodata+0x3a8): undefined reference to `rtc::Thread::Clear(rtc::MessageHandler*, unsigned int, std::list<rtc::Message, std::allocator<rtc::Message> >*)'
src/rtspvideocapturer.o:(.rodata+0x3ac): undefined reference to `rtc::MessageQueue::Dispatch(rtc::Message*)'
src/rtspvideocapturer.o:(.rodata+0x3b0): undefined reference to `rtc::Thread::ReceiveSends()'
src/rtspvideocapturer.o:(.rodata+0x3b4): undefined reference to `rtc::MessageQueue::GetDelay()'
src/rtspvideocapturer.o:(.rodata+0x3c0): undefined reference to `rtc::Thread::Send(rtc::Location const&, rtc::MessageHandler*, unsigned int, rtc::MessageData*)'
src/rtspvideocapturer.o: In function `cricket::VideoCapturer::~VideoCapturer()':
/home/osboxes/webrtc/src/media/base/videocapturer.h:80: undefined reference to `rtc::TimestampAligner::~TimestampAligner()'
/home/osboxes/webrtc/src/media/base/videocapturer.h:80: undefined reference to `rtc::CriticalSection::~CriticalSection()'
/home/osboxes/webrtc/src/media/base/videocapturer.h:80: undefined reference to `cricket::VideoAdapter::~VideoAdapter()'
/home/osboxes/webrtc/src/media/base/videocapturer.h:80: undefined reference to `vtable for cricket::VideoCapturer'
/home/osboxes/webrtc/src/media/base/videocapturer.h:80: undefined reference to `vtable for cricket::VideoCapturer'
src/rtspvideocapturer.o: In function `rtc::VideoSourceBase::~VideoSourceBase()':
/home/osboxes/webrtc/src/media/base/videosourcebase.h:23: undefined reference to `vtable for rtc::VideoSourceBase'
src/rtspvideocapturer.o: In function `rtc::VideoBroadcaster::~VideoBroadcaster()':
/home/osboxes/webrtc/src/media/base/videobroadcaster.h:32: undefined reference to `rtc::VideoSinkWants::~VideoSinkWants()'
/home/osboxes/webrtc/src/media/base/videobroadcaster.h:32: undefined reference to `rtc::CriticalSection::~CriticalSection()'
/home/osboxes/webrtc/src/media/base/videobroadcaster.h:32: undefined reference to `vtable for rtc::VideoBroadcaster'
/home/osboxes/webrtc/src/media/base/videobroadcaster.h:32: undefined reference to `vtable for rtc::VideoBroadcaster'
src/rtspvideocapturer.o: In function `rtc::VideoSourceBase::SinkPair::~SinkPair()':
/home/osboxes/webrtc/src/media/base/videosourcebase.h:31: undefined reference to `rtc::VideoSinkWants::~VideoSinkWants()'
collect2: error: ld returned 1 exit status
make: *** [webrtc-streamer] Error 1

Anyone can help me? I'm using ubuntu trusty in vmware workstation.

Thanks

[mpromonet]

@codeforge

It should work on trusty, the automatic build on travis succeeded https://travis-ci.org/mpromonet/webrtc- ... /294472842

Did you build webrtc using gn & ninja ?

Best Regards,

Michel.

[RaspiBeginner]

This is honestly great!! However, I have one question. Is there a way to use this streamer to connect to an appRTC room (which can be accessed on a computer)? Please let me know how!!

Thanks

[mpromonet]

Hi RaspiBeginner,
This should be possible like connecting to webrtc-streamer to janus-gateway.
I made some tries https://github.com/mpromonet/webrtc-str ... pprtc.html.
It is able to join the apprtc room, but there is a problems establishing ICE connection.
Best Regards,
Michel.

[slipjig]

Hi,
First off, thank you for creating this project!

I am running a Raspberry Pi 3, which runs 64-bit ARM v8, and I'm having trouble running the released binaries as well as the Docker image. Do you have any plans to provide a version for RPi 3? If not I may try building it as you did on Ubuntu trusty, but I'm not especially familiar with gcc/make so it will probably be painful

Thanks,
Mike

[informed]

HI

Installed all OK. But when I type this:

./webrtc-streamer

it tells me quite rightly this is a directory

(BTW I am a novic using Raspbian)

thanks

[xuanvuong96]

I am currently seeing this error when I was building Webrtc for the Rasberrypi device. I tried to solve. Hope you can give me an explanation. Thank you !
Error:
Errors:
failed to resolve infra/3pp/tools/git/linux-armv6l@version:2.24.1.chromium.5 (line 27): no such package
failed to resolve infra/3pp/tools/cpython/linux-armv6l@version:2.7.17.chromium.22 (line 21): no such package
failed to resolve infra/3pp/tools/cpython3/linux-armv6l@version:3.8.0.chromium.8 (line 24): no such package
/opt/depot_tools/bootstrap_python3: line 32: bootstrap-3.8.0.chromium.8_bin/python3/bin/python3: No such file or directory
cat: /opt/depot_tools/python3_bin_reldir.txt: No such file or directory
[E2020-06-17T03:43:50.747173Z 1855 0 annotate.go:241] original error: fork/exec /opt/depot_tools/python3: no such file or directory
[E2020-06-17T03:43:50.755466Z 1855 0 annotate.go:241]
[E2020-06-17T03:43:50.755627Z 1855 0 annotate.go:241] goroutine 1:
[E2020-06-17T03:43:50.755766Z 1855 0 annotate.go:241] #0 go.chromium.org/luci/vpython/python/interpreter.go:89 - python.(*Interpreter).GetVersion()
[E2020-06-17T03:43:50.755980Z 1855 0 annotate.go:241] #1 go.chromium.org/luci/vpython/venv/config.go:286 - venv.(*Config).resolvePythonInterpreter()
[E2020-06-17T03:43:50.756125Z 1855 0 annotate.go:241] reason: failed to determine Python version for: /opt/depot_tools//python3
[E2020-06-17T03:43:50.756264Z 1855 0 annotate.go:241]
[E2020-06-17T03:43:50.756395Z 1855 0 annotate.go:241] #2 go.chromium.org/luci/vpython/venv/config.go:186 - venv.(*Config).makeEnv()
[E2020-06-17T03:43:50.756533Z 1855 0 annotate.go:241] reason: failed to resolve system Python interpreter
[E2020-06-17T03:43:50.756680Z 1855 0 annotate.go:241]
[E2020-06-17T03:43:50.756810Z 1855 0 annotate.go:241] #3 go.chromium.org/luci/vpython/venv/venv.go:150 - venv.With()
[E2020-06-17T03:43:50.756947Z 1855 0 annotate.go:241] reason: failed to initialize empty probe environment
[E2020-06-17T03:43:50.757082Z 1855 0 annotate.go:241]
[E2020-06-17T03:43:50.757211Z 1855 0 annotate.go:241] #4 go.chromium.org/luci/vpython/run.go:62 - vpython.Run()
[E2020-06-17T03:43:50.757346Z 1855 0 annotate.go:241] #5 go.chromium.org/luci/vpython/application/application.go:320 - application.(*application).mainImpl()
[E2020-06-17T03:43:50.757530Z 1855 0 annotate.go:241] #6 go.chromium.org/luci/vpython/application/application.go:406 - application.(*Config).Main.func1()
[E2020-06-17T03:43:50.757670Z 1855 0 annotate.go:241] #7 go.chromium.org/luci/vpython/application/support.go:46 - application.run()
[E2020-06-17T03:43:50.757808Z 1855 0 annotate.go:241] #8 go.chromium.org/luci/vpython/application/application.go:405 - application.(*Config).Main()
[E2020-06-17T03:43:50.757946Z 1855 0 annotate.go:241] #9 vpython/main.go:106 - main.mainImpl()
[E2020-06-17T03:43:50.758081Z 1855 0 annotate.go:241] #10 vpython/main.go:112 - main.main()
[E2020-06-17T03:43:50.758219Z 1855 0 annotate.go:241] #11 runtime/proc.go:203 - runtime.main()
[E2020-06-17T03:43:50.758354Z 1855 0 annotate.go:241] #12 runtime/asm_arm.s:868 - runtime.goexit()

[jallwork]

I too am getting errors when installing.
After
GYP_DEFINES="target_arch=arm" fetch --no-history webrtc

I get many errors starting with:
failed to resolve infra/3pp/tools/git/linux-armv6l@version:2.28.0.chromium.6 (line 27): no such package: infra/3pp/tools/git/linux-armv6l

Any help available?
Thanks

[nasralli]

I am very new to this. I want to know if i can use this project to stream the video over the internet ( so that anyone can access it ) in a website that I created. If this is possible i would very much appreciate an explanation or even just a few directions on how i can start to google this project