jamesh
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 32227
Joined: Sat Jul 30, 2011 7:41 pm

New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 8:19 am

Principal Software Engineer at Raspberry Pi Ltd.
Working in the Applications Team.

User avatar
HermannSW
Posts: 5932
Joined: Fri Jul 22, 2016 9:09 pm
Location: Eberbach, Germany

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 8:47 am

Nice, I opened 3 of the 6 Germany seller links, one page was not up, the 2nd had no stock, did buy for 28.99€ plus delivery on buyzero.de.
A Raspberry autofocus camera sounds interesting, and the small form factor compared to HQ camera ...
Image
https://github.com/Hermann-SW/RSA_numbers_factored
https://stamm-wilbrandt.de/GS_cam_1152x192@304fps
https://hermann-sw.github.io/planar_graph_playground
https://github.com/Hermann-SW/Raspberry_v1_camera_global_external_shutter
https://stamm-wilbrandt.de/

User avatar
hansotten
Posts: 408
Joined: Fri Jul 13, 2012 6:01 am

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 8:53 am

Nice! About time, the Pi Camera line needed a fresh up with higher quality and autofocus.

The supply lines are not filled alas. No stock anywhere except Pimoroni (a firm I avoid since Brexit).

Logistics problems:, no stock, out of stock, sold out, are what Raspberry Pi's are about since the beginning.
http://duinorasp.hansotten.com for Raspberry Pi and Arduino and ESP8266
http://retro.hansotten.nl for retrocomputing with 8 bit CPU's

laurent
Posts: 396
Joined: Thu Jul 26, 2012 11:24 am

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 9:18 am

No problem ordering 2 FoV version from Kubii (FR).
And they are still available at the time of writing.

Can't wait to receive them :D

jamesh
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 32227
Joined: Sat Jul 30, 2011 7:41 pm

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 9:39 am

hansotten wrote:
Mon Jan 09, 2023 8:53 am
Nice! About time, the Pi Camera line needed a fresh up with higher quality and autofocus.

The supply lines are not filled alas. No stock anywhere except Pimoroni (a firm I avoid since Brexit).

Logistics problems:, no stock, out of stock, sold out, are what Raspberry Pi's are about since the beginning.
Stock should be getting to the resellers pretty quickly, imminent in fact.
Principal Software Engineer at Raspberry Pi Ltd.
Working in the Applications Team.

aoakley
Posts: 75
Joined: Fri May 11, 2012 10:27 pm

Does new Camera 3 fit official Zero case?

Mon Jan 09, 2023 9:59 am

Does the new (non-M12) Raspberry Pi Camera 3 fit in the existing Raspberry Pi Zero case with camera lid, please?

https://www.raspberrypi.com/products/ra ... zero-case/
Andrew Oakley - Cotswold Raspberry Jam, Gloucestershire - http://www.cotswoldjam.org

User avatar
aallan
Raspberry Pi Employee & Forum Moderator
Raspberry Pi Employee & Forum Moderator
Posts: 321
Joined: Mon Feb 09, 2015 11:30 am
Location: Exeter, UK

Re: Does new Camera 3 fit official Zero case?

Mon Jan 09, 2023 10:13 am

aoakley wrote:
Mon Jan 09, 2023 9:59 am
Does the new (non-M12) Raspberry Pi Camera 3 fit in the existing Raspberry Pi Zero case with camera lid, please?

https://www.raspberrypi.com/products/ra ... zero-case/

As the blog post mentions, "Due to changes in the size and position of the sensor module, it is not mechanically compatible with the camera lid for the Raspberry Pi Zero Case."
Head of Documentation
Raspberry Pi Ltd
About me, http://alasdairallan.com

drich
Posts: 80
Joined: Tue Jul 28, 2015 7:36 pm
Location: Paris, France 🇫🇷

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 10:49 am

Does HDR only work on still captures or also on video ?

User avatar
aallan
Raspberry Pi Employee & Forum Moderator
Raspberry Pi Employee & Forum Moderator
Posts: 321
Joined: Mon Feb 09, 2015 11:30 am
Location: Exeter, UK

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 10:53 am

drich wrote:
Mon Jan 09, 2023 10:49 am
Does HDR only work on still captures or also on video ?

HDR mode works in both still and video modes, see the documentation on the `--hdr` command line option for the libcamera-apps, https://www.raspberrypi.com/documentati ... amera-apps.
Head of Documentation
Raspberry Pi Ltd
About me, http://alasdairallan.com

jamesh
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 32227
Joined: Sat Jul 30, 2011 7:41 pm

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 11:12 am

drich wrote:
Mon Jan 09, 2023 10:49 am
Does HDR only work on still captures or also on video ?
Note that HDR reduces the resulting image size, so for stills its down to about 3MP. But that is well within 1080p so should be fine.
Principal Software Engineer at Raspberry Pi Ltd.
Working in the Applications Team.

azsde
Posts: 7
Joined: Sun Jan 06, 2013 11:09 pm

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 11:21 am

Does someone knows if this will be retro-compatible with the old camera stack ?

There are a few software that I use that are only compatible with the old camera stack (https://github.com/silvanmelchior/RPi_Cam_Web_Interface and https://github.com/mpromonet/v4l2rtspserver) and it would be awesome to be able to just plug the V3 camera and get things working directly.

jamesh
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 32227
Joined: Sat Jul 30, 2011 7:41 pm

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 11:22 am

azsde wrote:
Mon Jan 09, 2023 11:21 am
Does someone knows if this will be retro-compatible with the old camera stack ?

There are a few software that I use that are only compatible with the old camera stack (https://github.com/silvanmelchior/RPi_Cam_Web_Interface and https://github.com/mpromonet/v4l2rtspserver) and it would be awesome to be able to just plug the V3 camera and get things working directly.
No, the new cameras will only be supported by libcamera.
Principal Software Engineer at Raspberry Pi Ltd.
Working in the Applications Team.

cpixip
Posts: 144
Joined: Mon May 01, 2017 7:56 am

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 11:31 am

I am noticing in the example picture posted on the anouncement
ely2_no_hdr-copy-500x281.jpg
ely2_no_hdr-copy-500x281.jpg (58.08 KiB) Viewed 1760 times
a greenish cast around the edges of the image, combined with a slight magenta one in the center of the image.

Could it be that the ALSC-tables still need some work?

jamesh
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 32227
Joined: Sat Jul 30, 2011 7:41 pm

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 11:49 am

cpixip wrote:
Mon Jan 09, 2023 11:31 am
I am noticing in the example picture posted on the anouncement

ely2_no_hdr-copy-500x281.jpg

a greenish cast around the edges of the image, combined with a slight magenta one in the center of the image.

Could it be that the ALSC-tables still need some work?
Maybe, I'll flag it up to the team. Or it might have been deliberate vignetting.
Principal Software Engineer at Raspberry Pi Ltd.
Working in the Applications Team.

therealdavidp
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 821
Joined: Tue Jan 07, 2020 9:15 am

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 11:52 am

Yes, we noticed this too. This picture was taken with pre-production software and since then we have remeasured the lens shading tables, so anyone using the official release software will get better results.

gordon77
Posts: 7304
Joined: Sun Aug 05, 2012 3:12 pm

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 4:06 pm

Are the maximum exposure times correct in the tables? I don't think you can get more than 1.2 seconds with the v1 and v2 cameras with libcamera, and hq is 239 seconds ?
Attachments
IMG_20230109_160427.jpg
IMG_20230109_160427.jpg (17.22 KiB) Viewed 1600 times

therealdavidp
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 821
Joined: Tue Jan 07, 2020 9:15 am

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 4:12 pm

There was a code update a while ago that extended the maximum exposure time, so my belief is that the values given here should be correct.

gordon77
Posts: 7304
Joined: Sun Aug 05, 2012 3:12 pm

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 4:26 pm

therealdavidp wrote:
Mon Jan 09, 2023 4:12 pm
There was a code update a while ago that extended the maximum exposure time, so my belief is that the values given here should be correct.
Thanks

eggplantt
Posts: 2
Joined: Mon Jan 09, 2023 4:42 pm

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 4:49 pm

What sort of high FPS performance at what resolution will likely be possible with this chip, in comparison to previous camera modules?

e.g.
viewtopic.php?t=212518

I know it all 'depends' on what people attempt, but I am still curious if there's an idea of this chip's performance we have now that means something for slow-mo work.

6by9
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 14367
Joined: Wed Dec 04, 2013 11:27 am
Location: ZZ9 Plural Z Alpha, aka just outside Cambridge.

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 5:31 pm

therealdavidp wrote:
Mon Jan 09, 2023 4:12 pm
There was a code update a while ago that extended the maximum exposure time, so my belief is that the values given here should be correct.
Not sure about V1 there.
The legacy stack had a second 5MP mode that messed with PLL values to extend the max frame and exposure time. I don't believe that has been replicated in the kernel drivers.
V2, V3, and HQ should all be correct - HBLANK can be set on all of them.
Software Engineer at Raspberry Pi Ltd. Views expressed are still personal views.
I'm not interested in doing contracts for bespoke functionality - please don't ask.

jamesh
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 32227
Joined: Sat Jul 30, 2011 7:41 pm

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 5:36 pm

eggplantt wrote:
Mon Jan 09, 2023 4:49 pm
What sort of high FPS performance at what resolution will likely be possible with this chip, in comparison to previous camera modules?

e.g.
viewtopic.php?t=212518

I know it all 'depends' on what people attempt, but I am still curious if there's an idea of this chip's performance we have now that means something for slow-mo work.
The limiting factor with high frame rates is not the sensor, it's the connection to the board, being only two lane CSI, combined with the maximum throughput of the ISP. With the right software and sensor setup, I guess we should expect similar results to the V2 camera.
Principal Software Engineer at Raspberry Pi Ltd.
Working in the Applications Team.

gordon77
Posts: 7304
Joined: Sun Aug 05, 2012 3:12 pm

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 5:55 pm

6by9 wrote:
Mon Jan 09, 2023 5:31 pm
therealdavidp wrote:
Mon Jan 09, 2023 4:12 pm
There was a code update a while ago that extended the maximum exposure time, so my belief is that the values given here should be correct.
Not sure about V1 there.
The legacy stack had a second 5MP mode that messed with PLL values to extend the max frame and exposure time. I don't believe that has been replicated in the kernel drivers.
V2, V3, and HQ should all be correct - HBLANK can be set on all of them.
agreed, v1 limits at 1 sec. Image below using 6 second exposure
Attachments
v16secs.jpg
v16secs.jpg (83.95 KiB) Viewed 1487 times

User avatar
HermannSW
Posts: 5932
Joined: Fri Jul 22, 2016 9:09 pm
Location: Eberbach, Germany

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 7:42 pm

jamesh wrote:
Mon Jan 09, 2023 5:36 pm
eggplantt wrote:
Mon Jan 09, 2023 4:49 pm
What sort of high FPS performance at what resolution will likely be possible with this chip, in comparison to previous camera modules?

e.g.
viewtopic.php?t=212518

I know it all 'depends' on what people attempt, but I am still curious if there's an idea of this chip's performance we have now that means something for slow-mo work.
The limiting factor with high frame rates is not the sensor, it's the connection to the board, being only two lane CSI, combined with the maximum throughput of the ISP. With the right software and sensor setup, I guess we should expect similar results to the V2 camera.
The trick used in that thread to get 1007fps for v2 camera was reduced number of lines.
So capturing 640xH the H decided about the possible framerate (1007fps for H=75), see diagram at bottom.
This was all based on using 6by9's raspiraw AND capturing into RAM (/dev/shm).

In another posting 6by9 stated that v3 camera imx708 sensor is not planned to be supported with raspiraw:
viewtopic.php?t=345332#p2069198

To my knowledge all libcamera APIs only allow to capture from a small fixed set of resolutions, is that correct?
Or is it possible to capture say 640x240 with double the framerate as 640x480 with libcamera API, and 640x120 with 4× the framerate?


Capturing with v3 camera with 1000fps or even more would be super cool given that v3 camera is good at low light connditions ...
viewtopic.php?f=43&t=212518&p=1310445#p1310445
(classical mouse trap closes in 0.01s, which gives 10 frames of closing phase @1007fps)
Image
Image
https://github.com/Hermann-SW/RSA_numbers_factored
https://stamm-wilbrandt.de/GS_cam_1152x192@304fps
https://hermann-sw.github.io/planar_graph_playground
https://github.com/Hermann-SW/Raspberry_v1_camera_global_external_shutter
https://stamm-wilbrandt.de/

User avatar
schoolpost
Posts: 221
Joined: Sun Feb 19, 2017 10:47 am
Location: Canada

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 9:25 pm

Is there any more information specifically related to sensor modes? raw image dimensions and max sensor frame rate for each mode?

What is frame size for the HDR mode and what is the max frame rate that can be achieved in this mode? How does this mode work under the hood? ( Is the IMX708 Quad bayer? )

As always, I'm primarily interested in this for video application.
-Csaba Nagy

jamesh
Raspberry Pi Engineer & Forum Moderator
Raspberry Pi Engineer & Forum Moderator
Posts: 32227
Joined: Sat Jul 30, 2011 7:41 pm

Re: New Camera module 3 autofocus/HDR camera thread

Mon Jan 09, 2023 9:34 pm

schoolpost wrote:
Mon Jan 09, 2023 9:25 pm
Is there any more information specifically related to sensor modes? raw image dimensions and max sensor frame rate for each mode?

What is frame size for the HDR mode and what is the max frame rate that can be achieved in this mode? How does this mode work under the hood? ( Is the IMX708 Quad bayer? )

As always, I'm primarily interested in this for video application.
HDR halves vertical and horizontal resolution, so you end up with a 3MP sensor. But that is easily good enough for 1080p. It's a quad Bayer sensor, and individual pixels in each quad get different exposures which are then merged together using some clever maths. All done on sensor,.

https://www.sony-semicon.com/en/technol ... aked%20eye.
Principal Software Engineer at Raspberry Pi Ltd.
Working in the Applications Team.

Return to “Camera board”