Photo stitching strategy

I have many "scenes" that are covered by multiple cameras.
I don't want to burden the user with complicated setup
instructions:
- mount cameras
- aim in general direction of scene
- ensure some level of overlap
- press "Calibrate" button

Of course the software can advise the user if he has not
given it adequate coverage ("Please adjust camera #5...")

[This assumes static camera positions, not PTZ]

Once set, camera positions won't change.  And, the camera
settings won't, either.

[I would NOT like to have to place a reference object in the
scene as a calibration "scale" -- unless the scene is devoid
of features]

I *think* I can treat this as building a panorama.  Try to
stitch the (still!) images together and use the transforms
from that fitting exercise to "suitably distort" the live
video thereafter.

I can't imagine anything else that could change that would
affect the scene *geometry* in any significant way...?
(would the Ir filter kicking in alter the optics?)

Off-topic troll...

-- 
Don Y <blockedofcourse@foo.invalid> wrote:

> Path: not-for-mail
> From: Don Y <blockedofcourse@foo.invalid>
> Newsgroups: sci.electronics.design
> Subject: Photo stitching strategy
> Date: Fri, 1 Sep 2023 13:26:40 -0700
> Organization: A noiseless patient Spider
> Lines: 29
> Message-ID: <ucthea$etu$1@dont-email.me>
> MIME-Version: 1.0
> Content-Type: text/plain; charset=UTF-8; format=flowed
> Content-Transfer-Encoding: 7bit
> Injection-Date: Fri, 1 Sep 2023 20:26:50 -0000 (UTC)
> Injection-Info: dont-email.me; posting-host="082b903b02b18e20f05b0fcce867f743";
> 	logging-data="15294"; mail-complaints-to="abuse@eternal-september.org";	posting-account="U2FsdGVkX1/81ObkcWGwdEYv6mzbnCt8"
> User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:102.0) Gecko/20100101
>  Thunderbird/102.2.2
> Cancel-Lock: sha1:sVPFm/kyGdI5PVjJYYBx506ac6A=
> Content-Language: en-US
> X-Received-Bytes: 1926

On 9/1/2023 1:26 PM, Don Y wrote:
> I have many "scenes" that are covered by multiple cameras.
> I don't want to burden the user with complicated setup
> instructions:
> - mount cameras
> - aim in general direction of scene
> - ensure some level of overlap
> - press "Calibrate" button
> 
> Of course the software can advise the user if he has not
> given it adequate coverage ("Please adjust camera #5...")
> 
> [This assumes static camera positions, not PTZ]
> 
> Once set, camera positions won't change.  And, the camera
> settings won't, either.
> 
> [I would NOT like to have to place a reference object in the
> scene as a calibration "scale" -- unless the scene is devoid
> of features]
> 
> I *think* I can treat this as building a panorama.  Try to
> stitch the (still!) images together and use the transforms
> from that fitting exercise to "suitably distort" the live
> video thereafter.
> 
> I can't imagine anything else that could change that would
> affect the scene *geometry* in any significant way...?
> (would the Ir filter kicking in alter the optics?)

No, this doesn't work.  :<  But, it can be "special cased"
to MAKE it work!  :>