To join scheduled videoconference, enter an extension of the conference. You will find the extension from the calendar invite in "Join by calling a phone number" section. No need to enter #-sign.
After entering the extension, you will see text „Scheduled Conference“ and a conference box. Using arrows on a remote choose conference box and press "OK".