There is a full-screen button on the player.

Do note that iPhones struggle to play the videos properly. If I recall correctly, iPhones cannot full-screen the videos. Apple likes to be different and make things unnecessarily difficult, and my webdev has been unable to get the videos to fully cooperate with iPhones without breaking compatibility for other platforms.