Can I add a thumbnail/preview image to a video?

While on the backend of your Media Library, click on the settings gear icon by the asset and you will see a prompt to add a preview.