Will the contacts that I share the album with see newly added photos and videos as well?

Yes thats correct.

The receipient receives notification when you update the album or if you share photo or video.