Sometimes your source folder in Finder and your gallery in Narrative are out of sync. To resolve this, click on the folder icon >
What this means is that:
Photos that are in Finder but are not your gallery will be added.
Photos that are in your gallery but have been removed from Finder will be removed from your gallery, if and only if they are not in your current layout