In your Master Pages preview/tabs, click Page 1 and in your window, click your Object Tab>Master Page tab. Towards the bottom, you'll want to check the box that says "Restrict Page Occurrence". Do the same for your Page 2 Master Page and check your PDF Preview. See if that fixes your problem.
Do the same for your Page 2 Master Page and check your PDF Preview. See if that fixes your problem.