Set General preferences

Choose Apple menu > System Preferences, then click General and make sure that "Close windows when quitting an app" is selected. If this option isn't selected, Safari opens to your specified page only if that page was open when you last quit Safari. Learn more about how OS X automatically re-opens windows, apps, and documents.