How can I remove the existing footer section that comes with the Vantage Theme?

Hi Ting

You can manage footer widgets at Appearance > Widgets and manage the site information text at Appearance > Theme Settings > General. However to remove the entire footer you’d need to use CSS as follows:

#colophon { display: none; }

Place the above in a Custom CSS plugin like Simple Custom CSS.