Congratulations on your new home!* It appears you have Euonymus alatus aka winged euonymus aka burning bush.* Unfortunately in most areas it has become an invasive species.* Scroll down at this first site to #2.*
When weeding, the best way to make sure you are removing a weed and not a valuable plant is to pull on it. If it comes out of the ground easily, it is a valuable plant.