If you use the Magic Wand. Use Global Color Selection and a low tolerance setting. This might take a few attempts to get a tolerance right. Just click outside the image to deselect. Change values and select a green dot. 10 was the setting that worked pretty good for me. Then, with the selection applied.
Use the color replacement tool. I found it worked better than using the color replacement solo.