You have to chop them down 5 times for it to disappear from your farm.