Select a herbicide with the active ingredient glyphosate for effectively removing a tree permanently. Undiluted, water-soluble formulas have greater efficacy as compared to the esters, according to Washington State University Extension.
Cut the tree down to a stump and make stump surface level to ensure even application and prevent herbicide from flowing off. Clear the surface of all sawdust.
Apply the herbicide to entire stump area on diameter less than 3 inches. On larger trees where diameter exceeds 3 inches, treat only the 2 to 3 inches right next to the bark as the heartwood of larger trees is already dead.
Treat freshly cut stump immediately after cutting for best effect. If you were not able to treat stump right away, make a new cut to expose fresh tree tissues prior to application. The best time to use glyphosate is during August and September.
Remove the dead stump by grinding to a depth of about a foot below the soil line. You can also remove by wrapping stump with chain, hooking to a truck or tractor and pulling out entirely with roots. Grinding is the preferred method of stump removal in urban areas, according to the University of Minnesota Extension.