Mix one heaping tablespoon of baking soda with hot water in a spray bottle. Shake the bottle to mix.
Spray the baking soda solution on the wallpaper paste. Allow it to sit for up to five minutes. The baking soda will work to dissolve the paste.
Scrape the dissolved wallpaper paste off the walls using a plastic scraper. Refrain from using a metal scraper as it can scratch the surface of the walls.
Pour warm water into a bucket. Dip a clean sponge in the water, then wash away the baking soda solution and any remaining wallpaper paste on the wall. If any of the paste on the walls has not dissolved, repeats steps 2 through 4.