Wipe the underside of the stairs clean with a damp cloth to remove debris. Allow the wood to dry for two to four hours.
Apply water-based urethane to the underside of the stairs with a 2-inch paintbrush. Ensure that the entire surface of the wood is covered with urethane.
Allow the urethane to dry for two hours. Apply a second coat and allow the urethane to dry for at least two hours between each application. Depending on the quality of urethane you choose, you may need up to four coats to properly seal the wood.