Sand is not generally the best type of soil for planting. The problem with sandy soil is that it is not dense enough to hold nutrients. The soil doesn't hold moisture long enough for plants to make proper use of it. There are a few varieties of plants that do grow well in sand, however. Grapes, blueberries, white oak and red pine are all examples of trees that will grow well in sandy soil.
Clay is worse than sand for growing most plants. The problem with clay is the opposite of that with sand. Clay particles hold too much water and not enough air. This creates an inhospitable environment for the roots of most plants. Crab-apples, rosemary, periwinkle and thyme will all grow in clay.
Potting soil deserves different consideration than sand or clay, because it is typically used when planting in pots rather than outdoors where gardeners usually find their sandy- or clay-filled soil. Potting soil is a conglomeration of many different materials that are mixed together to create the ideal mixture for plant growth. As long as you buy a high-quality potting soil suited to the type of plant you want to grow, it will offer better results for indoor growing than sand or clay.
Plants can be grown successfully in sand, clay or potting soil. Just understand what type of soil you are dealing with, and take measures to ensure plant growth in those conditions. For instance, plants in sand may require more frequent watering. Gardening in strong clay may require the addition of gypsum or sand to the soil. The reality is that unless you're growing in pots, in which case potting soil is the best option, you have to come up with strategies to deal with the type of soil in your area.