Even with a low center of gravity there are other factors that will determine the stability; specifically wind speed and sail area.
If you build long, tall and narrow, there could be enough wind force (wind pressure x area applied at the centroid relative to the ground) to cause enough leverage to tip the poor thing over. Narrow is worse, taller is worse, larger area is worse, higher wind speed is worse, lighter is worse. Conversely, wider, shorter, smaller area, lower wind speed, and heavier are better... with respect to tipping.
So, not necessarily an issue, but you will want to look at some of the numbers to see what level of side wind speed you can reasonably expect to survive in... and then don't under estimate the possibility that those wind speeds won't ever be a factor (e.g. "Well I live down in the hollow where the wind never blows"... then later when you are traveling across country with your shiny new TD, "guess what happened on our trip thru Santa Fe?" Plop). It is a real possibility.
Penguino I link (sorry Catherine).
Somewhere on here there is a discussion of the math that goes into the moment calculations and wind force factors. Post your wall height and length (or actual sq footage, if you know it), wall height above ground, track width and anticipated weight, and we can help give you an estimate.