Estimate Transform assumes the topology is consistent, meaning the point count and point order is the same throughout the animation. You should delete any faces that aren't consistent to get correct results.

Oriented Bounding Box sometimes gets confused with perfectly flat planar surfaces. It can help to add some noise to the position of each point, or to subdivide the geometry.