In this paper, we presented a number of view-independent constraints for matching and recognition of planar boundaries under affine homographies. The constraints were presented as the rank constraints on a matrix that can be computed from the images alone. We presented results to demonstrate the effectiveness of our scheme to a number of planar shape recognition problems. Extending such constraints to the general projective image-to-image homography is the next step in this direction.