Taylor Swift's not into wearing the pants in a relationship