The pair enjoyed a brief fling last year and Harry isn't worried about Taylor, 23, using their relationship as inspiration for her music because she is such a good songwriter.
He told Us Weekly: "It would be hypocritical for me to say she couldn't do it because everybody writes songs based on personal experience. I can't say I'd have dated someone less famous to avoid it. At least she's a great songwriter!”
Harry, 19, also revealed it doesn't matter if someone is famous or not, he'll date whoever he likes.
He explained: "I think it's people, you like people for who they are, so I couldn't say I want to date someone less famous because of the hassle. You like who you like.
"I think relationships are hard enough, so I think you have to completely ignore everything from outside.
When you're in the opening stages of a relationship as it is, you're still under the pressure of getting to know everything about a person. If you have a lot of people from outside telling you what it is and they don't even know you, telling you what your relationship is, that's weird. So I think you sort of have to block it out and just have the relationship rather than think - we're having this relationship play out on magazine covers."