Does it really matter if they cross?

I guess it depends what you want to gain from your saved seeds. If you're trying to maintain an heirloom variety then I'd want to avoid possibility of crossing.
If you're after food for the table and you're not too concerned re provenance I don't see the worry with crossing. Worst case scenario if you don't like the offspring plants you bin em all and buy some new seeds of a known variety.