You are trying to build a phylogeny for several species, so…

You are trying to build a phylogeny for several species, so you extract 50-base-pair loci (segments of DNA) from each and create an alignment.  Later you realize the DNA comes from a nuclear chromosome for some of the species, and from the mitochondria for others.  What is the problem with aligning these and using them to infer your phylogeny?