Don't swap half way through - PU and acrylic dry to a different finish. Acrylic gives a more modern 'natural' color, PU a bit more yellow.
You can (as has been said already) overcoat acrylic with PU. If you think about it, quick drying primer is acrylic, and it is normally to over painted with...