[Q] About Factory Images topic

Can I use factory images to upgrade or downgrade from/to any Android version?
i.e I'm currently on stock 4.3, can I directly flash 5.0.1 factory image on this?
Thanks.