Switching between tax and audit

Hello all, I will be graduating soon and was wondering, if I were to start a career in Tax, and end up hating it, would it be difficult to switch to audit? What if I started a career in audit, hated it, and wanted to move into tax? Thoughts?