B4 to non accounting roll?

I have completed two years as an audit associate at a b4, promoted to senior now, and I'm looking to leave before season. I am licensed. I do not want to kill my accounting career. I also want to have the security of the ability to come crawling back to b4/regional within the next 3 years if things don't work out… Would I be crazy to take an interesting job in a smaller real estate servicing company, in a non accounting roll? They need someone with "proffesional experience and attention to detail" – great pay, great hours, great commute and some room to grow within the organization.