I think this is a matter of your own judgement and it's hard to put a yes or no stamp on any given situation. This has come up for us as well in the past and I had a big huge "this happened to us" all typed in but thought better of it. Your husband's working relationship and even friendship will change because of it and they will never look at each other the same again (could be good, could be bad). Just make sure you've thought it out well and then do what you guys want. That's what it's all about after all
