Is anal sex okay if I'm in remission from Crohn’s?

I have had Crohn's disease for 16 years and am in remission right now. Recently my boyfriend and I have been toying with the idea of anal sex, but I'm concerned about it given my health issues. I have a lot of thickening of the terminal ileum walls and worry that the "trauma" of anal sex could set off a flare up and be painful because of the narrowing. Any thoughts? I'm way too embarrassed to discuss this with my male doctor. Thanks!