Elastic impact, how to make a collision of a character and an object?

Question

Unity

I am making a 3d game. Implemented character control through the Character controller. There is a conditional stick that hits the character and he must fly off, as if he was pushed. I know how to implement this via RigidBody, but it conflicts with the Character controller. I tried to prescribe the control of the character, with RigidBody, but it somehow comes out oblique, not the way it should be. Tell me, please, how to make a collision with the Character controller.