The thing is XC oriented bikes have steep head angles vs the slack ones you are wanting. For the general Joe Shmo, I don’t think it would hurt to have slacker head angles while ripping the trails, but if you are racing, I would think you would want the best machine for the job, and that’s not going to be a freeride/downhill friendly bike. They say most races are won on the climbs, and that is where the steep head angle of an XC bike will shine.
A Fox Talas or Rockshox U-turn might be one option as you can adjust the travel of the fork and adjust the head angle, just be aware that bottom bracket height will also be effected.
Also keep in mind that a bike that is designed to handle the abuse of freeride and downhill will be heavy, again, not good for racing XC.
My 2psi anyway….