I think you gotta ride whats comfortable for you. I use shimano clipless. I don’t ride really wicked downhills, mostly double track with some mild singltrack thrown in once in a while. I would feel kind of naked if my feet weren’t connected to the bike, but, as always, YMMV.
Lon