Both are valid starting points -- the right choice depends on your living situation and goals.
Whoop drones (65mm-85mm micro quads with prop guards, BetaFPV Meteor65, Happymodel Mobula7): fly indoors, nearly safe to crash into furniture, $50-100, quiet enough for apartment flying, teach real acro skills in a forgiving package.
Full-size 5-inch: outdoor only, louder, more expensive to crash, requires a large open area -- but teaches the exact skills you need for club racing and freestyle.
The ideal path: start with a whoop plus a simulator simultaneously. The whoop lets you practice in any weather and any time of day. The simulator builds muscle memory. After 2-3 months on both, the transition to a 5-inch is much smoother than going straight there. If you only want to race outdoors and have reliable field access, you can skip the whoop -- but spend more time in the simulator first.
Shop FPV Whoop Drones on Amazon