IceLake/AVX2, Skylake/AVX or Generic/x86-64? How to decide the target?

How to decide which architecture you are going to use as your compiler target?
Use a generic architecture as x86-64 and you lose speed.
Use a SIMD-heavy target as icelake and your code might not run in older machines.
Thankfully, you do not need to decide!