Generic client code does not necessarily know whether some IRQ can be
given a CPU affinity (i.e. have a irq_set_affinity handler), but may
have to try nevertheless.

In addition, we filter out requests on pipeline-originated virtual
IRQs, which have no chip descriptor either.