Revert "arm64: vdso32: require CROSS_COMPILE_COMPAT for gcc+bfd"

This reverts commit 8c0059a25cb1da1454354350ff1db5cb8e0ea326.
The reverted commit breaks the CQ test and doesn't really do anthing
we needed.
2 files changed