After reading about this the policy of recruiting Alan horse archers that andronikos ii did I think it would be a very good policy against the Turks as you could have some horse archers that won't turn against you as easily would be essential in retaking Anatolia. Also having some Alans in Anatolia would be very interesting especially if they create a Turkic-Alanic-Greek language that they use. I think that doing that would be very good for John V to do that as that will act as a stop gap against Turkic incursions when the Greeks in Greece may be more reluctant to move back to Anatolia due to the Turks.I'm not sure if I'm recommending something you've already read, but if you can obtain a copy of this book
https://www.deremilitari.org/REVIEWS/Bartusis_LateByzantineArmy.htm I suggest doing so.
Just considering what means Andronicus III really has available to finance an the kind of army he's relying on instead of pronoiars and foreign mercenaries here.