If you set the conditional formatting to Show Icons Only, you can align the arrows any way you want.
Unfortunately you'll then be unable to see the data which the arrows relate to, so you'll need an additional column which replicates the data.
(I think that's the only way to get round it.)