Sort by group title in column chart

I have a column graph showing data from multiple groups over multiple boards. The X-Axis is of the type Group. But when I select sorting to be X-Axis, the sorting appears to be random.

I would like sorting by Group to actually use the group title to determine the order. Otherwise you cannot sort by that axis at all.

After talking to support, they have confirmed that the order is random, however I have 3 charts all showing totals from different columns but using the same set of groups, and they all use the same order.