Navigating Non-Orthogonality: Exploring Latent Mean Differences In Unbalanced Conditions