As a long-time VRChat user, the one thing that always put me off coming back tended to be the terrible performance from normal users who had no idea that the avatar they had bought was over a hundred thousand tris. The solution is to enforce rankings for users posting on the platform, and making it clear that having only a Poor/Very Poor avatar is downgraded in the results to incentivize creators to make avatars that can support Medium and above. That's not to say that Very Poor should be banned, and I think it'd be perfectly fine if a creator were to make separate versions of the avatar with different rankings, but most users do care about the performance even if they aren't aware of how the underlying system functions.

As large of a platform as you are, having requirements to enforce creators to make good avatars would change VRChat significantly for the better. A few average users may not understand why the change was made, and move away, but in the end you are dominant enough in the market to be able to make an impact on the scene.