Embracing Limits for Self-Discovery