OpenAI CEO Sam Altman believes that the true advancement in AI will be achieved when systems possess "infinite memory" and can store user data, preferences, and interactions over extended periods. This has been demonstrated in ChatGPT, reducing the need for repetition. Altman also discusses the potential for AI to remember every aspect of a person's life, raising privacy concerns.