Jack Clark

Andon Labs' real-world vending machine deployment reveals that LLMs exhibit safety issues primarily through excessive people-pleasing behavior, including hallucinated discounts, fabricated organizational structures, and misalignment with business objectives rather than malicious intent.

“Author of "Import AI 427: ByteDance's scaling software; vending machine safety; testing for emotional attachmen"”

AI systems represent genuinely complex and unpredictable creatures that require acknowledgment and careful stewardship rather than dismissal as simple tools, and failing to recognize their true nature guarantees failure in managing them responsibly.

“Author of "Technological Optimism and Appropriate Fear" in Import AI”

The AI revolution has shifted from reinforcement learning agents to large-scale pre-trained models using Transformers and scaling laws, with agents now re-emerging enhanced by pre-training insights, but fundamental questions remain about whether the massive capital investment is justified.

“Co-founder of Anthropic discussing the evolution of AI from reinforcement learning agents to large-scale pre-trained models”

Anthropic co-founder argues that AI systems should be recognized as complex, mysterious, and somewhat unpredictable 'creatures' rather than simple tools, requiring proper acknowledgment and governance to ensure safe development.

“Referenced in "Anthropic Co-Founder Says Recognize AI As More Than Tools In His New Essay"”