In this paper, we introduce an AI-based automatic diagnosis framework, Agent-derived Multi-Specialist Consultation (AMSC), which mimics real-world medical consultations by using language models as virtual medical specialists. This approach outperforms previous methods by efficiently combining agents’ predictions on diseases, requiring less training and parameter updates.