ScreenAgent: The AI That Sees Your Screen and Takes Control
ScreenAgent is an IJCAI-24 visual language model agent that autonomously controls computers by perceiving screenshots and outputting mouse/keyboard actions. Learn how to deploy this open-source breakthrough.