Grounding 3D composition in physics simulation with collaborative agents (planning + feedback) enables AI to handle complex assembly tasks that pure language or vision models cannot solve.
PhySGA is a framework that helps AI agents assemble 3D objects by combining language models with physics simulation. Instead of just predicting where objects go, it uses an Assembly Agent for planning and a Critic Agent for physical feedback, allowing it to handle complex tasks like hanging objects, gravity settling, and containment that require interactive trial-and-error.