Can one agent handle a whole team at once?

Yes. Your agent prioritizes and plans across many requests at the same time, and teams of 40 people share a single agent today.

When it's very busy you may wait a minute or two longer for a reply. It will tell you when it's at capacity instead of going quiet. You can also have it show its status (for example green = free, yellow = busy, red = at capacity).