Do I talk to him or let things cool for a couple days?

No..it's not the end of a relationship. Talk to him and if he hasn't given you a reason not to trust him, then don't make he feel as though he has.