Tap the Leave Lobby button on the bottom left to leave the current Team Match lobby entirely.
Please note that you can't leave the lobby after you've tapped Ready.
To leave, cancel your ready status.