The only way to start a match without the icebreaker is if the match started with a crushnote.

The icebreaker to start a match is mandatory, unless the match started with a crushnote. It's to avoid the "hey, what’s up?" you see in all the other apps, and to start the conversation in a more original way.