Not connecting to a game after Champ Select

I was playing normally and finished a game, started another one and after the champ select goes to black screen and a popup shows up saying "Unable to connect to server please check your internet connection and try again" This happened to me several times and im afraid of getting banned for this
Report as:
Offensive Spam Harassment Incorrect Board