"It was a matter of time before someone had to leave the group."