All labels to appear in test dataset

I am using model_selection.train_test_split to split a dataset into a training set and test set. I would like to have all labels appear in the test set, although the data in the main dataset is not balanced. Is there an option to do so? The stratify option does not work for this.