A training set is a set of data reserved for fitting a model, which we later evaluate using the corresponding training set. A training set may be further split into a validation set to further aid in tuning the model.