logging prompt and response pairs is the dataset you will wish you had later

start saving them on day one. when you want to evaluate, fine tune, or just understand what your users actually ask, you will be so glad the data is already there.