Datasets are crucial for training deep learning models, as AI is increasingly being utilised for security purposes such as Presentation Attack Detection (PAD). However, significant constraints are often overlooked during the creation of these datasets. In this presentation, I will discuss the key challenges and limitations encountered while developing the dataset for the FACEPAD3D project, led by the GREYC.