Unfortunately, once you set your Profile picture in Design Home, it is not possible to remove it. But, you can change your Profile Picture.

To do this please visit your Profile Page. Then, tap on your Profile Picture to change the image.