To reference an image (texture) you need to have syntax such as this in your .csv file as well as making sure in the structure you have it set to texture.
Texture2D'/Game/Textures/Icons/AmazingIcon'
You can store just about all variable types in data tables. Its just knowing the syntax for the .csv