Put the image in the /static/ folder and use the img tag in the component:
<img src={'../static/icon.png'} />