Search:

I actually enjoy using Kwfinder. It lists the keyword you search for, along with other suggested keywords that are relevant. In addition, it also shows you a 1-100 scale of how hard it would be to...

Depends what platform you may be using. I would check to see if you already have one by typing in your Web page url /robots.txt (www.website.com/robots.txt)

This shows search engine crawlers what...

Like most have said, the sitemap.xml contains all the URL's your website has. Then the search engine crawlers will be able to crawl via your sitemap, instead of finding your links via other links

There are many options and ways about creating one.. i've tried a few suggested aswell.
Do you wish to do the coding yourself? or have an easy platform to take care of it for you?

Also depends...