Moved inference.md to docs

Moved the inference.md to docs to have the docs in one folder.

Created a Readme for the inference folder

Updated relevant docs to reflect new inference.md link.