It is possible to use Markdown in the description field of an OpenAPI document. This comes with limitations. For example, tables are not rendered correctly. It is also possible to use HTML.
The best practice is to define a description in a separate document, such as a Quickstart document.