I've used MarkdownPad for this on Windows in the past.

http://markdownpad.com/

If I need a Markdown editor, it's awfully handy to be able to type as Markdown and see it rendered on the fly.