Yes, you can! Math figures inside a paragraph will not trigger a new paragraph, unless they are followed by a blank line.
Specifically, the following will result in one paragraph containing the figure:
foo
```$
e = mc^2
```
bar
The following will result in two paragraphs with a figure between them:
foo
```$
e = mc^2
```
bar