Yes, you can. You can select to pause an ad if you have recieved enough messages or if you have found a tenant.
The pause option is available when you're looking at the specific ad, right next to "Edit" and "Delete".
All paused adds can be activated again when you want to rent out the property.
If you chose to the delete the ad, you cannot reuse it.