For some, one or more side effects may be permanent as long as you take the medication. When considering whether to continue the medication, it’s important to balance the relief of depression symptoms against continuing side effects.