Cannot add multiple alarms to events on Exchange / O365

Office 365 / Exchange only supports a single alarm per event. Additional alarms are not supported.