To remove a KPI from the dashboard, hover the mouse over the KPI in the editing mode and click the "trash can" button of the KPI.