To remove a KPI from the dashboard, hover the mouse over the KPI and click the "trash can" button of the KPI.