As well as other typical software, "Ctrl+Z key" is undo and "Ctrl+Y key" is redo. And "U key" is also undo.
To delete object is to press " X key" or "Delete key". And then, following message shows up. You click the dialog by left mouse button to execute the deletion.

The deletion operation in the edit mode is same.