Changing the geometry of an object, i.e. inserting and modifying vertices, is possible by using the Change Geometry tool.
When modifying the geometry in edit mode, you will delete a single vertex by holding down Alt on the keyboard and clicking on a vertex on the map.
