No, you can not!
You can't do the deletion of any record for which the stock.picking has been done or made a delivery order.
Because the corresponding stock move for the order will be created in the inventory.
you can delete the record directly from the database by using SQL query like,
DELETE FROM stock_move WHERE product_id=id;
here pass the id for which the product that you have created by mistake.
Odoo don't allow delete done product move you can fix with reverse move this is safest way.
If you want delete anyhow then you can delete from direct database in this action delete carefull otherwise that make other inventory issue.