Not focusing on the front sight is the root of your difficulties. Black the sights and draw the pencil mark thereon, and give it a go. I think you will see an immediate improvement. The pencil mark helps you to remember to pull your focus back. If you see the pencil mark, you are good to go, if you can't see it, that's a reminder to focus hard on the front sight.
Please report back on your results when you have had a chance to apply this. Try not to giggle, it's unbecoming of a true marksman.
Natural Point of Aim is a lesson in itself. When you have absorbed the front sight technique and are ready, ask, and ye shall receive.