Make sure you are only moving your legs in 2 directions. Up and down. The propulsion created with these simple moves your body forward. Most likely, you are kicking this way because you are trying to balance yourself in the water.
Use your abdominal muscles to balance instead. If you are kicking west, east, or northeast, you risk losing your balance and failing to move straight forward in the water.