You may be feeding too fast. Relax and enjoy the time.
Check to make sure the table is square, and that the jaws for the machine are not putting a twist into the blade.
Cheap blades wander, they are stamped and do not have tooth set. This means it cuts easier on one side of the blade than the other. The blade will tend to wander in the same direction first. (I threw out the blades that came with my machine for this exact reason, after a certain amount of cursing.) Spend a little more money on high quality blades that are ground and have a kerf set to the teeth. (I do not have brand recommendations, sorry, I am using "brand name" blades from the local big box)
Reduce your feed pressure. Pushing the material into the blade faster than the blade is cutting it will deflect the blade and cause random wandering. Increasing the blade tension may reduce this some.
Switch to a more stout blade. This will mean that there is more blade to work turns around, which will prevent really small radius cuts and reduce wandering.
Make sure your blade is suited to the thickness of your material, or material stack. Make sure your blade is suited to the hardness of your material.
Strong grain structure can cause the blade to follow the soft edge of a hard spot. Back up and cut even slower.
As long as the arm is moving in a "straight" motion (different machines move differently) the machine itself does not cause wandering, unless there is a lot of play in the arm from side to side while operating.
Phil