This phenomenon is known as “gyro drift.” Some minor drift is common, as perfect calibration isn’t possible, and factors such as temperature and air pressure can also affect drift.
However, if your headset is drifting severely, try placing it on a stable surface, like a desk, for a few seconds. This will allow the gyros to recalibrate, and should solve the problem. When the recalibration is complete, “GyroDrift: Updated drift from (...)” will appear in the FOVE VR Platform log.
Another solution is to use the position tracking camera, if your headset came with one. This shifts the orientation tracking from relying on the gyros to relying on the IR camera, which is generally more accurate and effective at eliminating drift.