Most likely a threading issue. Rendering and manipulation of the camera are most likely taking place in different threads, which isn't a good idea. Either synchronize this part with the rendering or (and better) just let the sensor update set some flags and do the actual operations based on this flags in the rendering thread.