ESP32 Time-Drift Issue and Its Impact on Model Test Accuracy
Posted: Thu Jun 19, 2025 7:54 am
I am working on a gesture recognition project using Wi-Fi CSI data. When I train a model using a batch of data, the accuracy is good. However, after some time, when I collect a new test set under the same hardware setup, the model fails to recognize the gestures.
I conducted an experiment where I collected static CSI data for 30 minutes and looked at the signal's behavior over time. In the first plot, I analyzed if there were any drifts over 30 minutes.
My question is related to the standard deviation of the data. In the first plot, while the mean seems to change gradually, the standard deviation exhibits stepwise changes. Could these stepwise changes indicate something about the signal's stability or possible external factors affecting the signal? Could this behavior be contributing to the instability of my model's performance when the training and testing data distributions shift over time?
I conducted an experiment where I collected static CSI data for 30 minutes and looked at the signal's behavior over time. In the first plot, I analyzed if there were any drifts over 30 minutes.
My question is related to the standard deviation of the data. In the first plot, while the mean seems to change gradually, the standard deviation exhibits stepwise changes. Could these stepwise changes indicate something about the signal's stability or possible external factors affecting the signal? Could this behavior be contributing to the instability of my model's performance when the training and testing data distributions shift over time?