- Thu Feb 28, 2013 9:51 am
#156343
Assuming 402mV is what your meters says at the sensor pin and 489.000695271014 is what the module reports I still see a huge problem, no?
tbalon wrote:Thanks, I was able to fit the data using least squares as you did. BTW: there is a good site for doing this http://www.neoprogrammics.com/linear_le ... /index.phpHm so linearity aside how is this accurate? Take your first measurement for example: running the numbers based on your least squares formula one arrives at 489.000695271014 which is not the same as 402?
When I used this, I got y = 0.834202839107x + 153.65115395
Not sure how to approach a "scale factor"...
Assuming 402mV is what your meters says at the sensor pin and 489.000695271014 is what the module reports I still see a huge problem, no?