marke Posted March 11, 2007 Report Share Posted March 11, 2007 Hi When using real numbers, there is a potential of rounding errors if the "value" is to large. The real or floating point number is stored as a mantissa and an exponent where the mantissa is the "value" part and the exponent is the "tens multiplier". For example 123.45 has a mantissa of 12345 and an exponent of 10−2 The maximum value of the mantissa is just over 32,000,000 Any value above this will be truncated. This becomes significant where you have a running total and are adding in small values and keeping an accurate total. - for example power usage where the value that you are adding in is not a whole number. Best regards, Mark Empson | administratorSkype Contact = markempson | phone +64 274 363 067LMPForum | Power Factor | L M Photonics Ltd | Empson family | Advanced Motor Control Ltd | Pressure Transducers | Smart Relay | GSM Control | Mark Empson Website | AuCom | Soft Starters Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now