Number of digits displayed/used

Last Modified: 3rd Jan 2013
Category: Quality Control and Management > Quality Analyst
Version: -
Article Ref.: 1FAE
»Return to previous search
»Print friendly version of this article.
1 person has found this article useful.

Quality Analyst 1FAE Both Quality Monitor and Quality Analyst use Single Precision maths ( 7 significant digits ). However, Quality Analyst may display more digits but anything after 7 significant digits in a calculation is questionable. Also there are likely to be problems charting to 7 digits. If, for example your data is in the range 0.1234569 to 0.1234561, remember to check the scale and label the Y axis appropriately. So you may need to note the multiplication factor in the axis label. QualityAnalyst - en

For the time being we are unable to offer the following product ranges although we are currently working hard to increase the number of products we can offer in the future. Please contact us to talk about alternative products that we may be able to offer you.