Jump to content
Sign in to follow this  

Precision and Scale

Recommended Posts

Hey all! 

I have a question on scale calculations for scientific diagrams. 

 

In my classroom, we used a calibrated reticule to measure a cell length, lets say a value of 1.234mm

If my diagram length was 12.34cm, what precision do I use?

 

Scale for the assignment is to be shown as size of diagram:size of object in cm : micrometers

 

In this example the final scale value as 1.00cm= 10.00 micrometers after calculating scale:

 

(1.234mm) / ( 123.40mm) = 0.01000mm x 1000 = 10.00 micrometers ->> 10.00 micrometers follows sig figs, however, is not the measured precision of the reticule at 0.001mm.

 

So my question is, are these precisions of decimal places correct? And do you follow sig figs or original precision when showing scale?

Share this post


Link to post
Share on other sites

Hey all! 

I have a question on scale calculations for scientific diagrams. 

 

In my classroom, we used a calibrated reticule to measure a cell length, lets say a value of 1.234mm

If my diagram length was 12.34cm, what precision do I use?

 

Scale for the assignment is to be shown as size of diagram:size of object in cm : micrometers

 

In this example the final scale value as 1.00cm= 10.00 micrometers after calculating scale:

 

(1.234mm) / ( 123.40mm) = 0.01000mm x 1000 = 10.00 micrometers ->> 10.00 micrometers follows sig figs, however, is not the measured precision of the reticule at 0.001mm.

 

So my question is, are these precisions of decimal places correct? And do you follow sig figs or original precision when showing scale?

Your precision factor should be half the smallest unit. For example, for a ruler in cm, 1 cm/2 = +/-0.05

Hope I answered your question :)

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
Sign in to follow this  

×

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.