[R] rounding down with as.integer

peter dalgaard pdalgd at gmail.com
Fri Jan 2 10:59:08 CET 2015


On 02 Jan 2015, at 04:05 , Mike Miller <mbmiller+l at gmail.com> wrote:

> 
> ...but why are we seeing errors so much bigger than the machine precision? Why does it change at 2?


Because relative errors in the one-thousands part are roughly a thousand times bigger than errors in the number itself? Put differently: the 1.136868e-13 error is an absolute error on 1003, not on 3

-- 
Peter Dalgaard, Professor,
Center for Statistics, Copenhagen Business School
Solbjerg Plads 3, 2000 Frederiksberg, Denmark
Phone: (+45)38153501
Email: pd.mes at cbs.dk  Priv: PDalgd at gmail.com



More information about the R-help mailing list