[Rd] Bug in nlm, found using sem; failure in several flavors (PR#13881)

adik at ilovebacon.org adik at ilovebacon.org
Fri Aug 7 20:10:16 CEST 2009


  This message is in MIME format.  The first part should be readable text,
  while the remaining parts are likely unreadable without MIME-aware tools.

--1660387551-1458482416-1249639718=:2997
Content-Type: TEXT/PLAIN; CHARSET=US-ASCII; FORMAT=flowed
Content-ID: <Pine.LNX.4.64.0908071039211.2997 at parser.ilovebacon.org>

Hello,

 	There appears to be a bug in the nlm function, which I discovered
when trying to run an SEM.  The SEM is not bizarre; the covariance matrix is
solve-able and the eigenvalues are greater than zero, and I do not believe
the "sem" package per se to be the problem (as nlm keeps being the part that
fails, though I can't replicate this with other nlm tasks).  I apologize if
I have put too many much information in this message; I'm not a programmer
by trade so I don't really know what's going on here, which hampers my
ability to write consise bug reports.

Here is the code I use:

library(sem)
ice.S <- read.csv("iceS.csv") # attached
rownames(ice.S) <- ice.S[,1]
ice.S[,1] <- NULL
ice.S <- as.matrix(ice.S)
ice.ram <- specify.model("ice.ram") # attached
ice.N <- 342
ice.sem <- sem(ram=ice.ram, S=ice.S, N=ice.N)

...at this point, any number of problems could occur. I have seen the
following.

1) Simple lack of convergence. (might be my model's fault.)
2) Error in nlm(if (analytic.gradient) objective.2 else objective.1, start,
:
   type 31 is unimplemented in 'type2char'
3)  *** caught segfault ***
address 0xc019c87b, cause 'memory not mapped'

Traceback:
  1: nlm(if (analytic.gradient) objective.2 else objective.1, start,
hessian = TRUE, iterlim = maxiter, print.level = if (debug) 2 else 0,
typsize = typsize, ...)
  2: sem.default(ram = ram, S = S, N = N, param.names = pars, var.names =
vars,     fixed.x = fixed.x, debug = debug, ...)
  3: sem(ram = ram, S = S, N = N, param.names = pars, var.names = vars,
fixed.x = fixed.x, debug = debug, ...)
  4: sem.mod(ram = ice.ram, S = ice.S, N = ice.N)
  5: sem(ram = ice.ram, S = ice.S, N = ice.N)

Possible actions:
1: abort (with core dump, if enabled)
2: normal R exit
3: exit R without saving workspace
4: exit R saving workspace
Selection: 1
aborting ...
Segmentation fault
swiss:data$

(no core was dumped).

Trying with debug mode provides other interesting errors:

> ice.sem <- sem(ram=ice.ram, S=ice.S, N=ice.N, debug=TRUE)

...gets up to some iteration (not always 15), and then R dies ungracefully,
and exits to the shell:

iteration = 15
Step:
  [1]  1.253132e-02  1.183343e-02 -7.651342e-03 -2.490800e-03  2.278938e-03
  [6]  3.197431e-04  6.137849e-04 -2.496882e-03 -1.065829e-03 -2.118179e-03
[11]  2.942936e-03 -1.335936e-03 -3.665618e-03  3.090566e-03  8.534956e-04
[16] -1.440421e-03 -5.230877e-04 -1.053686e-04 -9.771005e-04 -4.269216e-04
[21]  7.261694e-05 -1.039668e-03 -8.409151e-03 -3.497456e-03  2.216899e-03
[26] -4.633520e-03 -4.052130e-03 -4.746537e-03 -1.589622e-03 -2.523766e-04
Parameter:
  [1] -0.76604614 -1.19639662  0.83456888  0.72540413  0.08482452  0.56180393
  [7]  0.50615814  0.55728015  0.83796696  0.88371335 -0.70465116  0.85251098
[13] -0.18346956  0.66857787  0.57012481  0.39116561  0.91237990  0.63951482
[19]  0.26601566  0.29240836  0.44710919  0.94734056  6.52039015  0.02524762
[25] -0.01614603  2.88198219  0.03442452  3.52272237  1.44698423 -0.72964745
Function Value
[1] -15175.94
Gradient:
  [1] -2.085412e+07 -3.819717e+07  3.883989e+07  1.352594e+00 -4.283329e+00
  [6] -1.437250e+00 -6.558913e-01  1.358276e+00  7.930865e+05 -1.293853e+06
[11] -5.816627e+03  5.908197e+05 -2.705742e+08 -1.194400e+07 -4.007083e+07
[16] -4.143068e+07 -6.159782e-01  1.044274e-01 -8.591048e+00 -2.083471e+00
[21] -7.548753e-01 -5.418994e-01 -2.799228e+02 -1.321739e+07 -3.517728e+07
[26] -7.106654e+02 -7.335293e+06 -7.335285e+05  3.117764e-01 -2.234989e+04

Abort trap
swiss:data$

...I have also seen convergence reached, and nlm then die with this message:

Error in nlm(if (analytic.gradient) objective.2 else objective.1, start,
:
   type 27 is unimplemented in 'type2char'

(similar to above, but now referring to type 27)

I have shown this effect (or something similar...never know how it'll fail
next) on the following platforms:

> version
                _ 
platform       i386-apple-darwin9.7.0 
arch           i386 
os             darwin9.7.0 
system         i386, darwin9.7.0 
status 
major          2 
minor          9.1 
year           2009 
month          06 
day            26 
svn rev        48839 
language       R 
version.string R version 2.9.1 (2009-06-26)

> sessionInfo()
R version 2.9.1 (2009-06-26) 
i386-apple-darwin9.8.0

locale:
en_US.UTF-8/en_US.UTF-8/C/C/en_US.UTF-8/en_US.UTF-8

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base

other attached packages:
[1] sem_0.9-17

loaded via a namespace (and not attached):
[1] tcltk_2.9.1 tools_2.9.1

(I admit to having compiled this version of R myself (to link to a
hand-compiled ATLAS), though no errors were thrown in the compilation stage. 
I compiled using this config string, at first...

./configure --prefix=/usr/local --with-x --disable-R-framework --enable-threads=posix --with-blas="/usr/local/lib/libptf77blas.a /usr/local/lib/libptcblas.a /usr/local/lib/libatlas.a -lpthread" --with-lapack="/usr/local/lib/liblapack.a /usr/local/lib/libptf77blas.a /usr/local/lib/libptcblas.a /usr/local/lib/libatlas.a -lpthread" --without-aqua CFLAGS="-O3 -mtune=nocona -m32" CXXFLAGS="-O3 -mtune=nocona -m32" FFLAGS="-O3 -mtune=nocona -m32 -L/usr/lib/gcc/i686-apple-darwin9/4.2.1 -l gfortran" F77FLAGS="-O3 -mtune=nocona -m32 -L/usr/lib/gcc/i686-apple-darwin9/4.2.1 -l gfortran" FCFLAGS="-O3 -mtune=nocona -m32 -L/usr/lib/gcc/i686-apple-darwin9/4.2.1 -l gfortran" LDFLAGS="-m32 -L/sw/lib" CPPFLAGS="-I/sw/include" CC=gcc-4.2 F77=gfortran-4.2 FC=gfortran-4.2 CXX=g++-4.2 OBJC=gcc-4.2

...though I have also recompiled using simply this:

./configure --prefix=/usr/local --with-x --disable-R-framework

...and then re-installed SEM, and I got a few other, different error
messages and core dumps, "including type 11 is unimplemented in 'type2char'"
and "cannot coerce type 'weakref' to vector of type 'double'".  Running with
debug=TRUE also segfaults sometimes, even after achieving "Current iterate
is probably solution" status.)

> version
                _ 
platform       x86_64-unknown-linux-gnu 
arch           x86_64 
os             linux-gnu 
system         x86_64, linux-gnu 
status 
major          2 
minor          9.1 
year           2009 
month          06 
day            26 
svn rev        48839 
language       R 
version.string R version 2.9.1 (2009-06-26)

> sessionInfo()
R version 2.9.1 (2009-06-26) 
x86_64-unknown-linux-gnu

locale:
LC_CTYPE=en_US;LC_NUMERIC=C;LC_TIME=en_US;LC_COLLATE=en_US;LC_MONETARY=C;LC_MESSAGES=en_US;LC_PAPER=en_US;LC_NAME=C;LC_ADDRESS=C;LC_TELEPHONE=C;LC_MEASUREMENT=en_US;LC_IDENTIFICATION=C

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base

other attached packages:
[1] sem_0.9-17

...however, THIS platform does NOT show the bug:

> version
                _ 
platform       powerpc-unknown-linux-gnu 
arch           powerpc 
os             linux-gnu 
system         powerpc, linux-gnu 
status 
major          2 
minor          9.1 
year           2009 
month          06 
day            26 
svn rev        48839 
language       R 
version.string R version 2.9.1 (2009-06-26)
> sessionInfo()
R version 2.9.1 (2009-06-26) 
powerpc-unknown-linux-gnu

locale:
LC_CTYPE=en_US.UTF-8;LC_NUMERIC=C;LC_TIME=en_US.UTF-8;LC_COLLATE=en_US.UTF-8;LC_MONETARY=C;LC_MESSAGES=en_US.UTF-8;LC_PAPER=en_US.UTF-8;LC_NAME=C;LC_ADDRESS=C;LC_TELEPHONE=C;LC_MEASUREMENT=en_US.UTF-8;LC_IDENTIFICATION=C

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base

other attached packages:
[1] sem_0.9-17
>

...for this system, the model simply repeatedly fails to converge, whether
debug is set or not.

I have also tried altering my model. This has resulted in the same bugs, but
instead of "every so often simply not converging," it actually converges and
appears to be the model I asked R to solve...but this is rare.

Please let me know if I can provide any other info.

Cordially,
Adam D. I. Kramer
--1660387551-1458482416-1249639718=:2997
Content-Type: AUDIO/X-PN-REALAUDIO; NAME=ice.ram
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.LNX.4.64.0908070308380.2997 at parser.ilovebacon.org>
Content-Description: 
Content-Disposition: ATTACHMENT; FILENAME=ice.ram

aW1wb3J0YW50IDwtLSBjaGFsbGVuZ2UsIE5BLCAxCmNvbXBsZXggIDwtLSBj
aGFsbGVuZ2UsIGMuY29tcGxleCwgTkEKZGlmZmljdWx0IDwtLSBjaGFsbGVu
Z2UsIGMuZGlmZmljdWx0LCBOQQptYW55ZGltZW5zaW9ucyA8LS0gY2hhbGxl
bmdlLCBjLm1hbnlkaW1lbnNpb25zLCBOQQpjb3VsZGF2b2lkIDwtLSBjaGFs
bGVuZ2UsIGMuY291bGRhdm9pZCwgTkEKb25seXNlbGYgPC0tIGNoYWxsZW5n
ZSwgYy5vbmx5c2VsZiwgTkEKCndhc3JpZ2h0Y2hvaWNlIDwtLSBldmFsLCBO
QSwgMQp0ZWxsZ29vZCA8LS0gZXZhbCwgZS50ZWxsZ29vZCwgTkEKdGVsbGJl
c3QgPC0tIGV2YWwsIGUudGVsbGJlc3QsIE5BCm5lZ291dGNvbWUgPC0tIGV2
YWwsIGUubmVnb3V0Y29tZSwgTkEKCmVxdWFsaW5mbyA8LS0gaW5mb3JtZWQs
IE5BLCAxCmNvbnRyb2wgPC0tIGluZm9ybWVkLCBpLmNvbnRyb2wsIE5BCmRl
c2lyZWQgPC0tIGluZm9ybWVkLCBpLmRlc2lyZWQsIE5BCmhvd211Y2hpbmZv
IDwtLSBpbmZvcm1lZCwgaS5ob3dtdWNoaW5mbywgTkEKcG9zb3V0Y29tZSA8
LS0gaW5mb3JtZWQsIGkucG9zb3V0Y29tZSwgTkEKCndhc3JpZ2h0Y2hvaWNl
IDwtPiB3YXNyaWdodGNob2ljZSwgd2FzcmlnaHRjaG9pY2VWLCBOQQp0ZWxs
Z29vZCA8LT4gdGVsbGdvb2QsIHRlbGxnb29kViwgTkEKdGVsbGJlc3QgPC0+
IHRlbGxiZXN0LCB0ZWxsYmVzdFYsIE5BCm5lZ291dGNvbWUgPC0+IG5lZ291
dGNvbWUsIG5lZ291dGNvbWVWLCBOQQoKb25seXNlbGYgPC0+IG9ubHlzZWxm
LCBvbmx5c2VsZlYsIE5BCmltcG9ydGFudCA8LT4gaW1wb3J0YW50LCBpbXBv
cnRhbnRWLCBOQQpjb21wbGV4IDwtPiBjb21wbGV4LCBjb21wbGV4ViwgTkEK
ZGlmZmljdWx0IDwtPiBkaWZmaWN1bHQsIGRpZmZpY3VsdFYsIE5BCm1hbnlk
aW1lbnNpb25zIDwtPiBtYW55ZGltZW5zaW9ucywgbWFueWRpbWVuc2lvbnNW
LCBOQQpjb3VsZGF2b2lkIDwtPiBjb3VsZGF2b2lkLCBjb3VsZGF2b2lkViwg
TkEKCmVxdWFsaW5mbyA8LT4gZXF1YWxpbmZvLCBlcXVhbGluZm9WLCBOQQpj
b250cm9sIDwtPiBjb250cm9sLCBjb250cm9sViwgTkEKZGVzaXJlZCA8LT4g
ZGVzaXJlZCwgZGVzaXJlZFYsIE5BCmhvd211Y2hpbmZvIDwtPiBob3dtdWNo
aW5mbywgaG93bXVjaGluZm9WLCBOQQpwb3NvdXRjb21lIDwtPiBwb3NvdXRj
b21lLCBwb3NvdXRjb21lViwgTkEKCmV2YWwgPC0+IGV2YWwsIGV2YWxWLCBO
QQpjaGFsbGVuZ2UgPC0+IGNoYWxsZW5nZSwgY2hhbGxlbmdlViwgTkEKaW5m
b3JtZWQgPC0+IGluZm9ybWVkLCBpbmZvcm1lZFYsIE5BCg==

--1660387551-1458482416-1249639718=:2997
Content-Type: TEXT/CSV; CHARSET=US-ASCII; NAME=iceS.csv
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.LNX.4.64.0908070308381.2997 at parser.ilovebacon.org>
Content-Description: 
Content-Disposition: ATTACHMENT; FILENAME=iceS.csv

IiIsIndhc3JpZ2h0Y2hvaWNlIiwidGVsbGdvb2QiLCJ0ZWxsYmVzdCIsImlt
cG9ydGFudCIsImNvbXBsZXgiLCJkaWZmaWN1bHQiLCJvbmx5c2VsZiIsIm1h
bnlkaW1lbnNpb25zIiwiaG93bXVjaGluZm8iLCJlcXVhbGluZm8iLCJjb3Vs
ZGF2b2lkIiwicG9zb3V0Y29tZSIsIm5lZ291dGNvbWUiLCJjb250cm9sIiwi
ZGVzaXJlZCINCiJ3YXNyaWdodGNob2ljZSIsMC45NjM2OTc3MzE3ODk2Myww
LjI5MjczNjMyMTIyOTY0NywwLjI4OTg1MjgwODQ4OTExNywwLjM4NTI2Njk2
NTM2Mjc2MSwwLjE5NzY0NDgyNDY5NjMyMCwwLjE4MzA0MTMyNDA2MjI5OCwt
MC4xNDY2MjYzNDcyMTk4NzksMC4xNDYzNTQwMjc3OTcxMDEsLTAuMTMyODg3
NTk2OTAyNTA2LC0wLjE3Mzk2NTA2OTExMTAyNSwtMC4yNjg0NTkxNjI5MzA1
NjcsLTAuMDY3ODA5NTM3NTA3NjIyMiwwLjE4MDU0OTkyNTAyNDM3NywtMC4w
NDIwODQ0MzY0MDM3ODc0LC0wLjA3MzA1Nzc4OTY5MDI5NjcNCiJ0ZWxsZ29v
ZCIsMC4yOTI3MzYzMjEyMjk2NDcsMC45NTU0OTQyNDYyMTA4NTYsMC43NTc1
NDQxOTMzMzk1NjYsMC4xOTEyNDExODMyMDMxMjksMC4wMDAxNzQ2MzA0MTc1
NjQ2ODgsMC4wMDM0MDg4NzExODA3MTI4NywwLjAwOTYzMDUwNDc0MzU4MDM0
LDAuMDI4Mzg5NDM3MzMxNjY4NCwwLjAxODgwMjc1Mzk0NjMyOTksLTAuMDE1
NzAyNjM4MTUxNTk4NSwtMC4xNDU3OTUwMDY3NDE4ODQsMC4xNDIwMzQzOTY5
MDY4NzksMC4wMDk4MTUzODM5ODQzNDg1MSwwLjA3MDU4Njg3NTY1Mzk3MzIs
MC4xMDgwMDA0NDkzMjgzMTMNCiJ0ZWxsYmVzdCIsMC4yODk4NTI4MDg0ODkx
MTcsMC43NTc1NDQxOTMzMzk1NjYsMC45NDg1OTM1OTA5MTI0MDgsMC4yMzA1
OTg5NTg1OTc1MjgsMC4wMzAyNjkyMTA2MTM1NDM5LDAuMDE1NTQ0NzA1NTc4
MzEyMiwwLjAzMjE2OTMyODE5ODg2NjksMC4wNjQ2MzEyMzI2MTg3MDk2LDAu
MDEwMjk0NTA4NTY1MTI0NiwtMC4wMTk2NzU5OTk3OTIzMDA5LC0wLjE3ODc2
NTU2MzM1NDgyOCwwLjE1MTM0MzU2Nzc2MTg1OSwtMC4wMzM2NTU5MDYzMzA3
ODM1LDAuMDkyOTA2MjI3OTMzNDg5OCwwLjE1OTczNTYxODQyMzMzNQ0KImlt
cG9ydGFudCIsMC4zODUyNjY5NjUzNjI3NjEsMC4xOTEyNDExODMyMDMxMjks
MC4yMzA1OTg5NTg1OTc1MjgsMC45NjQ0OTc4ODAzNDM2MSwwLjY0NzY1NzE0
MTQ4ODM3NSwwLjUxNDE3NTk3NDU1NDExNCwtMC4xOTc1MDY3MDU5MTcxMjMs
MC40NzQ3MjMzMzI0Njk4NzUsLTAuMTI5MDkxMzI5ODE2MjAxLC0wLjE4OTIy
OTEyMzcwNTM0MSwtMC40NjIxOTU4MzkyNjUwMzUsMC4xMjQxNTgzMzk1Mjcz
MjIsMC4xNjA2NjEzMDc0ODY1NTksLTAuMDg2NDU3MzcyNzQ2NjI2NSwtMC4w
NjgzNjc0ODQyNDk4ODAxDQoiY29tcGxleCIsMC4xOTc2NDQ4MjQ2OTYzMjAs
MC4wMDAxNzQ2MzA0MTc1NjQ2ODgsMC4wMzAyNjkyMTA2MTM1NDM5LDAuNjQ3
NjU3MTQxNDg4Mzc1LDAuOTc2MzIxNjU1NzYyOTY4LDAuNzU0OTc4Nzc3MzA5
NTUzLC0wLjI2MjM0MDQyNTgyNDA1MiwwLjY1NjcxNzUzMzM2MTE3NiwtMC4x
NjA0MjcxMzk2NzMwMTgsLTAuMjM2MjEwODU2MDgzOTAyLC0wLjM4NTQ1MjEw
MDA0NjYyMywwLjAyMzg3NzU3MjgyNzcxNTcsMC4zMjQ1MjU2NTMxNjQ1MDgs
LTAuMjQwNjM0ODA0ODg3MDU1LC0wLjIzMzY5NjU1NDE4OTE2NA0KImRpZmZp
Y3VsdCIsMC4xODMwNDEzMjQwNjIyOTgsMC4wMDM0MDg4NzExODA3MTI4Nyww
LjAxNTU0NDcwNTU3ODMxMjIsMC41MTQxNzU5NzQ1NTQxMTQsMC43NTQ5Nzg3
NzczMDk1NTMsMC45NTczMjQzNDE2NjE5NzIsLTAuMTgzMDA1NTg3NTUxNjI0
LDAuNTIzMTgzOTkzODk3NjMyLC0wLjE5NzgzMzM1NDQzMDkwNywtMC4yMjg0
MzQ3MTMwNjE3NzYsLTAuMjYzNTg3NzQ2MDIxMTc0LC0wLjA0NTM5NzEzNzc3
MDA4NDUsMC4zMzAwNzU2NjY1MjY3NjEsLTAuMjM0NzA3NTE3Njc3NTg2LC0w
LjIzOTEyNjk3MTQ4MDYyNQ0KIm9ubHlzZWxmIiwtMC4xNDY2MjYzNDcyMTk4
NzksMC4wMDk2MzA1MDQ3NDM1ODAzNCwwLjAzMjE2OTMyODE5ODg2NjksLTAu
MTk3NTA2NzA1OTE3MTIzLC0wLjI2MjM0MDQyNTgyNDA1MiwtMC4xODMwMDU1
ODc1NTE2MjQsMC45NDc4NTI0MTU0NDM2NjMsLTAuMjY4MzMzOTc5Mjk1NjEy
LDAuMDc4NzE5MTg3OTIxNTY1NCwwLjA4MDA1NTQ0MzA5MzgwMzYsMC4xNjM1
OTUyNzc0OTg3NTgsLTAuMDA1MDcyNjg2MDg0MTc3MDQsLTAuMTYwMTM3NTQ1
ODcxNDQ4LDAuMjExMjU3MjUyMjg3OTc5LDAuMTQ3ODg0MzUyNTg4NDk5DQoi
bWFueWRpbWVuc2lvbnMiLDAuMTQ2MzU0MDI3Nzk3MTAxLDAuMDI4Mzg5NDM3
MzMxNjY4NCwwLjA2NDYzMTIzMjYxODcwOTYsMC40NzQ3MjMzMzI0Njk4NzUs
MC42NTY3MTc1MzMzNjExNzYsMC41MjMxODM5OTM4OTc2MzIsLTAuMjY4MzMz
OTc5Mjk1NjEyLDAuOTQ5OTE3NjYyNjE2MTYsLTAuMTEzMjk1NjY3NDA4MTc3
LC0wLjE4MTU3NjQ3MzE3MDc4NCwtMC4yNzkyOTg0MTcxNzcyNjEsMC4wNDQy
NDgxMjM1MDgyNTI4LDAuMjU4MzQ5NzAyNDYwNjYzLC0wLjE5Njk5MzM0NjMz
NzIxNCwtMC4yMjI1MzM5NTI2MzM0ODINCiJob3dtdWNoaW5mbyIsLTAuMTMy
ODg3NTk2OTAyNTA2LDAuMDE4ODAyNzUzOTQ2MzI5OSwwLjAxMDI5NDUwODU2
NTEyNDYsLTAuMTI5MDkxMzI5ODE2MjAxLC0wLjE2MDQyNzEzOTY3MzAxOCwt
MC4xOTc4MzMzNTQ0MzA5MDcsMC4wNzg3MTkxODc5MjE1NjU0LC0wLjExMzI5
NTY2NzQwODE3NywwLjk0NjcyMjc0NjEzNzQxNSwwLjcwNjk3NjAxNTU4MjIx
OCwwLjA5MjMxOTI3MDQ0Mzk5MzQsMC4yMTMwMzIyNDI0NzMzMTUsLTAuMjA5
ODgyNDMxNzY1MTEwLDAuMjM5MTI0NTUxNjI5NTU5LDAuMjE5MDc4MzUyODkw
NjU3DQoiZXF1YWxpbmZvIiwtMC4xNzM5NjUwNjkxMTEwMjUsLTAuMDE1NzAy
NjM4MTUxNTk4NSwtMC4wMTk2NzU5OTk3OTIzMDA5LC0wLjE4OTIyOTEyMzcw
NTM0MSwtMC4yMzYyMTA4NTYwODM5MDIsLTAuMjI4NDM0NzEzMDYxNzc2LDAu
MDgwMDU1NDQzMDkzODAzNiwtMC4xODE1NzY0NzMxNzA3ODQsMC43MDY5NzYw
MTU1ODIyMTgsMC45NjQ1MTc1NjI3NzgzMjgsMC4xODA1MTczMjU3NTIzODcs
MC4xNjM4NDQ2NDA0OTU5ODMsLTAuMjEzODA0NTUwMDQzMjM5LDAuMjU4MDMy
MzIyODI0NTk5LDAuMTkxODIwNDQ3NDA0MzM1DQoiY291bGRhdm9pZCIsLTAu
MjY4NDU5MTYyOTMwNTY3LC0wLjE0NTc5NTAwNjc0MTg4NCwtMC4xNzg3NjU1
NjMzNTQ4MjgsLTAuNDYyMTk1ODM5MjY1MDM1LC0wLjM4NTQ1MjEwMDA0NjYy
MywtMC4yNjM1ODc3NDYwMjExNzQsMC4xNjM1OTUyNzc0OTg3NTgsLTAuMjc5
Mjk4NDE3MTc3MjYxLDAuMDkyMzE5MjcwNDQzOTkzNCwwLjE4MDUxNzMyNTc1
MjM4NywwLjk2MzIzNzMwOTczMDcyNiwtMC4xMjAxMzAxOTYzOTI0MDYsLTAu
MDY4OTY1OTY1NzA1NzA5MSwwLjE2NTUzMzIwODc0MzU0NywwLjE5MTQyMTEz
NDE4OTY4Mg0KInBvc291dGNvbWUiLC0wLjA2NzgwOTUzNzUwNzYyMjIsMC4x
NDIwMzQzOTY5MDY4NzksMC4xNTEzNDM1Njc3NjE4NTksMC4xMjQxNTgzMzk1
MjczMjIsMC4wMjM4Nzc1NzI4Mjc3MTU3LC0wLjA0NTM5NzEzNzc3MDA4NDUs
LTAuMDA1MDcyNjg2MDg0MTc3MDQsMC4wNDQyNDgxMjM1MDgyNTI4LDAuMjEz
MDMyMjQyNDczMzE1LDAuMTYzODQ0NjQwNDk1OTgzLC0wLjEyMDEzMDE5NjM5
MjQwNiwwLjkzOTEwNzcxNzE4NjM4NSwtMC4yOTEyNjIzOTE4Mjc2NzEsMC4y
NTYyNzQxOTU5ODMwMDQsMC4zNDY0NDE0MTExMTYxNDcNCiJuZWdvdXRjb21l
IiwwLjE4MDU0OTkyNTAyNDM3NywwLjAwOTgxNTM4Mzk4NDM0ODUxLC0wLjAz
MzY1NTkwNjMzMDc4MzUsMC4xNjA2NjEzMDc0ODY1NTksMC4zMjQ1MjU2NTMx
NjQ1MDgsMC4zMzAwNzU2NjY1MjY3NjEsLTAuMTYwMTM3NTQ1ODcxNDQ4LDAu
MjU4MzQ5NzAyNDYwNjYzLC0wLjIwOTg4MjQzMTc2NTExMCwtMC4yMTM4MDQ1
NTAwNDMyMzksLTAuMDY4OTY1OTY1NzA1NzA5MSwtMC4yOTEyNjIzOTE4Mjc2
NzEsMC45NTI1NTI5NjU3OTY0MjEsLTAuMjIxOTE3MjIyOTMwMTksLTAuMjMx
MDMyMDE0OTI3Mzk3DQoiY29udHJvbCIsLTAuMDQyMDg0NDM2NDAzNzg3NCww
LjA3MDU4Njg3NTY1Mzk3MzIsMC4wOTI5MDYyMjc5MzM0ODk4LC0wLjA4NjQ1
NzM3Mjc0NjYyNjUsLTAuMjQwNjM0ODA0ODg3MDU1LC0wLjIzNDcwNzUxNzY3
NzU4NiwwLjIxMTI1NzI1MjI4Nzk3OSwtMC4xOTY5OTMzNDYzMzcyMTQsMC4y
MzkxMjQ1NTE2Mjk1NTksMC4yNTgwMzIzMjI4MjQ1OTksMC4xNjU1MzMyMDg3
NDM1NDcsMC4yNTYyNzQxOTU5ODMwMDQsLTAuMjIxOTE3MjIyOTMwMTksMC45
Mzc2MDc1MzMxODY1NzYsMC4zMTI2NjQxOTk2MzE2MjANCiJkZXNpcmVkIiwt
MC4wNzMwNTc3ODk2OTAyOTY3LDAuMTA4MDAwNDQ5MzI4MzEzLDAuMTU5NzM1
NjE4NDIzMzM1LC0wLjA2ODM2NzQ4NDI0OTg4MDEsLTAuMjMzNjk2NTU0MTg5
MTY0LC0wLjIzOTEyNjk3MTQ4MDYyNSwwLjE0Nzg4NDM1MjU4ODQ5OSwtMC4y
MjI1MzM5NTI2MzM0ODIsMC4yMTkwNzgzNTI4OTA2NTcsMC4xOTE4MjA0NDc0
MDQzMzUsMC4xOTE0MjExMzQxODk2ODIsMC4zNDY0NDE0MTExMTYxNDcsLTAu
MjMxMDMyMDE0OTI3Mzk3LDAuMzEyNjY0MTk5NjMxNjIwLDAuOTYzMTMxNjM5
NTYwMTA4DQo=

--1660387551-1458482416-1249639718=:2997--



More information about the R-devel mailing list