[Rd] Windows 2000 crash while using rbind (PR#8225)

[ripley@stats.ox.ac.uk]

This is a stack-size issue.  Windows provides only a small stack by 
default (2Mb in R 2.2.0).  Your example will work in R-patched (which has 
a 10Mb stack) and R-devel (which has 10Mb and some stack-checking).

The non-technical summary is that you ran out of resources.  Fortunately 
we have been working on that issue and have builds with more resources.

Why this calculation is taking so much stack needs further investigation.


On Thu, 20 Oct 2005 Tom.Mulholland at dpi.wa.gov.au wrote:

> Windows 2000 reports that "Rgui.exe has generated errors and will be =
> closed by Windows. You will need to restart the program." when using =
> rbind.=20
>
>
> df1 <- data.frame(cbind(x=3D1, y=3D1:1000), fac=3Dsample(LETTERS[1:3], =
> 1000, repl=3DTRUE))
> df2 <- data.frame(cbind(x=3D1, y=3D1:10), fac=3Dsample(LETTERS[4:6], =
> 10, repl=3DTRUE))
> df3 <- data.frame(cbind(x=3D1, y=3D1:1000000), =
> fac=3Dsample(LETTERS[1:3], 1000000, repl=3DTRUE))
> df4 <- rbind(df1,df2)
> df5 <- rbind(df2,df3)
> =20
> =20
> Since this only happens intermittantly and appears to be related to the =
> size of the objects I ran the following code.
>
> sink("rbind test.txt")
> df1 <- data.frame(cbind(x=3D1, y=3D1:10), fac=3Dsample(LETTERS[4:6], 10, =
> repl=3DTRUE))
> for (j in seq(100000,1000000,10000)){
> df2 <- data.frame(cbind(x=3D1, y=3D1:j), fac=3Dsample(LETTERS[1:3], j, =
> repl=3DTRUE))
> print(j)
> df3 <- rbind(df2,df1)
> }
> sink()
>
> the output of rbind test.txt is
> [1] 100000
> [1] 110000
> [1] 120000
> ...
> [1] 510000
> [1] 520000
>
> I then ran=20
>
>
> sink("rbind test 2.txt")
> df1 <- data.frame(cbind(a =3D 1, b =3D 2, c =3D 3, d =3D 4, e =3D 5, f =
> =3D 6, x=3D1, y=3D1:10), fac=3Dsample(LETTERS[4:6], 10, repl=3DTRUE))
> for (j in seq(100000,1000000,10000)){
> df2 <- data.frame(cbind(a =3D 1, b =3D 2, c =3D 3, d =3D 4, e =3D 5, f =
> =3D 6, x=3D1, y=3D1:j), fac=3Dsample(LETTERS[1:3], j, repl=3DTRUE))
> print(j)
> df3 <- rbind(df2,df1)
> }
> sink()
>
> which also stopped at 520000.
>
> I tried to narrow down where the crash takes place but it would appear =
> that it is a moving feast, however both pieces of code always stopped =
> with the same number, somewhere around 520000.
>
>> version
>         _             =20
> platform i386-pc-mingw32
> arch     i386          =20
> os       mingw32       =20
> system   i386, mingw32 =20
> status                 =20
> major    2             =20
> minor    2.0           =20
> year     2005          =20
> month    10            =20
> day      06            =20
> svn rev  35749         =20
> language R=20
>
> One of the examples that has failed for me looks like
> pop <- rbind(om.tp[,c(6,2,4,5,3)],eas[,c(2,1,3,4,5)])
>
>
>> str(om.tp[,c(6,2,4,5,3)])
> `data.frame':   1001384 obs. of  5 variables:
> $ age5 : Factor w/ 18 levels "0 to 4","5 to 9",..: 1 1 1 1 1 2 2 2 2 2 =
> ...
> $ sex  : Factor w/ 2 levels "Females","Males": 1 1 1 1 1 1 1 1 1 1 ...
> $ lga  : Factor w/ 142 levels "Albany (C)","Armadale (C)",..: 21 21 21 =
> 21 21 21 21 21 21 21 ...
> $ count: num  7.33 7.45 7.05 6.31 5.71 ...
> $ year : Factor w/ 41 levels "2001","2002",..: 1 1 1 1 1 1 1 1 1 1 ...
>> str(eas[,c(2,1,3,4,5)])
> `data.frame':   25342 obs. of  5 variables:
> $ age5 : Factor w/ 18 levels "0 to 4","5 to 9",..: 1 1 1 1 1 1 1 1 1 1 =
> ...
> $ sex  : Factor w/ 2 levels "Females","Males": 2 2 2 2 2 2 2 2 2 2 ...
> $ lga  : Factor w/ 142 levels "Albany (C)","Armadale (C)",..: 1 2 3 4 5 =
> 6 7 8 9 10 ...
> $ count: num  1107 2163  532  294  479 ...
> $ year : Factor w/ 5 levels "1991","1996",..: 1 1 1 1 1 1 1 1 1 1 ...
>> gc()
>           used  (Mb) gc trigger  (Mb) max used  (Mb)
> Ncells  3255820  87.0    6193578 165.4  5266303 140.7
> Vcells 22096825 168.6   32770865 250.1 32114295 245.1
>
> Tom Mulholland
> Senior Demographer
> Spatial Information and Research
> State and Regional Policy
> Department for Planning and Infrastructure
> Perth, Western Australia
> +61 (08) 9264 7936
>
> ______________________________________________
> R-devel at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-devel
>
>

-- 
Brian D. Ripley,                  ripley at stats.ox.ac.uk
Professor of Applied Statistics,  http://www.stats.ox.ac.uk/~ripley/
University of Oxford,             Tel:  +44 1865 272861 (self)
1 South Parks Road,                     +44 1865 272866 (PA)
Oxford OX1 3TG, UK                Fax:  +44 1865 272595