[R] Burt table from word frequency list

[Murray Cooper]

The usual approach is to count the co-occurence within so many words of each 
other.
Typical is between 5 words before and 5 words after a given word.
So for each word in the document, you look for the occurence of all other 
words
within -5 -4 -3 -2 -1 0 1 2 3 4 5 words. Depending on the language and the 
question
being asked certain words may be excluded.

This is not a simple function! I don't know if anyone has done a package, 
for this type
of analysis but with over 2000 packages floating around you might get lucky.

Murray M Cooper, Ph.D.
Richland Statistics
9800 N 24th St
Richland, MI, USA 49083
Mail: richstat at earthlink.net

----- Original Message ----- 
From: "Ted Harding" <Ted.Harding at manchester.ac.uk>
To: "Joan-Josep Vallbé" <Pep.Vallbe at uab.cat>
Cc: <r-help at r-project.org>
Sent: Sunday, March 29, 2009 2:46 PM
Subject: Re: [R] Burt table from word frequency list


On 29-Mar-09 16:32:11, Joan-Josep Vallbé wrote:
> Ok, thank you. And is there any function to get the table directly
> from the original corpus?
>
> best,
> joan-josep vallbé

You will have to think about what you are doing. As Duncan said,
you need "counts of pairs of words" or, more precisely, of
co-occurrence. But co-occurrence within what?

Adjacent?
Within the same sentence?
Within the same paragraph?
Within the same chapter?
Within the same document (if your corpus incorporates several
  documents)?
Within documents by the same author?
  If so, then is there an additional classification by
  individual document?

Etc., etc., etc.

In short, what is the structure of your corpus, and how do
you wish this to be represented in the Burt table?

Hoping this helps to move you forward,
Ted.

> On Mar 29, 2009, at 2:00 PM, Duncan Murdoch wrote:
>
>> On 29/03/2009 7:02 AM, Joan-Josep Vallbé wrote:
>>> Dear all,
>>> I have a word frequency list from a corpus (say, in .csv), where
>>> the  first column is a word and the second is the occurrence
>>> frequency of  that word in the corpus. Is it possible to obtain a
>>> Burt table (a  table crossing all words with each other, i.e.,
>>> where rows and columns  are the words) from that frequency list
>>> with R? I'm exploring the "ca"  package but I'm not able to solve
>>> this detail.
>>
>> No, because you don't have any information on that.  You only have
>> marginal counts.  You need counts of pairs of words (from the
>> original corpus, or already summarized.)
>>
>> Duncan Murdoch
>
> ______________________________________________
> R-help at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.

--------------------------------------------------------------------
E-Mail: (Ted Harding) <Ted.Harding at manchester.ac.uk>
Fax-to-email: +44 (0)870 094 0861
Date: 29-Mar-09                                       Time: 18:46:40
------------------------------ XFMail ------------------------------

______________________________________________
R-help at r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.