[R] changing the loss function in the logistic regression?

Frank E Harrell Jr f.harrell at vanderbilt.edu
Fri Jun 26 23:07:48 CEST 2009


Michael wrote:
> Hi Frank,
> 
> Thanks for your help!
> 
> I want to incorporate lift score as the optimization objective. How to
> do that in logistic regression?
> 
> Thanks!

Please re-read my note.

Models should be fitted using proper scoring rules.  Otherwise the 
resulting fit is bogus.

Thanks
Frank

> 
> On Fri, Jun 26, 2009 at 7:47 AM, Frank E Harrell
> Jr<f.harrell at vanderbilt.edu> wrote:
>> Michael wrote:
>>> Hi all,
>>>
>>> Is there a way to change the loss function in the logistic regression?
>>> Or we could provide a customized loss function in the logistic
>>> regression so we could use that loss function in the Cross Validation
>>> in logistic regression?
>>>
>>> Thanks a lot!
>> The goal is to use a loss function that yields optimality, with a sensible
>> definition of optimality.  For many purposes, maximum likelihood or
>> penalized maximum likelihood is optimum.  So don't change the optimality
>> criteria just because you are cross-validating a different measure.
>>
>> By the way, it's often not a good idea to cross-validate a different
>> measure.  At least the accuracy index should be information-preserving.
>>  Deviance, log-likelihood, and AIC are your friends.
>>
>> Frank
>>
>> --
>> Frank E Harrell Jr   Professor and Chair           School of Medicine
>>                     Department of Biostatistics   Vanderbilt University
>>
> 


-- 
Frank E Harrell Jr   Professor and Chair           School of Medicine
                      Department of Biostatistics   Vanderbilt University




More information about the R-help mailing list