Username Remember Me?
Password   forgot password?
   
   
ROC Curve error
Posted: 11 May 2009 02:14 PM   [ Ignore ]  
Newbie
Rank
Total Posts:  25
Joined  2009-04-17

>> tr=setlablist(gendatb,{’apple’,’banana’})
Banana Set, 100 by 2 dataset with 2 classes: [50 50]
>> w=knnc(a,10)
10-NN Classifier, 2 to 2 trained mapping --> knn_map
>> ts=setlablist(gendatb,{’apple’,’banana’})
Banana Set, 100 by 2 dataset with 2 classes: [50 50]
>> out=ts*w
Banana Set, 100 by 2 dataset with 2 classes: [50 50]

>> r=sdroc(out,’measures’,{’FPr’,’apple’,’TPr’,’apple’,’FNr’,’apple’})
ROC (2001 w-based op.points, 4 measures), curop: 708
est: 1:FPr(apple)=0.00, 2:TPr(apple)=0.98, 3:FNr(apple)=0.02, 4:mean-error [0.50,0.50]=0.01
>> sddrawroc(r)

When i tried the above steps to generate a ROC curve, error appears like the following:
r=sdroc(out,’measures’,{’FPr’,’apple’,’TPr’,’apple’,’FNr’,’apple’})
??? Undefined function or method ‘sdroc’ for input arguments of type ‘dataset’.

[ Edited: 12 May 2009 09:48 AM by pavel]
Profile
 
 
Posted: 11 May 2009 03:13 PM   [ Ignore ]   [ # 1 ]  
Administrator
Avatar
RankRankRankRank
Total Posts:  236
Joined  2008-04-26

Dear park,

I can run your example without error.

The ‘undefined function’ error suggests Matlab cannot find sdroc command (which comes from prsd_toolbox, the Matlab part of PRSD Studio). You will need to add PRSD toolbox on your path.

Second thing I can see is that you train the classifier not on the dataset tr but on some other dataset a. If this dataset comes from a different classification problem or has numerical labels (not string as sdroc expects), sdroc returns an error.

Pavel

Profile
 
 
Posted: 11 May 2009 03:28 PM   [ Ignore ]   [ # 2 ]  
Newbie
Rank
Total Posts:  25
Joined  2009-04-17

Dear Pavel,

r=sdroc(out,’measures’,{’FPr’,’apple’,’TPr’,’apple’,’FNr’,’apple’})
??? Undefined function or method ‘sdroc’ for input arguments of type ‘dataset’.

I have set the path and also trained the classifier on dataset tr. But, still the error exists. file roc.m exists in the path that i have set.

Profile
 
 
Posted: 11 May 2009 03:31 PM   [ Ignore ]   [ # 3 ]  
Administrator
Avatar
RankRankRankRank
Total Posts:  236
Joined  2008-04-26

Dear Park,

yes, but you’re not invoking roc.m (which is PRTools command already on your path) but sdroc.m which is defined in prsd_toolbox and is probably not available.

Pavel

Profile
 
 
Posted: 11 May 2009 03:40 PM   [ Ignore ]   [ # 4 ]  
Newbie
Rank
Total Posts:  25
Joined  2009-04-17

Dear Pavel,

I am using PR tools for non-commercial academic use in research and education.
Is the toolbox available for that?
Is it possible to send the file (sdroc.m) through email?

Profile
 
 
Posted: 11 May 2009 03:47 PM   [ Ignore ]   [ # 5 ]  
Administrator
Avatar
RankRankRankRank
Total Posts:  236
Joined  2008-04-26

Dear Park,

please download the PRSD Studio Lite (http://prsysdesign.net/index.php/html/download/). You can use it freely for non-commercial purposes. It is limited to 300 samples and 3 classes. If you need to use larger datasets, you can buy the academic version (http://prsysdesign.net/index.php/html/software_pricing/)

Pavel

Profile
 
 
Posted: 11 May 2009 06:06 PM   [ Ignore ]   [ # 6 ]  
Newbie
Rank
Total Posts:  25
Joined  2009-04-17

Dear Pavel,

When i typed the key provided in email, iam getting the following error.

PRSD Studio initialization script
---------------------------------

Searching for PRTools toolbox: PRTools 4.1.4 11-Oct-2008 present

PRSD Toolbox 1.1.5 29-Apr-2009 present
Searching for the license...not found.
Please enter the PRSD Toolbox activation key you’ve received in the download e-mail.
PRSD Toolbox activation key: 7868-1521-0424-1302

PRSD Toolbox Lite 1.1.5 (29-Apr-2009), Copyright (C) 2007-2009, PR Sys Design, All rights
reserved
Only for non-commercial use.
Activation error: Cannot connect to the PR Sys Design license server. Please report this
problem to
??? Error using ==> prsd_init at 78
PRSD Toolbox activation failed. Check if you enter the proper key. In case the problem
remains, please contact us at

Error in ==> run at 57
evalin(’caller’, [s ‘;’]);

Please do the needful.

Profile
 
 
Posted: 11 May 2009 07:41 PM   [ Ignore ]   [ # 7 ]  
Administrator
Avatar
RankRankRankRank
Total Posts:  236
Joined  2008-04-26

Dear Park,

thank you for reporting this problem. It seems your machine cannot contact our activation server (which works fine as I tested just now). Could it be you’re behind a firewall that blocks the outbound traffic?

Possible workaround: I’ve just uploaded the updated version that prints hostid of your machine if activation fails. Please download it and run prsd_init again on the new version. In case the same error occurs, please send me the error message to and we will email you the license.

Sorry for this inconvenience and thank you once more for your feedback!

Best regards,

Pavel

Profile