Classification Support Vector Machine Learner
mlr_learners_classif.smo.Rd
Support Vector classifier trained with John Platt's sequential minimal optimization algorithm.
Calls RWeka::SMO()
from RWeka.
Custom mlr3 parameters
output_debug_info
:original id: output-debug-info
do_not_check_capabilities
:original id: do-not-check-capabilities
num_decimal_places
:original id: num-decimal-places
batch_size
:original id: batch-size
E_poly
:original id: E
L_poly
:original id: L
C_poly
:original id: C
C_logistic
:original id: C
R_logistic
:original id: R
M_logistic
:original id: M
Reason for change: This learner contains changed ids of the following control arguments since their ids contain irregular pattern
Parameters
Id | Type | Default | Levels | Range |
subset | untyped | - | - | |
na.action | untyped | - | - | |
no_checks | logical | FALSE | TRUE, FALSE | - |
C | numeric | 1 | \((-\infty, \infty)\) | |
N | character | 0 | 0, 1, 2 | - |
L | numeric | 0.001 | \((-\infty, \infty)\) | |
P | numeric | 1e-12 | \((-\infty, \infty)\) | |
M | logical | FALSE | TRUE, FALSE | - |
V | integer | -1 | \((-\infty, \infty)\) | |
W | integer | 1 | \((-\infty, \infty)\) | |
K | character | PolyKernel | NormalizedPolyKernel, PolyKernel, Puk, RBFKernel, StringKernel | - |
calibrator | untyped | "weka.classifiers.functions.Logistic" | - | |
E_poly | numeric | 1 | \((-\infty, \infty)\) | |
L_poly | logical | FALSE | TRUE, FALSE | - |
C_poly | integer | 25007 | \((-\infty, \infty)\) | |
C_logistic | logical | FALSE | TRUE, FALSE | - |
R_logistic | numeric | - | \((-\infty, \infty)\) | |
M_logistic | integer | -1 | \((-\infty, \infty)\) | |
output_debug_info | logical | FALSE | TRUE, FALSE | - |
do_not_check_capabilities | logical | FALSE | TRUE, FALSE | - |
num_decimal_places | integer | 2 | \([1, \infty)\) | |
batch_size | integer | 100 | \([1, \infty)\) | |
options | untyped | NULL | - |
References
Platt J (1998). “Fast Training of Support Vector Machines using Sequential Minimal Optimization.” In Schoelkopf B, Burges C, Smola A (eds.), Advances in Kernel Methods - Support Vector Learning. MIT Press. http://research.microsoft.com/jplatt/smo.html.
Keerthi S, Shevade S, Bhattacharyya C, Murthy K (2001). “Improvements to Platt's SMO Algorithm for SVM Classifier Design.” Neural Computation, 13(3), 637-649.
Hastie T, Tibshirani R (1998). “Classification by Pairwise Coupling.” In Jordan MI, Kearns MJ, Solla SA (eds.), Advances in Neural Information Processing Systems, volume 10.
See also
as.data.table(mlr_learners)
for a table of available Learners in the running session (depending on the loaded packages).Chapter in the mlr3book: https://mlr3book.mlr-org.com/basics.html#learners
mlr3learners for a selection of recommended learners.
mlr3cluster for unsupervised clustering learners.
mlr3pipelines to combine learners with pre- and postprocessing steps.
mlr3tuning for tuning of hyperparameters, mlr3tuningspaces for established default tuning spaces.
Super classes
mlr3::Learner
-> mlr3::LearnerClassif
-> LearnerClassifSMO
Examples
# Define the Learner
learner = mlr3::lrn("classif.smo")
print(learner)
#> <LearnerClassifSMO:classif.smo>: Support Vector Machine
#> * Model: -
#> * Parameters: list()
#> * Packages: mlr3, RWeka
#> * Predict Types: [response], prob
#> * Feature Types: logical, integer, numeric, factor, ordered
#> * Properties: missings, multiclass, twoclass
# Define a Task
task = mlr3::tsk("sonar")
# Create train and test set
ids = mlr3::partition(task)
# Train the learner on the training ids
learner$train(task, row_ids = ids$train)
print(learner$model)
#> SMO
#>
#> Kernel used:
#> Linear Kernel: K(x,y) = <x,y>
#>
#> Classifier for classes: M, R
#>
#> BinarySMO
#>
#> Machine linear: showing attribute weights, not support vectors.
#>
#> -0.3294 * (normalized) V1
#> + -1.0855 * (normalized) V10
#> + -1.6984 * (normalized) V11
#> + -1.4758 * (normalized) V12
#> + -0.7128 * (normalized) V13
#> + 0.8303 * (normalized) V14
#> + 0.8588 * (normalized) V15
#> + 0.3944 * (normalized) V16
#> + -0.1734 * (normalized) V17
#> + -0.0423 * (normalized) V18
#> + 0.1487 * (normalized) V19
#> + -0.0985 * (normalized) V2
#> + 0.0139 * (normalized) V20
#> + -0.1047 * (normalized) V21
#> + -0.8675 * (normalized) V22
#> + -0.689 * (normalized) V23
#> + 0.0187 * (normalized) V24
#> + 0.327 * (normalized) V25
#> + 0.4808 * (normalized) V26
#> + 0.1184 * (normalized) V27
#> + -1.1194 * (normalized) V28
#> + -0.124 * (normalized) V29
#> + 0.6092 * (normalized) V3
#> + -0.4824 * (normalized) V30
#> + 1.2162 * (normalized) V31
#> + 0.2052 * (normalized) V32
#> + 0.1934 * (normalized) V33
#> + 0.0538 * (normalized) V34
#> + 0.0088 * (normalized) V35
#> + 0.7903 * (normalized) V36
#> + 0.8661 * (normalized) V37
#> + -0.4677 * (normalized) V38
#> + -0.21 * (normalized) V39
#> + -0.5597 * (normalized) V4
#> + 0.9772 * (normalized) V40
#> + -0.6496 * (normalized) V41
#> + 0.1253 * (normalized) V42
#> + -0.3136 * (normalized) V43
#> + -1.0209 * (normalized) V44
#> + -1.0068 * (normalized) V45
#> + -0.5484 * (normalized) V46
#> + -0.0429 * (normalized) V47
#> + -0.2758 * (normalized) V48
#> + -1.2616 * (normalized) V49
#> + -0.5141 * (normalized) V5
#> + 0.6515 * (normalized) V50
#> + -0.6319 * (normalized) V51
#> + -1.1104 * (normalized) V52
#> + 0.0606 * (normalized) V53
#> + 0.1476 * (normalized) V54
#> + 0.4627 * (normalized) V55
#> + 0.8799 * (normalized) V56
#> + 0.3064 * (normalized) V57
#> + -1.0134 * (normalized) V58
#> + -0.9756 * (normalized) V59
#> + 0.0571 * (normalized) V6
#> + -0.058 * (normalized) V60
#> + 0.5798 * (normalized) V7
#> + 0.5534 * (normalized) V8
#> + -0.828 * (normalized) V9
#> + 2.2925
#>
#> Number of kernel evaluations: 6201 (90.002% cached)
#>
#>
# Make predictions for the test rows
predictions = learner$predict(task, row_ids = ids$test)
# Score the predictions
predictions$score()
#> classif.ce
#> 0.2753623