Classification Support Vector Machine Learner

Support Vector classifier trained with John Platt's sequential minimal optimization algorithm. Calls RWeka::SMO() from RWeka.

Custom mlr3 parameters

• output_debug_info:

  • original id: output-debug-info

• do_not_check_capabilities:

  • original id: do-not-check-capabilities

• num_decimal_places:

  • original id: num-decimal-places

• batch_size:

  • original id: batch-size

• E_poly:

  • original id: E

• L_poly:

  • original id: L

• C_poly:

  • original id: C

• C_logistic:

  • original id: C

• R_logistic:

  • original id: R

• M_logistic:

  • original id: M

• Reason for change: This learner contains changed ids of the following control arguments since their ids contain irregular pattern

Dictionary

This Learner can be instantiated via lrn():

lrn("classif.smo")

Meta Information

• Task type: “classif”

• Predict Types: “response”, “prob”

• Feature Types: “logical”, “integer”, “numeric”, “factor”, “ordered”

• Required Packages: mlr3, RWeka

Parameters

Id	Type	Default	Levels	Range
subset	untyped	-		-
na.action	untyped	-		-
no_checks	logical	FALSE	TRUE, FALSE	-
C	numeric	1		\((-\infty, \infty)\)
N	character	0	0, 1, 2	-
L	numeric	0.001		\((-\infty, \infty)\)
P	numeric	1e-12		\((-\infty, \infty)\)
M	logical	FALSE	TRUE, FALSE	-
V	integer	-1		\((-\infty, \infty)\)
W	integer	1		\((-\infty, \infty)\)
K	character	PolyKernel	NormalizedPolyKernel, PolyKernel, Puk, RBFKernel, StringKernel	-
calibrator	untyped	"weka.classifiers.functions.Logistic"		-
E_poly	numeric	1		\((-\infty, \infty)\)
L_poly	logical	FALSE	TRUE, FALSE	-
C_poly	integer	25007		\((-\infty, \infty)\)
C_logistic	logical	FALSE	TRUE, FALSE	-
R_logistic	numeric	-		\((-\infty, \infty)\)
M_logistic	integer	-1		\((-\infty, \infty)\)
output_debug_info	logical	FALSE	TRUE, FALSE	-
do_not_check_capabilities	logical	FALSE	TRUE, FALSE	-
num_decimal_places	integer	2		\([1, \infty)\)
batch_size	integer	100		\([1, \infty)\)
options	untyped	NULL		-

References

Platt J (1998). “Fast Training of Support Vector Machines using Sequential Minimal Optimization.” In Schoelkopf B, Burges C, Smola A (eds.), Advances in Kernel Methods - Support Vector Learning. MIT Press. https://www.microsoft.com/en-us/research/publication/sequential-minimal-optimization-a-fast-algorithm-for-training-support-vector-machines/.

Keerthi S, Shevade S, Bhattacharyya C, Murthy K (2001). “Improvements to Platt's SMO Algorithm for SVM Classifier Design.” Neural Computation, 13(3), 637-649.

Hastie T, Tibshirani R (1998). “Classification by Pairwise Coupling.” In Jordan MI, Kearns MJ, Solla SA (eds.), Advances in Neural Information Processing Systems, volume 10.

See also

• Dictionary of Learners: mlr3::mlr_learners.

• as.data.table(mlr_learners) for a table of available Learners in the running session (depending on the loaded packages).

• Chapter in the mlr3book: https://mlr3book.mlr-org.com/chapters/chapter2/data_and_basic_modeling.html#sec-learners

• mlr3learners for a selection of recommended learners.

• mlr3cluster for unsupervised clustering learners.

• mlr3pipelines to combine learners with pre- and postprocessing steps.

• mlr3tuning for tuning of hyperparameters, mlr3tuningspaces for established default tuning spaces.

Author

damirpolat

Super classes

mlr3::Learner -> mlr3::LearnerClassif -> LearnerClassifSMO

Active bindings

marshaled

(logical(1))
Whether the learner has been marshaled.

Methods

Public methods

• LearnerClassifSMO$new()

• LearnerClassifSMO$marshal()

• LearnerClassifSMO$unmarshal()

• LearnerClassifSMO$clone()

Inherited methods

• mlr3::Learner$base_learner()
• mlr3::Learner$configure()
• mlr3::Learner$encapsulate()
• mlr3::Learner$format()
• mlr3::Learner$help()
• mlr3::Learner$predict()
• mlr3::Learner$predict_newdata()
• mlr3::Learner$print()
• mlr3::Learner$reset()
• mlr3::Learner$selected_features()
• mlr3::Learner$train()
• mlr3::LearnerClassif$predict_newdata_fast()

---

LearnerClassifSMO$new()

Creates a new instance of this R6 class.

Usage

LearnerClassifSMO$new()

---

LearnerClassifSMO$marshal()

Marshal the learner's model.

Usage

LearnerClassifSMO$marshal(...)

Arguments

...

(any)
Additional arguments passed to mlr3::marshal_model().

---

LearnerClassifSMO$unmarshal()

Unmarshal the learner's model.

Usage

LearnerClassifSMO$unmarshal(...)

Arguments

...

(any)
Additional arguments passed to mlr3::unmarshal_model().

---

LearnerClassifSMO$clone()

The objects of this class are cloneable with this method.

Usage

LearnerClassifSMO$clone(deep = FALSE)

Arguments

deep

Whether to make a deep clone.

Examples

# Define the Learner
learner = lrn("classif.smo")
print(learner)
#> 
#> ── <LearnerClassifSMO> (classif.smo): Support Vector Machine ───────────────────
#> • Model: -
#> • Parameters: list()
#> • Packages: mlr3 and RWeka
#> • Predict Types: [response] and prob
#> • Feature Types: logical, integer, numeric, factor, and ordered
#> • Encapsulation: none (fallback: -)
#> • Properties: marshal, missings, multiclass, and twoclass
#> • Other settings: use_weights = 'error', predict_raw = 'FALSE'

# Define a Task
task = tsk("sonar")

# Create train and test set
ids = partition(task)

# Train the learner on the training ids
learner$train(task, row_ids = ids$train)

print(learner$model)
#> SMO
#> 
#> Kernel used:
#>   Linear Kernel: K(x,y) = <x,y>
#> 
#> Classifier for classes: M, R
#> 
#> BinarySMO
#> 
#> Machine linear: showing attribute weights, not support vectors.
#> 
#>         -0.6713 * (normalized) V1
#>  +      -0.429  * (normalized) V10
#>  +      -1.4567 * (normalized) V11
#>  +      -1.4301 * (normalized) V12
#>  +      -0.1309 * (normalized) V13
#>  +      -0.2521 * (normalized) V14
#>  +       0.2569 * (normalized) V15
#>  +       0.5479 * (normalized) V16
#>  +       0.6749 * (normalized) V17
#>  +       0.3005 * (normalized) V18
#>  +      -0.4054 * (normalized) V19
#>  +       0.2681 * (normalized) V2
#>  +      -0.0124 * (normalized) V20
#>  +      -0.8813 * (normalized) V21
#>  +      -0.3805 * (normalized) V22
#>  +       0.1565 * (normalized) V23
#>  +      -0.7174 * (normalized) V24
#>  +      -0.1794 * (normalized) V25
#>  +       0.0971 * (normalized) V26
#>  +      -0.3063 * (normalized) V27
#>  +      -0.8959 * (normalized) V28
#>  +      -0.8829 * (normalized) V29
#>  +       0.8152 * (normalized) V3
#>  +      -0.1533 * (normalized) V30
#>  +       1.1939 * (normalized) V31
#>  +       0.1542 * (normalized) V32
#>  +      -0.2038 * (normalized) V33
#>  +      -0.1734 * (normalized) V34
#>  +      -0.1605 * (normalized) V35
#>  +       1.054  * (normalized) V36
#>  +       0.7569 * (normalized) V37
#>  +      -0.5313 * (normalized) V38
#>  +      -0.8355 * (normalized) V39
#>  +      -1.4946 * (normalized) V4
#>  +       0.5966 * (normalized) V40
#>  +       0.1291 * (normalized) V41
#>  +       0.3    * (normalized) V42
#>  +      -0.1589 * (normalized) V43
#>  +      -0.7472 * (normalized) V44
#>  +      -0.9281 * (normalized) V45
#>  +      -0.6038 * (normalized) V46
#>  +      -0.8392 * (normalized) V47
#>  +      -0.8698 * (normalized) V48
#>  +      -1.1038 * (normalized) V49
#>  +      -0.7317 * (normalized) V5
#>  +       0.9889 * (normalized) V50
#>  +      -0.0678 * (normalized) V51
#>  +      -1.2126 * (normalized) V52
#>  +      -0.5583 * (normalized) V53
#>  +      -0.1607 * (normalized) V54
#>  +       0.1019 * (normalized) V55
#>  +      -0.062  * (normalized) V56
#>  +      -0.0198 * (normalized) V57
#>  +      -0.5661 * (normalized) V58
#>  +      -1.2875 * (normalized) V59
#>  +       0.0377 * (normalized) V6
#>  +       0.2022 * (normalized) V60
#>  +       0.5281 * (normalized) V7
#>  +       0.6162 * (normalized) V8
#>  +      -0.1424 * (normalized) V9
#>  +       4.2959
#> 
#> Number of kernel evaluations: 5917 (91.901% cached)
#> 
#> 


# Make predictions for the test rows
predictions = learner$predict(task, row_ids = ids$test)

# Score the predictions
predictions$score()
#> classif.ce 
#>   0.173913