LiblineaR Classification Learner

L2 regularized support vector classification. Calls LiblineaR::LiblineaR() from LiblineaR.

Details

Type of SVC depends on type argument:

• 0 – L2-regularized logistic regression (primal)

• 1 - L2-regularized L2-loss support vector classification (dual)

• 3 - L2-regularized L1-loss support vector classification (dual)

• 2 – L2-regularized L2-loss support vector classification (primal)

• 4 – Support vector classification by Crammer and Singer

• 5 - L1-regularized L2-loss support vector classification

• 6 - L1-regularized logistic regression

• 7 - L2-regularized logistic regression (dual)

If number of records > number of features, type = 2 is faster than type = 1 (Hsu et al. 2003).

Note that probabilistic predictions are only available for types 0, 6, and 7. The default epsilon value depends on the type parameter, see LiblineaR::LiblineaR().

Dictionary

This Learner can be instantiated via lrn():

lrn("classif.liblinear")

Meta Information

• Task type: “classif”

• Predict Types: “response”, “prob”

• Feature Types: “numeric”

• Required Packages: mlr3, mlr3extralearners, LiblineaR

Parameters

Id	Type	Default	Levels	Range
type	integer	0		\([0, 7]\)
cost	numeric	1		\([0, \infty)\)
epsilon	numeric	-		\([0, \infty)\)
bias	numeric	1		\((-\infty, \infty)\)
cross	integer	0		\([0, \infty)\)
verbose	logical	FALSE	TRUE, FALSE	-
wi	untyped	NULL		-
findC	logical	FALSE	TRUE, FALSE	-
useInitC	logical	TRUE	TRUE, FALSE	-

References

Fan, Rong-En, Chang, Kai-Wei, Hsieh, Cho-Jui, Wang, Xiang-Rui, Lin, Chih-Jen (2008). “LIBLINEAR: A library for large linear classification.” the Journal of machine Learning research, 9, 1871–1874.

See also

• Dictionary of Learners: mlr3::mlr_learners.

• as.data.table(mlr_learners) for a table of available Learners in the running session (depending on the loaded packages).

• Chapter in the mlr3book: https://mlr3book.mlr-org.com/chapters/chapter2/data_and_basic_modeling.html#sec-learners

• mlr3learners for a selection of recommended learners.

• mlr3cluster for unsupervised clustering learners.

• mlr3pipelines to combine learners with pre- and postprocessing steps.

• mlr3tuning for tuning of hyperparameters, mlr3tuningspaces for established default tuning spaces.

Author

be-marc

Super classes

mlr3::Learner -> mlr3::LearnerClassif -> LearnerClassifLiblineaR

Methods

Public methods

• LearnerClassifLiblineaR$new()

• LearnerClassifLiblineaR$clone()

Inherited methods

• mlr3::Learner$base_learner()
• mlr3::Learner$configure()
• mlr3::Learner$encapsulate()
• mlr3::Learner$format()
• mlr3::Learner$help()
• mlr3::Learner$predict()
• mlr3::Learner$predict_newdata()
• mlr3::Learner$print()
• mlr3::Learner$reset()
• mlr3::Learner$selected_features()
• mlr3::Learner$train()
• mlr3::LearnerClassif$predict_newdata_fast()

---

LearnerClassifLiblineaR$new()

Creates a new instance of this R6 class.

Usage

LearnerClassifLiblineaR$new()

---

LearnerClassifLiblineaR$clone()

The objects of this class are cloneable with this method.

Usage

LearnerClassifLiblineaR$clone(deep = FALSE)

Arguments

deep

Whether to make a deep clone.

Examples

# Define the Learner
learner = lrn("classif.liblinear")
print(learner)
#> 
#> ── <LearnerClassifLiblineaR> (classif.liblinear): Support Vector Machine ───────
#> • Model: -
#> • Parameters: list()
#> • Packages: mlr3, mlr3extralearners, and LiblineaR
#> • Predict Types: [response] and prob
#> • Feature Types: numeric
#> • Encapsulation: none (fallback: -)
#> • Properties: multiclass and twoclass
#> • Other settings: use_weights = 'error', predict_raw = 'FALSE'

# Define a Task
task = tsk("sonar")

# Create train and test set
ids = partition(task)

# Train the learner on the training ids
learner$train(task, row_ids = ids$train)

print(learner$model)
#> $TypeDetail
#> [1] "L2-regularized logistic regression primal (L2R_LR)"
#> 
#> $Type
#> [1] 0
#> 
#> $W
#>               V1        V10       V11       V12        V13        V14       V15
#> [1,] -0.08421187 -0.7065261 -1.149165 -1.184134 -0.6038325 0.09507805 0.6096418
#>            V16       V17         V18        V19         V2        V20
#> [1,] 0.8128018 0.2541213 -0.07195225 -0.2290659 -0.1321337 -0.1677096
#>             V21        V22        V23        V24         V25       V26
#> [1,] -0.2717648 -0.3585888 -0.1162153 -0.4100821 -0.03905957 0.6651488
#>            V27        V28        V29         V3        V30       V31       V32
#> [1,] 0.5007754 -0.2820957 0.03204067 -0.2509722 0.05168889 0.6238485 0.1559399
#>           V33       V34       V35      V36       V37        V38        V39
#> [1,] 0.275372 0.4496596 0.6137172 1.213372 0.5508438 -0.5738552 -0.4735414
#>             V4      V40       V41        V42        V43       V44       V45
#> [1,] -0.578135 0.352911 -0.222937 -0.7339408 -0.9062992 -1.281349 -1.512481
#>             V46       V47        V48        V49         V5         V50
#> [1,] -0.9957077 -0.775918 -0.7559107 -0.4081976 -0.5702384 0.003241282
#>             V51         V52         V53         V54          V55         V56
#> [1,] -0.1261468 -0.08840331 -0.03562363 -0.04308056 -0.008834006 -0.04693627
#>              V57         V58         V59         V6         V60         V7
#> [1,] 0.007652789 -0.04181549 -0.05760866 -0.1674691 -0.04392776 -0.1328432
#>              V8         V9      Bias
#> [1,] -0.4234848 -0.7738424 0.6849929
#> 
#> $Bias
#> [1] 1
#> 
#> $ClassNames
#> [1] R M
#> Levels: M R
#> 
#> $NbClass
#> [1] 2
#> 
#> attr(,"class")
#> [1] "LiblineaR"


# Make predictions for the test rows
predictions = learner$predict(task, row_ids = ids$test)

# Score the predictions
predictions$score()
#> classif.ce 
#>  0.2753623