features.md
April 3, 2026 ยท View on GitHub
Scikit-Learn
Examples: main.py
- Probability Calibration:
- Clustering:
- Composite estimators:
- Cross decomposition:
- Matrix decomposition:
- Discriminant analysis:
- Dummies:
- Ensemble methods:
ensemble.AdaBoostClassifierensemble.AdaBoostRegressorensemble.BaggingClassifierensemble.BaggingRegressorensemble.ExtraTreesClassifierensemble.ExtraTreesRegressorensemble.GradientBoostingClassifierensemble.GradientBoostingRegressorensemble.HistGradientBoostingClassifierensemble.HistGradientBoostingRegressorensemble.IsolationForestensemble.RandomForestClassifierensemble.RandomForestRegressorensemble.StackingClassifierensemble.StackingRegressorensemble.VotingClassifierensemble.VotingRegressor
- Feature extraction:
- Feature selection:
feature_selection.GenericUnivariateSelect(only viasklearn2pmml.SelectorProxy)feature_selection.RFE(only viasklearn2pmml.SelectorProxy)feature_selection.RFECV(only viasklearn2pmml.SelectorProxy)feature_selection.SelectFdr(only viasklearn2pmml.SelectorProxy)feature_selection.SelectFpr(only viasklearn2pmml.SelectorProxy)feature_selection.SelectFromModel(either directly or viasklearn2pmml.SelectorProxy)feature_selection.SelectFwe(only viasklearn2pmml.SelectorProxy)feature_selection.SelectKBest(either directly or viasklearn2pmml.SelectorProxy)feature_selection.SelectPercentile(only viasklearn2pmml.SelectorProxy)feature_selection.VarianceThreshold(only viasklearn2pmml.SelectorProxy)
- Freezing:
- Impute:
- Isotonic regression:
- Kernel ridge regression:
- Generalized linear models:
linear_model.ARDRegressionlinear_model.BayesianRidgelinear_model.ElasticNetlinear_model.ElasticNetCVlinear_model.GammaRegressorlinear_model.HuberRegressorlinear_model.Larslinear_model.LarsCVlinear_model.Lassolinear_model.LassoCVlinear_model.LassoLarslinear_model.LassoLarsCVlinear_model.LinearRegressionlinear_model.LogisticRegressionlinear_model.LogisticRegressionCVlinear_model.OrthogonalMatchingPursuitlinear_model.OrthogonalMatchingPursuitCVlinear_model.Perceptronlinear_model.PoissonRegressorlinear_model.QuantileRegressorlinear_model.Ridgelinear_model.RidgeCVlinear_model.RidgeClassifierlinear_model.RidgeClassifierCVlinear_model.SGDClassifierlinear_model.SGDOneClassSVMlinear_model.SGDRegressorlinear_model.TheilSenRegressorlinear_model.TweedieRegressor
- Model selection:
- Post-fit Model tuning:
- Multiclass classification:
- Multioutput regression and classification:
- Naive Bayes:
- Nearest neighbors:
- Pipelines:
- Neural network models:
- Preprocessing and normalization:
preprocessing.Binarizerpreprocessing.FunctionTransformerpreprocessing.Imputerpreprocessing.KBinsDiscretizerpreprocessing.LabelBinarizerpreprocessing.LabelEncoderpreprocessing.MaxAbsScalerpreprocessing.MinMaxScalerpreprocessing.Normalizerpreprocessing.OneHotEncoderpreprocessing.OrdinalEncoderpreprocessing.PolynomialFeaturespreprocessing.PowerTransformerpreprocessing.QuantileTransformerpreprocessing.RobustScalerpreprocessing.SplineTransformerpreprocessing.StandardScalerpreprocessing.TargetEncoder
- Support vector machines:
- Decision trees:
Category Encoders
Examples: extensions/category_encoders.py and extensions/category_encoders-xgboost.py
Causal ML
Examples: extensions/causalml.py
causalml.inference.meta.BaseRClassifiercausalml.inference.meta.BaseRRegressorcausalml.inference.meta.BaseSClassifiercausalml.inference.meta.BaseSRegressorcausalml.inference.meta.BaseTClassifiercausalml.inference.meta.BaseTRegressorcausalml.inference.meta.BaseXClassifiercausalml.inference.meta.BaseXRegressorcausalml.inference.meta.XGBRRegressorcausalml.inference.meta.XGBTRegressorcausalml.propensity.ElasticNetPropensityModelcausalml.propensity.LogisticRegressionPropensityModel
FLAML
Examples: extensions/flaml.py
flaml.automl.contrib.histgb.HistGradientBoostingEstimatorflaml.automl.model.ElasticNetEstimatorflaml.automl.model.ExtraTreesEstimatorflaml.automl.model.LassoLarsEstimatorflaml.automl.model.LGBMEstimatorflaml.automl.model.LRL1Classifierflaml.automl.model.LRL2Classifierflaml.automl.model.RandomForestEstimatorflaml.automl.model.SGDEstimatorflaml.automl.model.SVCEstimatorflaml.automl.model.XGBoostLimitDepthEstimatorflaml.automl.model.XGBoostSklearnEstimator
H2O.ai
Examples: main-h2o.py
h2o.estimators.extended_isolation_forest.H2OExtendedIsolationForestEstimatorh2o.estimators.gbm.H2OGradientBoostingEstimatorh2o.estimators.glm.H2OGeneralizedLinearEstimatorh2o.estimators.isolation_forest.H2OIsolationForestEstimatorh2o.estimators.random_forest.H2ORandomForestEstimatorh2o.estimators.stackedensemble.H2OStackedEnsembleEstimatorh2o.estimators.xgboost.H2OXGBoostEstimator
Imbalanced-Learn
Examples: extensions/imblearn.py
- Under-sampling methods:
imblearn.under_sampling.AllKNNimblearn.under_sampling.ClusterCentroidsimblearn.under_sampling.CondensedNearestNeighbourimblearn.under_sampling.EditedNearestNeighboursimblearn.under_sampling.InstanceHardnessThresholdimblearn.under_sampling.NearMissimblearn.under_sampling.NeighbourhoodCleaningRuleimblearn.under_sampling.OneSidedSelectionimblearn.under_sampling.RandomUnderSamplerimblearn.under_sampling.RepeatedEditedNearestNeighboursimblearn.under_sampling.TomekLinks
- Over-sampling methods:
- Combination of over- and under-sampling methods:
- Ensemble methods:
- Pipeline:
InterpretML
Examples: extensions/interpret.py
LightGBM
Examples: main-lightgbm.py
NGBoost
Examples: extensions/ngboost.py
ngboost.NGBClassifierngboost.NGBRegressorngboost.NGBSurvival
OptBinning
Examples: extensions/optbinning.py
PyCaret
Examples: extensions/pycaret.py
pycaret.internal.pipeline.Pipelinepycaret.internal.preprocess.transformers.CleanColumnNamespycaret.internal.preprocess.transformers.FixImbalancerpycaret.internal.preprocess.transformers.RareCategoryGroupingpycaret.internal.preprocess.transformers.RemoveMulticollinearitypycaret.internal.preprocess.transformers.RemoveOutlierspycaret.internal.preprocess.transformers.TransformerWrapperpycaret.internal.preprocess.transformers.TransformerWrapperWithInverse
Scikit-Lego
Examples: extensions/sklego.py
sklego.meta.EstimatorTransformer- Predict functions
apply,decision_function,predictandpredict_proba.
- Predict functions
sklego.meta.OrdinalClassifiersklego.pipeline.DebugPipelinesklego.preprocessing.IdentityTransformer
SkLearn2PMML
Examples: main.py and extensions/sklearn2pmml.py
- Helpers:
sklearn2pmml.EstimatorProxysklearn2pmml.SelectorProxysklearn2pmml.h2o.H2OEstimatorProxy
- Feature cross-references:
sklearn2pmml.cross_reference.Memorizersklearn2pmml.cross_reference.Recaller
- Feature specification and decoration:
sklearn2pmml.decoration.Aliassklearn2pmml.decoration.CategoricalDomainsklearn2pmml.decoration.ContinuousDomainsklearn2pmml.decoration.ContinuousDomainErasersklearn2pmml.decoration.DateDomainsklearn2pmml.decoration.DateTimeDomainsklearn2pmml.decoration.DiscreteDomainErasersklearn2pmml.decoration.MultiAliassklearn2pmml.decoration.MultiDomainsklearn2pmml.decoration.OrdinalDomain
- Ensemble methods:
sklearn2pmml.ensemble.EstimatorChainsklearn2pmml.ensemble.GBDTLMRegressor- The GBDT side: All Scikit-Learn decision tree ensemble regressors,
LGBMRegressor,XGBRegressor,XGBRFRegressor. - The LM side: A Scikit-Learn linear regressor (eg.
ElasticNet,LinearRegression,SGDRegressor).
- The GBDT side: All Scikit-Learn decision tree ensemble regressors,
sklearn2pmml.ensemble.GBDTLRClassifier- The GBDT side: All Scikit-Learn decision tree ensemble classifiers,
LGBMClassifier,XGBClassifier,XGBRFClassifier. - The LR side: A Scikit-Learn binary linear classifier (eg.
LinearSVC,LogisticRegression,SGDClassifier).
- The GBDT side: All Scikit-Learn decision tree ensemble classifiers,
sklearn2pmml.ensemble.SelectFirstClassifiersklearn2pmml.ensemble.SelectFirstRegressor
- UDF models:
sklearn2pmml.expression.ExpressionClassifiersklearn2pmml.expression.ExpressionRegressor
- Feature selection:
sklearn2pmml.feature_selection.SelectUnique
- Linear models:
sklearn2pmml.statsmodels.StatsModelsClassifiersklearn2pmml.statsmodels.StatsModelsOrdinalClassifiersklearn2pmml.statsmodels.StatsModelsRegressor
- Neural networks:
sklearn2pmml.neural_network.MLPTransformer
- Pipeline:
sklearn2pmml.pipeline.PMMLPipeline
- Postprocessing:
sklearn2pmml.postprocessing.BusinessDecisionTransformersklearn2pmml.postprocessing.FeatureExporter
- Preprocessing:
sklearn2pmml.preprocessing.AggregateTransformersklearn2pmml.preprocessing.BSplineTransformersklearn2pmml.preprocessing.CastTransformersklearn2pmml.preprocessing.ConcatTransformersklearn2pmml.preprocessing.CutTransformersklearn2pmml.preprocessing.DataFrameConstructorsklearn2pmml.preprocessing.DateTimeFormattersklearn2pmml.preprocessing.DaysSinceYearTransformersklearn2pmml.preprocessing.ExpressionTransformer- Ternary conditional expression
<expression_true> if <condition> else <expression_false>. - Array indexing expressions
X[<column index>]andX[<column name>]. - String concatenation expressions.
- String slicing expressions
<str>[<start>:<stop>]. - Arithmetic operators
+,-,*,/,//and%. - The power operator
**. - Identity comparison operators
is Noneandis not None. - Comparison operators
in <list>,not in <list>,<=,<,==,!=,>and>=. - Logical operators
and,orandnot. - Built-in functions (too numerous to list).
- Built-in type cast functions
bool,float,intandstr. - Math constants
math.e,math.nan,math.piandmath.tau. - Math functions (too numerous to list).
- Numpy constants
numpy.e,numpy.NaN.numpy.NZERO,numpy.piandnumpy.PZERO. - Numpy function
numpy.where. - Numpy universal functions (too numerous to list).
- Pandas constants
pandas.NAandpandas.NaT. - Pandas functions
pandas.isna,pandas.isnull,pandas.notnaandpandas.notnull. - Scipy functions
scipy.special.expitandscipy.special.logit. - String functions
startswith(<prefix>),endswith(<suffix>),lower,upperandstrip. - String length function
len(<str>). - Perl Compatible Regular Expression (PCRE) functions
pcre.searchandpcre.sub. - Regular Expression (RE) functions
re.search, andre.sub. - User-defined functions.
- Ternary conditional expression
sklearn2pmml.preprocessing.FilterLookupTransformersklearn2pmml.preprocessing.IdentityTransformersklearn2pmml.preprocessing.LagTransformersklearn2pmml.preprocessing.LookupTransformersklearn2pmml.preprocessing.MatchesTransformersklearn2pmml.preprocessing.MultiCastTransformersklearn2pmml.preprocessing.MultiLookupTransformersklearn2pmml.preprocessing.NumberFormattersklearn2pmml.preprocessing.PMMLLabelBinarizersklearn2pmml.preprocessing.PMMLLabelEncodersklearn2pmml.preprocessing.PowerFunctionTransformersklearn2pmml.preprocessing.ReplaceTransformersklearn2pmml.preprocessing.RollingAggregateTransformersklearn2pmml.preprocessing.SecondsSinceMidnightTransformersklearn2pmml.preprocessing.SecondsSinceYearTransformersklearn2pmml.preprocessing.SelectFirstTransformersklearn2pmml.preprocessing.SeriesConstructorsklearn2pmml.preprocessing.StringLengthTransformersklearn2pmml.preprocessing.StringNormalizersklearn2pmml.preprocessing.SubstringTransformersklearn2pmml.preprocessing.WordCountTransformersklearn2pmml.preprocessing.h2o.H2OFrameConstructorsklearn2pmml.util.Reshapersklearn2pmml.util.Slicer
- Rule sets:
sklearn2pmml.ruleset.RuleSetClassifier
- Decision trees:
sklearn2pmml.tree.chaid.CHAIDClassifiersklearn2pmml.tree.chaid.CHAIDRegressor
StatsModels
Examples: main-statsmodels.py
Treeple (formerly Scikit-Tree)
Examples: extensions/treeple.py