climb.tool.impl.data_suite.third_party.uq360 package

Subpackages

• climb.tool.impl.data_suite.third_party.uq360.algorithms package
  • Subpackages
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.actively_learned_model package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.actively_learned_model.actively_learned_model module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.auxiliary_interval_predictor package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.auxiliary_interval_predictor.auxiliary_interval_predictor module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.blackbox_metamodel package
      • Subpackages
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.blackbox_metamodel.confidence_classification module
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.blackbox_metamodel.metamodel_classification module
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.blackbox_metamodel.metamodel_regression module
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.blackbox_metamodel.passthrough_classification module
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.blackbox_metamodel.short_text_classification module
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.blackbox_metamodel.structured_data_classification module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.classification_calibration package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.classification_calibration.classification_calibration module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.ensemble_heteroscedastic_regression package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.ensemble_heteroscedastic_regression.ensemble_heteroscedastic_regression module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.heteroscedastic_regression package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.heteroscedastic_regression.heteroscedastic_regression module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.homoscedastic_gaussian_process_regression package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.homoscedastic_gaussian_process_regression.homoscedastic_gaussian_process_regression module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.infinitesimal_jackknife package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.infinitesimal_jackknife.infinitesimal_jackknife module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.layer_scoring package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.layer_scoring.aklpe module
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.layer_scoring.knn module
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.layer_scoring.latent_scorer module
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.layer_scoring.mahalanobis module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.quantile_regression package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.quantile_regression.quantile_regression module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.ucc_recalibration package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.ucc_recalibration.ucc_recalibration module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.algorithms.variational_bayesian_neural_networks package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.algorithms.variational_bayesian_neural_networks.bnn module
      • Module contents
  • Submodules
  • climb.tool.impl.data_suite.third_party.uq360.algorithms.builtinuq module
    • BuiltinUQ
      • BuiltinUQ.fit()
      • BuiltinUQ.predict()
      • BuiltinUQ.set_params()
  • climb.tool.impl.data_suite.third_party.uq360.algorithms.posthocuq module
    • PostHocUQ
      • PostHocUQ.get_params()
      • PostHocUQ.predict()
      • PostHocUQ.set_params()
  • Module contents
• climb.tool.impl.data_suite.third_party.uq360.data package
  • Module contents
• climb.tool.impl.data_suite.third_party.uq360.datasets package
  • Submodules
  • climb.tool.impl.data_suite.third_party.uq360.datasets.atis_dataset module
    • AtisDataset
      • AtisDataset.data()
    • default_preprocessing()
  • climb.tool.impl.data_suite.third_party.uq360.datasets.banking_dataset module
    • BankMarketingDataset
      • BankMarketingDataset.data()
    • default_preprocessing()
  • climb.tool.impl.data_suite.third_party.uq360.datasets.meps_dataset module
    • MEPSDataset
      • MEPSDataset.data()
    • default_preprocessing()
  • Module contents
• climb.tool.impl.data_suite.third_party.uq360.metrics package
  • Subpackages
    • climb.tool.impl.data_suite.third_party.uq360.metrics.uncertainty_characteristics_curve package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.metrics.uncertainty_characteristics_curve.uncertainty_characteristics_curve module
      • Module contents
  • Submodules
  • climb.tool.impl.data_suite.third_party.uq360.metrics.classification_metrics module
    • area_under_risk_rejection_rate_curve()
    • compute_classification_metrics()
    • entropy_based_uncertainty_decomposition()
    • expected_calibration_error()
    • multiclass_brier_score()
    • plot_reliability_diagram()
    • plot_risk_vs_rejection_rate()
  • climb.tool.impl.data_suite.third_party.uq360.metrics.regression_metrics module
    • auucc_gain()
    • compute_regression_metrics()
    • mpiw()
    • negative_log_likelihood_Gaussian()
    • picp()
    • plot_picp_by_feature()
    • plot_uncertainty_by_feature()
    • plot_uncertainty_distribution()
  • Module contents
• climb.tool.impl.data_suite.third_party.uq360.models package
  • Subpackages
    • climb.tool.impl.data_suite.third_party.uq360.models.bayesian_neural_networks package
      • Subpackages
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.models.bayesian_neural_networks.layer_utils module
      • climb.tool.impl.data_suite.third_party.uq360.models.bayesian_neural_networks.layers module
      • climb.tool.impl.data_suite.third_party.uq360.models.bayesian_neural_networks.misc module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.models.noise_models package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.models.noise_models.heteroscedastic_noise_models module
      • climb.tool.impl.data_suite.third_party.uq360.models.noise_models.homoscedastic_noise_models module
      • climb.tool.impl.data_suite.third_party.uq360.models.noise_models.noisemodel module
      • Module contents
  • Submodules
  • climb.tool.impl.data_suite.third_party.uq360.models.heteroscedastic_mlp module
    • GaussianNoiseMLPNet
      • GaussianNoiseMLPNet.forward()
      • GaussianNoiseMLPNet.loss()
  • Module contents
• climb.tool.impl.data_suite.third_party.uq360.savedmodels package
  • Module contents
• climb.tool.impl.data_suite.third_party.uq360.utils package
  • Subpackages
    • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.batch_basic_pointwise_hist module
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.batch_feature module
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.batch_projection module
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.batch_shadow_models module
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.blackbox_feature module
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.clustering_feature module
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.drift_classifier module
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.feature_extractor module
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.histogram_feature module
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.histogram_utilities module
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.num_important module
      • climb.tool.impl.data_suite.third_party.uq360.utils.batch_features.significance_feature module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.utils.calibrators package
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.utils.calibrators.calibrator module
      • climb.tool.impl.data_suite.third_party.uq360.utils.calibrators.confidence_binning module
      • climb.tool.impl.data_suite.third_party.uq360.utils.calibrators.isotonic_regression module
      • climb.tool.impl.data_suite.third_party.uq360.utils.calibrators.linear_extrapolation module
      • climb.tool.impl.data_suite.third_party.uq360.utils.calibrators.shift_calibrator module
      • Module contents
    • climb.tool.impl.data_suite.third_party.uq360.utils.transformers package
      • Subpackages
      • Submodules
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.class_accuracy module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.class_frequency module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.cluster_feature module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.confidence_delta module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.confidence_entropy module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.confidence_min_max module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.confidence_std module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.confidence_top module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.distribution_clustering module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.feature_transformer module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.gbm module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.group_scaler module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.logistic_regression module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.mlp module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.one_class_svm module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.original_features module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.pca module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.predicted_class module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.random_forest module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.svc module
      • climb.tool.impl.data_suite.third_party.uq360.utils.transformers.umap_kde module
      • Module contents
  • Submodules
  • climb.tool.impl.data_suite.third_party.uq360.utils.gbm_whitebox_features module
    • GBM_WhiteboxFeatureExtractor
      • GBM_WhiteboxFeatureExtractor.add_whitebox_feature()
      • GBM_WhiteboxFeatureExtractor.compute_decision_distance()
      • GBM_WhiteboxFeatureExtractor.compute_depth_sums()
      • GBM_WhiteboxFeatureExtractor.compute_gbm_internal_whitebox_features()
      • GBM_WhiteboxFeatureExtractor.compute_leaf_frequencies()
      • GBM_WhiteboxFeatureExtractor.compute_tree_depth_sums()
      • GBM_WhiteboxFeatureExtractor.count_nodes()
  • climb.tool.impl.data_suite.third_party.uq360.utils.generate_1D_regression_data module
    • make_data_gap()
    • make_data_sine()
  • climb.tool.impl.data_suite.third_party.uq360.utils.hidden_markov_model module
    • HMM
      • HMM.clear_trellis()
      • HMM.compute_hessian()
      • HMM.compute_jacobian()
      • HMM.fit()
      • HMM.get_indices_in_held_out_fold()
      • HMM.get_prior_contrib()
      • HMM.initialize_params()
      • HMM.log_obs_lik()
      • HMM.loss_at_missing_timesteps()
      • HMM.pack_params()
      • HMM.synthetic_hmm_data()
      • HMM.unpack_params()
      • HMM.weighted_alpha_recursion()
      • HMM.weighted_beta_recursion()
      • HMM.weighted_loss()
  • climb.tool.impl.data_suite.third_party.uq360.utils.hpo_search module
    • CustomRandomSearch
  • climb.tool.impl.data_suite.third_party.uq360.utils.latent_features module
    • LatentFeatures
      • LatentFeatures.extract()
  • climb.tool.impl.data_suite.third_party.uq360.utils.logistic_regression module
    • LogisticRegression
      • LogisticRegression.compute_hessian()
      • LogisticRegression.compute_jacobian()
      • LogisticRegression.fit()
      • LogisticRegression.get_test_acc()
      • LogisticRegression.loss()
      • LogisticRegression.predict()
      • LogisticRegression.set_parameters()
      • LogisticRegression.synthetic_lr_data()
    • get_num_train()
    • logistic_predictions()
    • sigmoid()
  • climb.tool.impl.data_suite.third_party.uq360.utils.misc module
    • DummySklearnEstimator
      • DummySklearnEstimator.fit()
      • DummySklearnEstimator.predict_proba()
    • fitted_ucc_w_nullref()
    • form_D_for_auucc()
    • generate_regression_data()
    • make_batches()
    • make_sklearn_compatible_scorer()
  • climb.tool.impl.data_suite.third_party.uq360.utils.optimizers module
    • adam()
  • climb.tool.impl.data_suite.third_party.uq360.utils.significance_test module
    • SignificanceTester
      • SignificanceTester.confidence_interval()
      • SignificanceTester.get_average()
      • SignificanceTester.get_cost()
      • SignificanceTester.get_metric_function()
      • SignificanceTester.hypothesis_test()
      • SignificanceTester.resample_compute()
  • climb.tool.impl.data_suite.third_party.uq360.utils.utils module
  • Module contents

Submodules

climb.tool.impl.data_suite.third_party.uq360.base module

class climb.tool.impl.data_suite.third_party.uq360.base.Base

Bases: object

Base class that represents a generic plugin with subtypes that are referenced by name and instantiated at runtime.

classmethod instance(discriminator: Any, **params) → PluginBase

classmethod name() → str | List[str]

Name of this subtype, used for lookup purposes. To be implemented by subclasses. This method can either return a single name, or a list/tuple of names.

classmethod try_instantiate(discriminator: Any, **params) → PluginBase | None

Return an instance of this subtype, if it is capable of handling the given discriminator, otherwise None. By default, this method assumes that “discriminator” is a subtype name, and returns an instance if the discriminator matches the name of this subtype (as returned by the name() method). This method can be overwritten by subclasses, in which case the discriminator can also be any other object based on which the subtype class can decide whether it is responsible for handling it.

climb.tool.impl.data_suite.third_party.uq360.base.is_list_or_tuple(obj)

Determine whether an object is an iterable list or tuple

Module contents