evidently.tests

Available tests for TestSuite reports. Tests grouped into modules. For detailed information see module documentation.

Submodules

base_test module

class BaseCheckValueTest(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseConditionsTest

Base class for all tests with checking a value condition

Attributes:

value : Union[float, int]

Methods:

abstract calculate_value_for_test()

Method for getting the checking value. Define it in a child class

check()

get_condition()

abstract get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

groups()

class BaseConditionsTest(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: Test, ABC

Base class for all tests with a condition

Attributes:

condition : TestValueCondition

class GroupData(id: str, title: str, description: str, sort_index: int = 0, severity: Optional[str] = None)

Bases: object

Attributes:

description : str

id : str

severity : Optional[str] = None

sort_index : int = 0

title : str

class GroupTypeData(id: str, title: str, values: List[evidently.tests.base_test.GroupData] = )

Bases: object

Attributes:

id : str

title : str

values : List[GroupData]

Methods:

add_value(data: GroupData)

class GroupingTypes()

Bases: object

Attributes:

ByClass = GroupTypeData(id='by_class', title='By class', values=[])

ByFeature = GroupTypeData(id='by_feature', title='By feature', values=[GroupData(id='no group', title='Dataset-level tests', description='Some tests cannot be grouped by feature', sort_index=0, severity=None)])

TestGroup = GroupTypeData(id='test_group', title='By test group', values=[GroupData(id='no group', title='Ungrouped', description='Some tests don’t belong to any group under the selected condition', sort_index=0, severity=None), GroupData(id='classification', title='Classification', description='', sort_index=0, severity=None), GroupData(id='data_drift', title='Data Drift', description='', sort_index=0, severity=None), GroupData(id='data_integrity', title='Data Integrity', description='', sort_index=0, severity=None), GroupData(id='data_quality', title='Data Quality', description='', sort_index=0, severity=None), GroupData(id='regression', title='Regression', description='', sort_index=0, severity=None)])

TestType = GroupTypeData(id='test_type', title='By test type', values=[])

class Test()

Bases: object

all fields in test class with type that is subclass of Metric would be used as dependencies of test.

Attributes:

context = None

group : str

name : str

Methods:

abstract check()

get_result()

set_context(context)

class TestResult(name: str, description: str, status: str, groups: Dict[str, str] = )

Bases: object

Attributes:

ERROR = 'ERROR'

FAIL = 'FAIL'

SKIPPED = 'SKIPPED'

SUCCESS = 'SUCCESS'

WARNING = 'WARNING'

description : str

groups : Dict[str, str]

name : str

status : str

Methods:

is_passed()

mark_as_error(description: Optional[str] = None)

mark_as_fail(description: Optional[str] = None)

mark_as_success(description: Optional[str] = None)

mark_as_warning(description: Optional[str] = None)

set_status(status: str, description: Optional[str] = None)

class TestValueCondition(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: object

Class for processing a value conditions - should it be less, greater than, equals and so on.

An object of the class stores specified conditions and can be used for checking a value by them.

Attributes:

eq : Optional[Union[float, int]] = None

gt : Optional[Union[float, int]] = None

gte : Optional[Union[float, int]] = None

is_in : Optional[List[Union[float, int, str, bool]]] = None

lt : Optional[Union[float, int]] = None

lte : Optional[Union[float, int]] = None

not_eq : Optional[Union[float, int]] = None

not_in : Optional[List[Union[float, int, str, bool]]] = None

Methods:

as_dict()

check_value(value: Union[float, int])

has_condition()

Checks if we have a condition in the object and returns True in this case. If we have no conditions - returns False.

generate_column_tests(test_class: Type[Test], columns: Optional[Union[str, list]] = None, parameters: Optional[Dict] = None)

Function for generating tests for columns

classification_performance_tests module

class ByClassClassificationTest(label: str, probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest, ABC

Attributes:

group : str = 'classification'

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

abstract get_value(result: dict)

class SimpleClassificationTest(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest

Attributes:

group : str = 'classification'

name : str

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

class SimpleClassificationTestTopK(probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: SimpleClassificationTest, ABC

Attributes:

k : Optional[Union[float, int]]

probas_threshold : Optional[float]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

class TestAccuracyScore(probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: SimpleClassificationTestTopK

Attributes:

condition : TestValueCondition

k : Optional[Union[float, int]]

name : str = 'Accuracy Score'

probas_threshold : Optional[float]

value : Union[float, int]

Methods:

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestAccuracyScore)

render_json(obj: TestAccuracyScore)

class TestF1ByClass(label: str, probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: ByClassClassificationTest

Attributes:

name : str = 'F1 Score by Class'

Methods:

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

get_value(result: dict)

Attributes:

Methods:

render_html(obj: TestF1ByClass)

render_json(obj: TestF1ByClass)

class TestF1Score(probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: SimpleClassificationTestTopK

Attributes:

condition : TestValueCondition

k : Optional[Union[float, int]]

name : str = 'F1 Score'

probas_threshold : Optional[float]

value : Union[float, int]

Methods:

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestF1Score)

render_json(obj: TestF1Score)

class TestFNR(probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: SimpleClassificationTestTopK

Attributes:

condition : TestValueCondition

k : Optional[Union[float, int]]

name : str = 'False Negative Rate'

probas_threshold : Optional[float]

value : Union[float, int]

Methods:

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestF1Score)

render_json(obj: TestFNR)

class TestFPR(probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: SimpleClassificationTestTopK

Attributes:

condition : TestValueCondition

k : Optional[Union[float, int]]

name : str = 'False Positive Rate'

probas_threshold : Optional[float]

value : Union[float, int]

Methods:

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestF1Score)

render_json(obj: TestFPR)

class TestLogLoss(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: SimpleClassificationTest

Attributes:

condition : TestValueCondition

name : str = 'Logarithmic Loss'

value : Union[float, int]

Methods:

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestLogLoss)

render_json(obj: TestLogLoss)

class TestPrecisionByClass(label: str, probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: ByClassClassificationTest

Attributes:

name : str = 'Precision Score by Class'

Methods:

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

get_value(result: dict)

Attributes:

Methods:

render_html(obj: TestPrecisionByClass)

render_json(obj: TestPrecisionByClass)

class TestPrecisionScore(probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: SimpleClassificationTestTopK

Attributes:

condition : TestValueCondition

k : Optional[Union[float, int]]

name : str = 'Precision Score'

probas_threshold : Optional[float]

value : Union[float, int]

Methods:

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestPrecisionScore)

render_json(obj: TestPrecisionScore)

class TestRecallByClass(label: str, probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: ByClassClassificationTest

Attributes:

name : str = 'Recall Score by Class'

Methods:

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

get_value(result: dict)

Attributes:

Methods:

render_html(obj: TestRecallByClass)

render_json(obj: TestRecallByClass)

class TestRecallScore(probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: SimpleClassificationTestTopK

Attributes:

condition : TestValueCondition

k : Optional[Union[float, int]]

name : str = 'Recall Score'

probas_threshold : Optional[float]

value : Union[float, int]

Methods:

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestRecallScore)

render_json(obj: TestRecallScore)

class TestRocAuc(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: SimpleClassificationTest

Attributes:

name : str = 'ROC AUC Score'

Methods:

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestRocAuc)

render_json(obj: TestRocAuc)

class TestTNR(probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: SimpleClassificationTestTopK

Attributes:

condition : TestValueCondition

k : Optional[Union[float, int]]

name : str = 'True Negative Rate'

probas_threshold : Optional[float]

value : Union[float, int]

Methods:

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestF1Score)

render_json(obj: TestTNR)

class TestTPR(probas_threshold: Optional[float] = None, k: Optional[Union[float, int]] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: SimpleClassificationTestTopK

Attributes:

condition : TestValueCondition

k : Optional[Union[float, int]]

name : str = 'True Positive Rate'

probas_threshold : Optional[float]

value : Union[float, int]

Methods:

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestF1Score)

render_json(obj: TestTPR)

data_drift_tests module

Bases: BaseCheckValueTest, ABC

Attributes:

group : str = 'data_drift'

Methods:

check()

Create value drift tests for numeric and category features

Attributes:

cat_stattest_threshold : Optional[float]

columns : Optional[List[str]]

num_stattest_threshold : Optional[float]

per_column_stattest_threshold : Optional[Dict[str, float]]

stattest_threshold : Optional[float]

Methods:

Bases: Test

Attributes:

column_name : str

group : str = 'data_drift'

name : str = 'Drift per Column'

Methods:

check()

Attributes:

Methods:

render_html(obj: TestColumnDrift)

render_json(obj: TestColumnDrift)

Create value drift tests for specified features

Attributes:

cat_stattest_threshold : Optional[float] = None

features : List[str]

num_stattest_threshold : Optional[float] = None

per_column_stattest_threshold : Optional[Dict[str, float]] = None

stattest_threshold : Optional[float] = None

Methods:

class TestDataDriftResult(name: str, description: str, status: str, groups: Dict[str, str] = , features: Dict[str, Tuple[str, float, float]] = )

Bases: TestResult

Attributes:

features : Dict[str, Tuple[str, float, float]]

Bases: BaseDataDriftMetricsTest

Attributes:

condition : TestValueCondition

name : str = 'Number of Drifted Features'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestNumberOfDriftedColumns)

render_json(obj: TestNumberOfDriftedColumns)

Bases: BaseDataDriftMetricsTest

Attributes:

condition : TestValueCondition

name : str = 'Share of Drifted Columns'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestShareOfDriftedColumns)

render_json(obj: TestShareOfDriftedColumns)

data_integrity_tests module

class BaseIntegrityByColumnsConditionTest(column_name: str, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest, ABC

Attributes:

column_name : str

group : str = 'data_integrity'

Methods:

groups()

class BaseIntegrityColumnMissingValuesTest(column_name: str, missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest, ABC

Attributes:

column_name : str

group : str = 'data_integrity'

class BaseIntegrityMissingValuesValuesTest(missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest, ABC

Attributes:

group : str = 'data_integrity'

class BaseIntegrityOneColumnTest(column_name: str)

Bases: Test, ABC

Attributes:

column_name : str

group : str = 'data_integrity'

Methods:

groups()

class BaseIntegrityValueTest(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest, ABC

Attributes:

group : str = 'data_integrity'

Common class for tests of missing values. Some tests have the same details visualizations.

Attributes:

MISSING_VALUES_NAMING_MAPPING = {None: 'Pandas nulls (None, NAN, etc.)', '': '"" (empty string)', inf: 'Numpy "inf" value', -inf: 'Numpy "-inf" value'}

Methods:

Get a table with missing values number and percents

class TestAllColumnsShareOfMissingValues(columns: Optional[List[str]] = None)

Attributes:

columns : Optional[List[str]]

Methods:

class TestColumnAllConstantValues(column_name: str)

Bases: BaseIntegrityOneColumnTest

Test that there is only one unique value in a column

Attributes:

name : str = 'All Constant Values in a Column'

Methods:

check()

Attributes:

Methods:

render_html(obj: TestColumnAllConstantValues)

class TestColumnAllUniqueValues(column_name: str)

Bases: BaseIntegrityOneColumnTest

Test that there is only uniques values in a column

Attributes:

column_name : str

name : str = 'All Unique Values in a Column'

Methods:

check()

Attributes:

Methods:

render_html(obj: TestColumnAllUniqueValues)

class TestColumnNumberOfDifferentMissingValues(column_name: str, missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityColumnMissingValuesTest

Check a number of differently encoded missing values in one column.

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'Different Types of Missing Values in a Column'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Bases: BaseTestMissingValuesRenderer

Attributes:

Methods:

render_html(obj: TestColumnNumberOfDifferentMissingValues)

Get a table with a missing value and number of the value in the dataset

render_json(obj: TestColumnNumberOfDifferentMissingValues)

class TestColumnNumberOfMissingValues(column_name: str, missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityColumnMissingValuesTest

Check a number of missing values in one column.

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'The Number of Missing Values in a Column'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Bases: BaseTestMissingValuesRenderer

Attributes:

Methods:

render_json(obj: TestColumnNumberOfMissingValues)

class TestColumnRegExp(column_name: str, reg_exp: str, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest, ABC

Attributes:

column_name : str

group : str = 'data_integrity'

name : str = 'RegExp Match'

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

groups()

Attributes:

Methods:

render_html(obj: TestColumnRegExp)

class TestColumnShareOfMissingValues(column_name: str, missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityColumnMissingValuesTest

Check a share of missing values in one column.

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'The Share of Missing Values in a Column'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Bases: BaseTestMissingValuesRenderer

Attributes:

Methods:

render_json(obj: TestColumnShareOfMissingValues)

class TestColumnsType(columns_type: Optional[dict] = None)

Bases: Test

This test compares columns type against the specified ones or a reference dataframe

class Result name: str, description: str, status: str, groups: Dict[str, str] = , columns_types: Dict[str, Tuple[str, str]] =

Bases: TestResult

Attributes:

columns_types : Dict[str, Tuple[str, str]]

check()

columns_type : Optional[dict]

group : str = 'data_integrity'

name : str = 'Column Types'

Attributes:

Methods:

render_html(obj: TestColumnsType)

render_json(obj: TestColumnsType)

class TestNumberOfColumns(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityValueTest

Number of all columns in the data, including utility columns (id/index, datetime, target, predictions)

Attributes:

condition : TestValueCondition

name : str = 'Number of Columns'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestNumberOfColumns)

render_json(obj: TestNumberOfColumns)

class TestNumberOfColumnsWithMissingValues(missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityMissingValuesValuesTest

Check a number of columns with a missing value.

Attributes:

condition : TestValueCondition

name : str = 'The Number of Columns With Missing Values'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Bases: BaseTestMissingValuesRenderer

Attributes:

Methods:

render_html(obj: TestNumberOfMissingValues)

render_json(obj: TestNumberOfColumnsWithMissingValues)

class TestNumberOfConstantColumns(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityValueTest

Number of columns contained only one unique value

Attributes:

condition : TestValueCondition

name : str = 'Number of Constant Columns'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestNumberOfConstantColumns)

render_json(obj: TestNumberOfConstantColumns)

class TestNumberOfDifferentMissingValues(missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityMissingValuesValuesTest

Check a number of different encoded missing values.

Attributes:

condition : TestValueCondition

name : str = 'Different Types of Missing Values'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Bases: BaseTestMissingValuesRenderer

Attributes:

Methods:

render_html(obj: TestNumberOfDifferentMissingValues)

Get a table with a missing value and number of the value in the dataset

render_json(obj: TestNumberOfDifferentMissingValues)

class TestNumberOfDuplicatedColumns(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityValueTest

How many columns have duplicates in the dataset

Attributes:

condition : TestValueCondition

name : str = 'Number of Duplicate Columns'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_json(obj: TestNumberOfDuplicatedColumns)

class TestNumberOfDuplicatedRows(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityValueTest

How many rows have duplicates in the dataset

Attributes:

condition : TestValueCondition

name : str = 'Number of Duplicate Rows'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_json(obj: TestNumberOfDuplicatedRows)

class TestNumberOfEmptyColumns(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityValueTest

Number of columns contained all NAN values

Attributes:

condition : TestValueCondition

name : str = 'Number of Empty Columns'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestNumberOfEmptyColumns)

class TestNumberOfEmptyRows(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityValueTest

Number of rows contained all NAN values

Attributes:

condition : TestValueCondition

name : str = 'Number of Empty Rows'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

class TestNumberOfMissingValues(missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityMissingValuesValuesTest

Check a number of missing values.

Attributes:

condition : TestValueCondition

name : str = 'The Number of Missing Values'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Bases: BaseTestMissingValuesRenderer

Attributes:

Methods:

render_html(obj: TestNumberOfMissingValues)

render_json(obj: TestNumberOfMissingValues)

class TestNumberOfRows(eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityValueTest

Number of rows in the data

Attributes:

condition : TestValueCondition

name : str = 'Number of Rows'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_json(obj: TestNumberOfRows)

class TestNumberOfRowsWithMissingValues(missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityMissingValuesValuesTest

Check a number of rows with a missing value.

Attributes:

condition : TestValueCondition

name : str = 'The Number Of Rows With Missing Values'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Bases: BaseTestMissingValuesRenderer

Attributes:

Methods:

render_json(obj: TestNumberOfRowsWithMissingValues)

class TestShareOfColumnsWithMissingValues(missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityMissingValuesValuesTest

Check a share of columns with a missing value.

Attributes:

condition : TestValueCondition

name : str = 'The Share of Columns With Missing Values'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Bases: BaseTestMissingValuesRenderer

Attributes:

Methods:

render_html(obj: TestNumberOfMissingValues)

render_json(obj: TestShareOfColumnsWithMissingValues)

class TestShareOfMissingValues(missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityMissingValuesValuesTest

Check a share of missing values.

Attributes:

condition : TestValueCondition

name : str = 'Share of Missing Values'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Bases: BaseTestMissingValuesRenderer

Attributes:

Methods:

render_html(obj: TestNumberOfMissingValues)

render_json(obj: TestShareOfMissingValues)

class TestShareOfRowsWithMissingValues(missing_values: Optional[list] = None, replace: bool = True, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseIntegrityMissingValuesValuesTest

Check a share of rows with a missing value.

Attributes:

condition : TestValueCondition

name : str = 'The Share of Rows With Missing Values'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Bases: BaseTestMissingValuesRenderer

Attributes:

Methods:

render_json(obj: TestShareOfRowsWithMissingValues)

data_quality_tests module

class BaseDataQualityCorrelationsMetricsValueTest(method: str = 'pearson', eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest, ABC

Attributes:

group : str = 'data_quality'

method : str

class BaseDataQualityMetricsValueTest(column_name: str, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest, ABC

Attributes:

group : str = 'data_quality'

class BaseDataQualityValueListMetricsTest(column_name: str, values: Optional[list] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest, ABC

Attributes:

column_name : str

group : str = 'data_quality'

values : Optional[list]

Methods:

groups()

class BaseDataQualityValueRangeMetricsTest(column_name: str, left: Optional[float] = None, right: Optional[float] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest, ABC

Attributes:

column : str

group : str = 'data_quality'

left : Optional[float]

right : Optional[float]

Methods:

groups()

class BaseFeatureDataQualityMetricsTest(column_name: str, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseDataQualityMetricsValueTest, ABC

Attributes:

column_name : str

Methods:

check()

groups()

class TestAllColumnsMostCommonValueShare(columns: Optional[List[str]] = None)

Creates most common value share tests for each column in the dataset

Attributes:

columns : Optional[List[str]]

Methods:

class TestCatColumnsOutOfListValues(columns: Optional[List[str]] = None)

Create share of out of list values tests for category columns

Attributes:

columns : Optional[List[str]]

Methods:

class TestColumnQuantile(column_name: str, quantile: float, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseCheckValueTest

Attributes:

column_name : str

group : str = 'data_quality'

name : str = 'Quantile Value'

quantile : float

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

groups()

Attributes:

Methods:

render_html(obj: TestColumnQuantile)

class TestColumnValueMax(column_name: str, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseFeatureDataQualityMetricsTest

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'Max Value'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestColumnValueMax)

class TestColumnValueMean(column_name: str, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseFeatureDataQualityMetricsTest

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'Mean Value'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestColumnValueMean)

class TestColumnValueMedian(column_name: str, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseFeatureDataQualityMetricsTest

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'Median Value'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestColumnValueMedian)

class TestColumnValueMin(column_name: str, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseFeatureDataQualityMetricsTest

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'Min Value'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestColumnValueMin)

class TestColumnValueStd(column_name: str, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseFeatureDataQualityMetricsTest

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'Standard Deviation (SD)'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestColumnValueStd)

class TestConflictPrediction()

Bases: Test

Attributes:

group : str = 'data_quality'

metric : ConflictPredictionMetric

name : str = 'Test number of conflicts in prediction'

Methods:

check()

class TestConflictTarget()

Bases: Test

Attributes:

group : str = 'data_quality'

metric : ConflictTargetMetric

name : str = 'Test number of conflicts in target'

Methods:

check()

class TestCorrelationChanges(corr_diff: float = 0.25, method: str = 'pearson', eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseDataQualityCorrelationsMetricsValueTest

Attributes:

corr_diff : float

group : str = 'data_quality'

name : str = 'Change in Correlation'

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestCorrelationChanges)

class TestHighlyCorrelatedColumns(method: str = 'pearson', eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseDataQualityCorrelationsMetricsValueTest

Attributes:

condition : TestValueCondition

method : str

name : str = 'Highly Correlated Columns'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestHighlyCorrelatedColumns)

render_json(obj: TestHighlyCorrelatedColumns)

class TestMeanInNSigmas(column_name: str, n_sigmas: int = 2)

Bases: Test

Attributes:

column_name : str

group : str = 'data_quality'

n_sigmas : int

name : str = 'Mean Value Stability'

Methods:

check()

Attributes:

Methods:

render_html(obj: TestMeanInNSigmas)

render_json(obj: TestMeanInNSigmas)

class TestMostCommonValueShare(column_name: str, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseFeatureDataQualityMetricsTest

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'Share of the Most Common Value'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestMostCommonValueShare)

render_json(obj: TestMostCommonValueShare)

class TestNumColumnsMeanInNSigmas(columns: Optional[List[str]] = None)

Create tests of mean for all numeric columns

Attributes:

columns : Optional[List[str]]

Methods:

class TestNumColumnsOutOfRangeValues(columns: Optional[List[str]] = None)

Creates share of out of range values tests for all numeric columns

Attributes:

columns : Optional[List[str]]

Methods:

class TestNumberOfOutListValues(column_name: str, values: Optional[list] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseDataQualityValueListMetricsTest

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'Number Out-of-List Values'

value : Union[float, int]

values : Optional[list]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestNumberOfOutListValues)

class TestNumberOfOutRangeValues(column_name: str, left: Optional[float] = None, right: Optional[float] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseDataQualityValueRangeMetricsTest

Attributes:

column : str

condition : TestValueCondition

left : Optional[float]

name : str = 'Number of Out-of-Range Values '

right : Optional[float]

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestNumberOfOutRangeValues)

class TestNumberOfUniqueValues(column_name: str, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseFeatureDataQualityMetricsTest

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'Number of Unique Values'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestNumberOfUniqueValues)

class TestPredictionFeaturesCorrelations(method: str = 'pearson', eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseDataQualityCorrelationsMetricsValueTest

Attributes:

condition : TestValueCondition

method : str

name : str = 'Correlation between Prediction and Features'

value : Union[float, int]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestTargetFeaturesCorrelations)

render_json(obj: TestPredictionFeaturesCorrelations)

class TestShareOfOutListValues(column_name: str, values: Optional[list] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseDataQualityValueListMetricsTest

Attributes:

column_name : str

condition : TestValueCondition

name : str = 'Share of Out-of-List Values'

value : Union[float, int]

values : Optional[list]

Methods:

calculate_value_for_test()

Method for getting the checking value. Define it in a child class

get_condition()

get_description(value: Union[float, int])

Method for getting a description that we can use. The description can use the checked value. Define it in a child class

Attributes:

Methods:

render_html(obj: TestShareOfOutListValues)

render_json(obj: TestShareOfOutListValues)

class TestShareOfOutRangeValues(column_name: str, left: Optional[float] = None, right: Optional[float] = None, eq: Optional[Union[float, int]] = None, gt: Optional[Union[float, int]] = None, gte: Optional[Union[float, int]] = None, is_in: Optional[List[Union[float, int, str, bool]]] = None, lt: Optional[Union[float, int]] = None, lte: Optional[Union[float, int]] = None, not_eq: Optional[Union[float, int]] = None, not_in: Optional[List[Union[float, int, str, bool]]] = None)

Bases: BaseDataQualityValueRangeMetricsTest