Manage Expectations
An Expectation is a verifiable assertion about your data. They make implicit assumptions about your data explicit, and they provide a flexible, declarative language for describing expected behavior. They can help you better understand your data and help you improve data quality. An Expectation Suite contains multiple Expectations.
Prerequisites
-
You have deployed the GX Agent. See Deploy the GX Agent.
-
You have a Data Asset.
Available Expectations
The following table lists the available GX Cloud Expectations.
Expectation | Description |
---|---|
expect_column_max_to_be_between | Expect the column maximum to be between a minimum and a maximum value. |
expect_column_mean_to_be_between | Expect the column mean to be between a minimum and a maximum value (inclusive). |
expect_column_median_to_be_between | Expect the column median to be between a minimum and a maximum value. |
expect_column_min_to_be_between | Expect the column minimum to be between a minimum value and a maximum value. |
expect_column_values_to_be_in_set | Expect each column value to be in a given set. |
expect_column_values_to_be_in_type_list | Expect a column to contain values from a specified type list. |
expect_column_values_to_be_null | Expect the column values to be null. |
expect_column_values_to_be_of_type | Expect a column to contain values of a specified data type. |
expect_column_values_to_be_unique | Expect each column value to be unique. |
expect_column_values_to_not_be_null | Expect the column values to not be null. |
expect_table_columns_to_match_ordered_list | Expect the columns to exactly match a specified list. |
expect_table_row_count_to_be_between | Expect the number of rows to be between two values. |
expect_table_row_count_to_equal | Expect the number of rows to equal a value. |
Add an Expectation
-
In GX Cloud, click Data Assets.
-
In the Data Assets list, click the Data Asset name.
-
Click the Expectations tab.
-
Click New Expectation.
-
Select an Expectation type. See Available Expectation types.
If you prefer to work in a code editor, or you want to configure an Expectation from the Expectations Gallery that isn't listed, click the JSON Editor tab and define your Expectation parameters in the code pane.
-
Complete the fields in the Create Expectation pane.
-
Click Save.
-
Optional. Repeat steps 1 to 4 to add additional Expectations.
-
Optional. Run a Validation. See Run a Validation.
Edit an Expectation
-
In GX Cloud, click Data Assets.
-
In the Data Assets list, click the Data Asset name.
-
Click the Expectations tab.
-
Click Edit Expectations for the Expectation that you want to edit.
-
Edit the Expectation configuration.
If you prefer to work in a code editor, or you configured an Expectation from the Expectations Gallery, click the JSON Editor tab and edit the Expectation parameters in the code pane.
-
Click Save.
View Expectation history
View the Expectation history to determine when an Expectation was changed and who made the change.
-
In GX Cloud, click Expectation Suites.
-
In the Expectation Suites list, click the Expectation Suite name.
-
Click the Change Log tab.
-
Optional. Select an Expectation in the Columns pane to view the change history for a specific Expectation.
The date, time, and email address of the users who created, edited, or deleted the Expectation appears below the Expectation name. Strikethrough text indicates an Expectation was deleted.
Delete an Expectation
-
In GX Cloud, click Data Assets.
-
In the Data Assets list, click the Data Asset name.
-
Click the Expectations tab.
-
Click Delete Expectation for the Expectation you want to delete.
-
Click Yes, delete Expectation.