Skip to main content
Version: 1.0 prerelease

Manage Expectations

An Expectation is a verifiable assertion about your data. They make implicit assumptions about your data explicit, and they provide a flexible, declarative language for describing expected behavior. They can help you better understand your data and help you improve data quality. An Expectation Suite contains multiple Expectations.

Prerequisites

Available Expectations

The following table lists the available GX Cloud Expectations.

ExpectationDescription
expect_column_max_to_be_betweenExpect the column maximum to be between a minimum and a maximum value.
expect_column_mean_to_be_betweenExpect the column mean to be between a minimum and a maximum value (inclusive).
expect_column_median_to_be_betweenExpect the column median to be between a minimum and a maximum value.
expect_column_min_to_be_betweenExpect the column minimum to be between a minimum value and a maximum value.
expect_column_values_to_be_in_setExpect each column value to be in a given set.
expect_column_values_to_be_in_type_listExpect a column to contain values from a specified type list.
expect_column_values_to_be_nullExpect the column values to be null.
expect_column_values_to_be_of_typeExpect a column to contain values of a specified data type.
expect_column_values_to_be_uniqueExpect each column value to be unique.
expect_column_values_to_not_be_nullExpect the column values to not be null.
expect_table_columns_to_match_ordered_listExpect the columns to exactly match a specified list.
expect_table_row_count_to_be_betweenExpect the number of rows to be between two values.
expect_table_row_count_to_equalExpect the number of rows to equal a value.

Add an Expectation

  1. In GX Cloud, click Data Assets.

  2. In the Data Assets list, click the Data Asset name.

  3. Click the Expectations tab.

  4. Click New Expectation.

  5. Select an Expectation type. See Available Expectation types.

    If you prefer to work in a code editor, or you want to configure an Expectation from the Expectations Gallery that isn't listed, click the JSON Editor tab and define your Expectation parameters in the code pane.

  6. Complete the fields in the Create Expectation pane.

  7. Click Save.

  8. Optional. Repeat steps 1 to 4 to add additional Expectations.

  9. Optional. Run a Validation. See Run a Validation.

Edit an Expectation

  1. In GX Cloud, click Data Assets.

  2. In the Data Assets list, click the Data Asset name.

  3. Click the Expectations tab.

  4. Click Edit Expectations for the Expectation that you want to edit.

  5. Edit the Expectation configuration.

    If you prefer to work in a code editor, or you configured an Expectation from the Expectations Gallery, click the JSON Editor tab and edit the Expectation parameters in the code pane.

  6. Click Save.

View Expectation history

View the Expectation history to determine when an Expectation was changed and who made the change.

  1. In GX Cloud, click Expectation Suites.

  2. In the Expectation Suites list, click the Expectation Suite name.

  3. Click the Change Log tab.

  4. Optional. Select an Expectation in the Columns pane to view the change history for a specific Expectation.

    The date, time, and email address of the users who created, edited, or deleted the Expectation appears below the Expectation name. Strikethrough text indicates an Expectation was deleted.

Delete an Expectation

  1. In GX Cloud, click Data Assets.

  2. In the Data Assets list, click the Data Asset name.

  3. Click the Expectations tab.

  4. Click Delete Expectation for the Expectation you want to delete.

  5. Click Yes, delete Expectation.