Skip to main content
Version: 1.0 prerelease

InferredAssetDBFSDataConnector

class great_expectations.datasource.data_connector.InferredAssetDBFSDataConnector(name: str, datasource_name: str, base_directory: str, execution_engine: ExecutionEngine, default_regex: Optional[dict] = None, glob_directive: str = '*', sorters: Optional[list] = None, batch_spec_passthrough: Optional[dict] = None, id: Optional[str] = None)#

An Inferred Asset Data Connector used to connect to data on a DBFS filesystem.

Parameters:

  • name – The name of the Data Connector.

  • datasource_name – The name of this Data Connector’s Datasource.

  • base_directory – The directory from which the Data Connector should read files.

  • execution_engine – The Execution Engine object to used by this Data Connector to read the data.

  • default_regex – A regex configuration for filtering data references.

  • glob_directive – A glob pattern for selecting files in directory.

  • sorters – A list of sorters for sorting data references.

  • batch_spec_passthrough – Dictionary with keys that will be added directly to the batch spec.

  • id – The unique identifier for this Data Connector used when running in cloud mode.

get_available_data_asset_names()→ List[str]#

Return the list of asset names known by this DataConnector

Returns:

A list of available names