ConfiguredAssetFilesystemDataConnector
class great_expectations.datasource.data_connector.ConfiguredAssetFilesystemDataConnector(name: str, datasource_name: str, base_directory: str, assets: dict, execution_engine: Optional[ExecutionEngine] = None, default_regex: Optional[dict] = None, glob_directive: str = '**/*', sorters: Optional[list] = None, batch_spec_passthrough: Optional[dict] = None, id: Optional[str] = None)#
Extension of ConfiguredAssetFilePathDataConnector used to connect to Filesystem.
Being a Configured Asset Data Connector, it requires an explicit list of each Data Asset it can connect to. While this allows for fine-grained control over which Data Assets may be accessed, it requires more setup.
- Parameters:
name (str) – name of ConfiguredAssetFilesystemDataConnector
datasource_name (str) – Name of datasource that this DataConnector is connected to
assets (dict) – configured assets as a dictionary. These can each have their own regex and sorters
execution_engine (ExecutionEngine) – ExecutionEngine object to actually read the data
default_regex (dict) – Optional dict the filter and organize the data_references.
glob_directive (str) – glob for selecting files in directory (defaults to **/* ) or nested directories (e.g. //*.csv )
sorters (list) – Optional list if you want to sort the data_references
batch_spec_passthrough (dict) – dictionary with keys that will be added directly to batch_spec
- get_available_data_asset_names()List[str] #
Return the list of asset names known by this DataConnector.
- Returns:
A list of available names