`airflow.providers.apache.hdfs.sensors.web_hdfs`¶

Module Contents¶

Classes¶

`WebHdfsSensor`	Waits for a file or folder to land in HDFS.
`MultipleFilesWebHdfsSensor`	Waits for multiple files in a folder to land in HDFS.

class airflow.providers.apache.hdfs.sensors.web_hdfs.WebHdfsSensor(*, filepath, webhdfs_conn_id='webhdfs_default', **kwargs)[source]¶

Bases: airflow.sensors.base.BaseSensorOperator

Waits for a file or folder to land in HDFS.

template_fields: collections.abc.Sequence[str] = ('filepath',)[source]¶

poke(context)[source]¶

Override when deriving this class.

class airflow.providers.apache.hdfs.sensors.web_hdfs.MultipleFilesWebHdfsSensor(*, directory_path, expected_filenames, webhdfs_conn_id='webhdfs_default', **kwargs)[source]¶