tests.system.amazon.aws.example_comprehend_document_classifier

Module Contents

Functions

document_classifier_workflow()

copy_data_to_s3(bucket, sources, prefix[, ...])

Copy some sample data to S3 using HttpToS3Operator.

Attributes

ROLE_ARN_KEY

sys_test_context_task

DAG_ID

ANNOTATION_BUCKET_KEY

TRAINING_DATA_PREFIX

PUBLIC_DATA_SOURCES

ANNOTATIONS

test_context

test_run

tests.system.amazon.aws.example_comprehend_document_classifier.ROLE_ARN_KEY = 'ROLE_ARN'[source]
tests.system.amazon.aws.example_comprehend_document_classifier.sys_test_context_task[source]
tests.system.amazon.aws.example_comprehend_document_classifier.DAG_ID = 'example_comprehend_document_classifier'[source]
tests.system.amazon.aws.example_comprehend_document_classifier.ANNOTATION_BUCKET_KEY = 'training-labels/label.csv'[source]
tests.system.amazon.aws.example_comprehend_document_classifier.TRAINING_DATA_PREFIX = 'training-docs'[source]
tests.system.amazon.aws.example_comprehend_document_classifier.PUBLIC_DATA_SOURCES[source]
tests.system.amazon.aws.example_comprehend_document_classifier.ANNOTATIONS = Multiline-String[source]
Show Value
"""DISCHARGE_SUMMARY,discharge-summary-0.pdf,1
DISCHARGE_SUMMARY,discharge-summary-1.pdf,1
DISCHARGE_SUMMARY,discharge-summary-2.pdf,1
DISCHARGE_SUMMARY,discharge-summary-3.pdf,1
DISCHARGE_SUMMARY,discharge-summary-4.pdf,1
DISCHARGE_SUMMARY,discharge-summary-5.pdf,1
DISCHARGE_SUMMARY,discharge-summary-6.pdf,1
DISCHARGE_SUMMARY,discharge-summary-7.pdf,1
DISCHARGE_SUMMARY,discharge-summary-8.pdf,1
DISCHARGE_SUMMARY,discharge-summary-9.pdf,1
DOCTOR_NOTES,doctors-notes-0.pdf,1
DOCTOR_NOTES,doctors-notes-1.pdf,1
DOCTOR_NOTES,doctors-notes-2.pdf,1
DOCTOR_NOTES,doctors-notes-3.pdf,1
DOCTOR_NOTES,doctors-notes-4.pdf,1
DOCTOR_NOTES,doctors-notes-5.pdf,1
DOCTOR_NOTES,doctors-notes-6.pdf,1
DOCTOR_NOTES,doctors-notes-7.pdf,1
DOCTOR_NOTES,doctors-notes-8.pdf,1
DOCTOR_NOTES,doctors-notes-9.pdf,1"""
tests.system.amazon.aws.example_comprehend_document_classifier.document_classifier_workflow()[source]
tests.system.amazon.aws.example_comprehend_document_classifier.copy_data_to_s3(bucket, sources, prefix, number_of_copies=1)[source]

Copy some sample data to S3 using HttpToS3Operator.

Parameters

  • bucket (str) – Name of the Amazon S3 bucket to send the data.

  • prefix (str) – Folder to store the files

  • number_of_copies – Number of files to create for a document from the sources

  • sources (list[dict]) – Public available data locations

tests.system.amazon.aws.example_comprehend_document_classifier.test_context[source]
tests.system.amazon.aws.example_comprehend_document_classifier.test_run[source]

Was this entry helpful?