(node:17808) ExperimentalWarning: The fs.promises API is experimental
python: can't open file 'deployment_glue_datajob.py': [Errno 2] No such file or directory
Subprocess exited with error 2
DVCL643@10NB03610:~/workspace/python/aws_best_practices$ cd glue
DVCL643@10NB03610:~/workspace/python/aws_best_practices/glue$ cdk deploy --app "python deployment_glue_datajob.py"
(node:10368) ExperimentalWarning: The fs.promises API is experimental
Traceback (most recent call last):
File "deployment_glue_datajob.py", line 60, in <module>
python_job >> pyspark_job
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\datajob\stepfunctions\stepfunctions_workflow.py", line 115, in __exit__
self._build_workflow()
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\datajob\stepfunctions\stepfunctions_workflow.py", line 91, in _build_workflow
self.client = boto3.client("stepfunctions")
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\boto3\__init__.py", line 93, in client
return _get_default_session().client(*args, **kwargs)
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\boto3\session.py", line 263, in client
aws_session_token=aws_session_token, config=config)
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\botocore\session.py", line 826, in create_client
credentials = self.get_credentials()
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\botocore\session.py", line 431, in get_credentials
'credential_provider').load_credentials()
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\botocore\credentials.py", line 1975, in load_credentials
creds = provider.load()
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\botocore\credentials.py", line 1102, in load
credentials = fetcher(require_expiry=False)
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\botocore\credentials.py", line 1137, in fetch_credentials
provider=method, cred_var=mapping['secret_key'])
botocore.exceptions.PartialCredentialsError: Partial credentials found in env, missing: AWS_SECRET_ACCESS_KEY
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "deployment_glue_datajob.py", line 60, in <module>
python_job >> pyspark_job
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\datajob\datajob_stack.py", line 74, in __exit__
self.create_resources()
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\datajob\datajob_stack.py", line 93, in create_resources
[resource.create() for resource in self.resources]
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\datajob\datajob_stack.py", line 93, in <listcomp>
[resource.create() for resource in self.resources]
File "C:\Users\dvcl643\.virtualenvs\glue-E61qYPlY\lib\site-packages\datajob\stepfunctions\stepfunctions_workflow.py", line 104, in create
text_file.write(self.workflow.get_cloudformation_template())
AttributeError: 'NoneType' object has no attribute 'get_cloudformation_template'
Subprocess exited with error 1
