Hello,
I have gone through your requirements for creating CI/CD for AWS Glue job in Python and will definitely help you for your requirements. I possess 7+ years of experience of working in AWS Glue jobs, crawlers, workflows and creating CI/CD pipeline using AWS code commit, CFT, code build, code pipeline, etc. Other than this, I have also worked on other services such as AWS Redshift, Lambda, EC2, S3, EMR, Dynamo DB, DMS, RDS, etc.
I can be your perfect helping hand for your requirements as I have worked on several CI/CD enabled AWS projects in past that covered :-
-Creation of batch and stream data pipeline on cloud
-Cloud migration
-Solution accelerators
-Frameworks to automate customers data pipeline
-Stream data generator
-ILM
-Ecommerce analysis platform
-Healthcare platform
-Sagemaker MLOPS
-Digital data platform
-Banking one stop shop accelerator
-Batch job processing on cloud
-Kinesis streams processor
-Database migration using DMS
etc
Awaiting your kind response !
Thanks