Will perform data flow monitoring, troubleshoot data anomalies, provide predictive and preventive analysis for proper maintenance/enhancement to avoid data loss, data latency, and data quality issues. Provide data quality assessments for security-related issues observed in the Secure Ingest pipeline. Perform configuration of AWS services such as Simple Notification Service (SNS) and Simple queuing Service (SQS). Program, test, implement and maintain Lambda functions using programming languages like Python to build large-scale batch and real-time data pipelines. Assist in documenting process and procedures which include and not limited to SOPs, SAFe and DevOps operating procedures, and IaC scripts. Support creation of different artifacts, T&E reports, and Security compliance documentation. Support the operational activities to maintain transition algorithms. Look for opportunities to automate and streamline cloud cost reporting and cost anomaly detection.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Mid Level