Software Engineer [Multiple Positions Available]
About The Position
Duties: Gather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems. Execute software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems. Identify hidden problems and patterns in data and use these insights to drive improvements to coding hygiene and system architecture. Generate data models using firm wide tooling, linear algebra, statistics, and geometrical algorithms. Evaluate and report on access control processes to determine effectiveness of data asset security. Develop innovative AI/ML solutions and agentic systems for the LLM Suite platform utilizing public cloud architecture and modern standards, and Al Agentic frameworks. Develop and implement state-of-the-art GenAl services. Produce architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development.
Requirements
- Master's degree in Computer Science or related field of study plus 3 years of experience in the job offered or as Software Engineer, Data Engineer, or related occupation. The employer will alternatively accept a Bachelor's degree in Computer Science or related field of study plus 5 years of experience in the job offered or as Software Engineer, Data Engineer, or related occupation.
- 3 years of experience with building scalable data pipelines, integrating machine learning models using Scikit-Learn and PySpark, optimizing query performance, and leveraging cloud platforms including AWS for data-driven solutions.
- 2 years of experience with designing and developing highly scalable, fault tolerant data architectures on AWS by integrating Amazon S3 with Lake Formation, leveraging AWS Glue, orchestrating workflows with Amazon MWAA and AWS Step Functions, deploying using EMR or ECS and optimizing performance using Apache Iceberg in Athena and Redshift Spectrum, ensuring real-time and batch processing across petabyte-scale datasets.
- Experience with provisioning infrastructure, managing ingress/egress traffic, configuring AWS Route 53 to manage domain names, and setting up VPCs using Terraform
- Experience with implementing hub-and-spoke data modeling approach with satellite and hub tables in Amazon Redshift or Snowflake to ensure efficient historical tracking and auditability
- Experience with building pipelines in Databricks by leveraging Data Lake, Photon Engine, Unity Catalog, MLflow, Auto Loader, and Workflow and integrating the pipelines with AWS to enable real-time, secure, and cost-efficient big data and AI workloads
- Experience with executing large-scale, real-time search and analytics solution using Amazon OpenSearch Service, integrating SQS and SNS to enhance Kafka ingestion and ensure efficient data processing
- Experience with using FastAPI and Spring Boot, Swagger, and Akamai for content delivery and security, and Grafana for monitoring streaming services
- Experience with engineering automated, Al-powered data catalog and knowledge graph that enables seamless discovery, self-serve analytics by embedding LLM generated metadata, embeddings based indexing and vector search
- Experience with designing and implementing automated data-quality and anomaly detection using statistical methods to maintain data integrity and detect anomalies in high-velocity data streams.
Responsibilities
- Gather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets
- Execute software solutions, design, development, and technical troubleshooting
- Identify hidden problems and patterns in data
- Generate data models using firm wide tooling, linear algebra, statistics, and geometrical algorithms
- Evaluate and report on access control processes
- Develop innovative AI/ML solutions and agentic systems for the LLM Suite platform
- Develop and implement state-of-the-art GenAl services
- Produce architecture and design artifacts for complex applications
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
5,001-10,000 employees
