Sr Data Engineer, AI

Constellation Energy Generation, LLC.•Chicago, IL

10h

About The Position

Constellation is seeking a Sr Data Engineer, AI to lead activities relating to designing, building, testing, implementing, and maintaining AI solutions, products, and processes. This role involves providing IT teams and business personnel with technology solutions by evaluating technology standards, market availability of products, and the risks and benefits of technology to deliver solutions that meet business/IT needs. The position requires coordinating the tasks of less experienced engineers and collaborating across teams. The role is centered on the development and improvement of new and existing features, reviewing peer code, advocating for standard development methodologies, and participating in an inclusive, energetic, and highly cross-functional team. The role encompasses architecting, designing, implementing, and testing to ensure products are built correctly and released with high quality. Maintaining deep knowledge of technology and its application across business areas or for customers, and promoting this knowledge via seminars, presentations, and publications within IT and Constellation is expected. The role also involves participating in technological innovation to drive new business opportunities and solve complex business problems, shaping and advancing core team processes to increase operational efficiency and quality, and coaching and leading other engineers. This is considered a highly skilled and proficient role, conducting complex and important work under minimal supervision with wide latitude for independent judgment.

Requirements

Bachelor's degree in Accounting with 5-years experience, in lieu of degree 9-years experience
Experience with private and public cloud architectures, pros/cons, and migration considerations
5-years of RDBMS experience
Experience with JSON, JSON-LD, XML data structures
Experience implementing data pipelines using latest technologies and techniques
Experience with Azure DevOps, Copado, GitHub, Heroku, ServiceNow or similar tools
3-years of hands-on experience in programming languages such as Java 8, c#, node.js, python, SQL, Unix shell/Perl scripting
5-years of industry experience data engineer, with involvement in the data component of the AI/ML lifecycle, and a solid understanding of applied machine learning topics
3-years of consulting or client service delivery experience on Azure
Experience handling Structured and unstructured datasets
Strong t-SQL skills with experience in Azure SQL DW
Experience in data modeling and advanced SQL techniques
Cloud migration methodologies and processes with tools like Azure Data Factory, Event Hub, etc.
Analytical skills, attention to detail, critical thinking, problem solving and independent decision making
Knowledge of ETL tools
Experience with cloud-native Azure technologies like Azure Functions, Event Grids, Service Bus Queues, Cosmos DB, Azure Data Factory, or related is a plus
Experience designing integration applications, both upstream and downstream applications
Experience with git, Azure DevOps, build pipelines, code branching/merging, code management
Experience writing technical reports and procedures
Knowledge of Event driven architecture

Nice To Haves

Advanced hands-on experience with Databricks and Spark (PySpark preferred) for building and optimizing workflows and pipelines.
Hands-on proficiency in designing, building, and maintaining ETL/ELT pipelines using Python, PySpark, and related tools.
Strong SQL skills and experience with data warehousing.
Hands-on experience with cloud platforms such as AWS, Azure, or GCP, including cloud-native data tools.
Expertise in big data systems and integrating data from diverse sources such as APIs, flat files, and databases.
Experience configuring secure external data connections (e.g., Azure Data Lake Storage, On-prem SQL Server) using: Service Principals, SAS Tokens, OAuth, Mounting techniques
Strong understanding of: Data security, Encryption, Compliance standards
Experience implementing data governance frameworks to ensure and manage data quality.
Proven expertise with Azure Data Factory (ADF) for orchestrating and automating data workflows across cloud and on-premises environments.

Responsibilities

Produce high-quality, secure, and maintainable code/configurations
Learn and understand business processes with limited guidance
Work collaboratively as a member of the development team to build solutions in an agile environment
Support and research issues across all application layers and database
Identify areas to improve and scale our Azure architecture and design
Ensure code can be deployed using Azure DevOps
Design and query database tables, views, functions, stored procedures and batch processes
Develop, implement, and support interfaces that connect our websites, back-end systems, and various 3rd party cloud solutions, vendors and customers.
Engage with business partners to gather information, analyze requirements and deliver practical, efficient and cost-effective solutions that satisfy business needs.
Design, develop and/or review complex code or configurations to ensure AI solutions meet the requirements of functional and technical specifications.
Write product specifications and design documentation for assigned system components.
Design and build large-scale AI data platforms/products & frameworks for processing high volumes of data, in real-time as well as batch, that will be used by teams across the organization
Develop complex data algorithms for AI/ML, data analytics, machine learning, or scientific computing
Utilize indicators to scope and respond proactively to emerging threats
Lead team members and provide oversight for less experienced engineers; Stay on top of the latest technologies and trends.
Support development of version control principles (e.g. Git and working within an agile environment)
Enhance knowledge of and compliance with preferred technologies, methodologies, standards and policies.
Assist in the development of white papers, conducting presentations as needed to explain why a technology is being recommended by IT.
Maintain technical knowledge and business acumen within own discipline or function.
Provide IT teams and business personnel with technology solutions by weighing advantages of technology trends, market availability of products, risks and benefits of technology to meet business/IT needs.
Strong debugging and problem-solving skills; lead peer code reviews.