IT DATA ENGINEER III

VERSANT POWERBangor, ME

About The Position

The IT Data Engineer III is responsible for analyzing data, identifying patterns and trends, and developing predictive models to help organizations make data-driven decisions. Qualified Candidate must also be able to communicate their findings to stakeholders and work collaboratively with other teams. They are responsible for designing and building data pipelines, data warehouses, and data lakes and ensure that data is easily accessible, reliable, and secure.

Requirements

  • Bachelor's or Master’s degree in computer science, Information Systems, or a related field.
  • Proven experience (10-15 years) working as a data engineer or in a similar role.
  • Strong proficiency in SQL and experience with relational databases (e.g., Oracle, MySQL, MS SQL, PostgreSQL).
  • Proficiency in core enterprise applications sitting in a UNIX and Windows environment, especially Customer Information Systems, Geographical Information Systems, and Financial Information Systems running Oracle.
  • Proficiency in programming languages such as C#, Python, Java, R for development, data manipulation, scripting, visualizations, and analysis
  • Proficiency in full stack development and frameworks such as JavaScript, React, Angular, ExpressJS, Java, .NET, HTML, and CSS for web application development.
  • Solid understanding of data modeling, data warehousing, and ETL principles.
  • Experience with big data technologies and frameworks (e.g., Hadoop, Spark, Hive, Kafka) and cloud-based data platforms (e.g., AWS, Azure, GCP).
  • Knowledge of data governance, data security, and privacy practices.
  • Excellent problem-solving and analytical skills.
  • Excellent technical architecture and technical support documentation skills.
  • Strong communication and collaboration skills to work effectively in cross-functional teams.
  • Ability to prioritize and manage multiple projects and tasks in a dynamic work environment.
  • Travel for training and User Group participation required.

Nice To Haves

  • Familiarity with data visualization and reporting tools (e.g. Plotly, Tableau, Power BI) is a plus.
  • Familiarity with computer networking, current systems software, protocols, and standards, especially routing/switching/security, Active Directory, Voice over IP.

Responsibilities

  • Design and develop data-centric applications and services (C#, Python)
  • Build APIs, services, and backend components that expose data for: Operational systems Analytics platforms Customer-facing applications
  • Integrate data into applications to enable real-time and near-real-time decision-making
  • Support and enhance existing applications with improved data capabilities
  • Design and implement enterprise integrations using:
  • APIs, file-based interfaces, and messaging patterns
  • Integration platforms (e.g., MuleSoft ESB)
  • Develop and maintain ETL/ELT pipelines (Python, Alteryx, etc.)
  • Ensure resilient, monitored, and recoverable data flows
  • Troubleshoot and resolve integration failures and performance issues
  • Standardize integration patterns to improve consistency and reuse
  • Design, develop, and maintain scalable and efficient data pipelines, databases, and data integration processes.
  • Collaborate with stakeholders to understand data requirements and translate them into technical specifications and data models.
  • Collaborate with IT Architects to align solutions with enterprise standards
  • Evaluate and recommend appropriate data storage and processing technologies based on project requirements and business objectives.
  • Maintain and enhance data dictionaries, lineage, and governance artifacts
  • Design, build, and maintain data warehouses and data lakes to support reporting, analytics, and business intelligence initiatives.
  • Implement data partitioning, indexing, and optimization strategies to improve query performance and efficiency.
  • Work closely with data consumers to understand their reporting and analysis requirements and provide appropriate data structures and schemas.
  • Ensure compliance with data governance policies, standards, and regulations.
  • Implement and enforce data security measures, including access controls, encryption, and data masking techniques.
  • Monitor data usage and access patterns, identifying and mitigating potential data security risks.
  • Follow application development standards and change control.
  • Optimize data processes and infrastructure to improve performance, scalability, and reliability.
  • Conduct performance tuning, query optimization, and indexing to enhance data retrieval and processing speed.
  • Proactively identify and address system bottlenecks to ensure efficient data operations.
  • Design, construction, implementation, and maintenance of automated jobs and reports.
  • Collaborate with cross-functional teams, business analysts, and IT systems analysts, to understand their business requirements and provide data and custom application solutions
  • Communicate technical concepts and solutions effectively to both technical and non-technical stakeholders.
  • Stay updated with the latest industry trends, technologies, and best practices related to data engineering.
  • Participate in after-hours call out for application support and engagement of Managed Service provider as required.
  • Participate actively with related user groups.
  • Other related duties as assigned including designated duties associated with Storm Restoration.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service