Data Engineering Engineer 3

V2Soft•Dearborn, MI

3h•Hybrid

About The Position

Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately. V2Soft is a global leader in IT services and business solutions, delivering innovative and cost-effective technology solutions worldwide since 1998. We have headquartered in Bloomfield Hills, MI and have 16 offices spread across six countries. We partner with Fortune 500 companies to address complex business challenges. Our services span AI, IT staffing, cloud computing, engineering, mobility, testing, and more. Certified with CMMI Level 3 and ISO standards, V2Soft is committed to quality and security. Beyond our work, we actively support local communities and non-profits, reflecting our core values. Join us to be part of a dynamic and impactful global company! Please visit us at www.V2soft.com to know more.

Requirements

GCP Cloud Run
KAFKA
Cloud Architecture
Software Development
SQL
Cloud Computing
Big Data
Big Query
Application Development
Google Cloud Platform
Java
Application Testing
Agile Software Development
Artificial Intelligence & Expert Systems
Python
API Experience
7+ years Data Engineering work experience
Bachelor's Degree
Python
SQL
DBT/Dataform
GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Functions, etc.)

Nice To Haves

Full-stack skills

Responsibilities

Collaborate with business and technology stakeholders to understand current and future data requirements
Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis
Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow
Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data
Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks
Ensure optimum performance and identify improvement opportunities
Spearhead the design, development, and maintenance of scalable data ingestion and curation pipelines from diverse sources.
Ensure data is standardized, high-quality, and optimized for analytical use.
Utilize your full-stack skills to contribute to seamless end-to-end development, ensuring smooth and reliable data flow from source to insight.
Implement and manage robust data governance policies, access controls, and security best practices to protect sensitive data.
Employ efficient data workflow management and cloud infrastructure provisioning, championing best practices in Infrastructure as Code (IaC).
Continuously monitor and improve the performance, scalability, and efficiency of data pipelines and storage solutions, ensuring optimal resource utilization and cost-effectiveness.
Collaborate effectively with data architects, application architects, and cross-functional teams to define and promote best practices, design patterns, and frameworks for cloud data engineering.
Proactively automate data platform processes to enhance reliability, improve data quality, minimize manual intervention, and drive operational efficiency.
Clearly and transparently communicate complex technical decisions to both technical and non-technical stakeholders, fostering understanding and alignment.
Stay ahead of the curve by continuously learning about industry trends and emerging technologies, proactively identifying opportunities to improve our data platform and enhance our capabilities.
Develop comprehensive documentation for data engineering processes, promoting knowledge sharing, facilitating collaboration, and ensuring long-term system maintainability.