Principal Big Data Software

AT&T•Plano, TX

3d•Hybrid

About The Position

The Principal Big Data Software role involves producing batch and real-time data pipelines for network and NLP-based use cases, supporting data scientists and developers. The position offers opportunities to develop deep domain expertise and expand into modeling, cloud-based environment architecting, and software development. Responsibilities include analyzing, designing, programming, debugging, and modifying software enhancements and new products for distributed, large-scale analytics and visualization solutions within a highly agile environment. The role requires working with Big Data technologies such as Hadoop, NoSQL, and text mining in both Azure and on-premise distributed environments. Specific tasks include Hadoop administration, Apache NiFi support, Databricks workspace administration, and supporting the Network Intelligence Data Collect and AI Team. Automation of infrastructure using CICD/Ansible in Azure cloud, setting up secure vents and core infrastructure components in Azure, and UNIX administration are also key duties. The role supports iQI Insights platform Hadoop clusters and Databricks workspaces, manages core ingestion NiFi servers, and assists platform teams with Azure-related tasks. Addressing Azure admin and Databricks issues for various teams, communicating with management, understanding business requirements, defining project roadmaps, and supporting iQI Data & AI applications are also part of the role. The position involves working with iQI Platforms management in Azure Cloud and acting as a Strategy lead for the iQI platform, utilizing technologies like Hadoop, NoSQL, text mining, Databricks workspaces, Azure cloud administration, Agile Scrums, Databricks, Azure Delta Lake, Snowflake, and 5G Architecture/3GPP.

Requirements

Bachelor’s degree, or foreign equivalent degree in Electrical Engineering, Computer Engineering or Computer Science.
5 years of progressive, post-baccalaureate experience in the job offered or 5 years of progressive, post-baccalaureate experience in a related occupation utilizing Hadoop, NoSQL, text mining.
Utilizing Databricks workspaces.
Utilize Azure cloud administration and subscription management.
Utilizing Agile Scrums.
Building Data and AI applications in Azure Cloud.
Utilizing Databricks, Azure Delta Lake, and Snowflake.

Nice To Haves

Utilize 5G Architecture/3GPP.

Responsibilities

Produce batch and real time data pipelines for network and NLP based use cases.
Develop deep domain expertise and opportunities to expand role into modeling, cloud-based environment architecting, and software development.
Analyze, design, program, debug, and modify software enhancements and/or new products used in distributed, large-scale analytics, and visualization solutions.
Work in a highly agile environment.
Develop high performance and distributed computing tasks using Big Data technologies such as Hadoop, NoSQL, text mining, and other distributed environment technologies in azure and on-prem.
Work on Hadoop administration, Apache NiFi support, and Databricks workspace administration.
Support the Network Intelligence Data Collect, AI Team, and their business partners.
Responsible for automation of infrastructure using CICD/ansible or comparable technologies in Azure cloud.
Set up secure vents and core infrastructure components in Azure.
Work on UNIX administration.
Support the iQI Insights platform Hadoop clusters and Databricks workspaces that collects the mobile packet data via the network probes.
Manage the core ingestion NiFi servers and support the platforms teams with all things azure.
Address and support azure admin and Databricks related issues for various in house and offshore teams.
Communicate with all levels of management.
Understand business requirements.
Define project roadmaps.
Support the iQI Data & AI applications that collects the mobile device data.
Work with iQI Platforms management in Azure Cloud and play the role of a Strategy lead for our iQI platform.
Build Data and AI applications in Azure Cloud.

Benefits

Medical/Dental/Vision coverage
401(k) plan
Tuition reimbursement program
Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)
Paid Parental Leave
Paid Caregiver Leave
Additional sick leave beyond what state and local law require may be available but is unprotected
Adoption Reimbursement
Disability Benefits (short term and long term)
Life and Accidental Death Insurance
Supplemental benefit programs: critical illness/accident hospital indemnity/group legal
Employee Assistance Programs (EAP)
Extensive employee wellness programs
Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone