Data Architect - SME (Remote)
About The Position
NIWC Atlantic Software Services requires ISHPI to provide emerging Department of Defense (DoD) and Department of Navy (DON) information technology, to design, develop, engineer, and maintain systems that will improve customer organizational efficiency. ISHPI provides support in the areas of Administrative Services, Applications Integration Management, Corporate Strategy Planning and Execution, Information Assurance (IA), Information Resource Management, and Information Technology (IT) Operations. Further task includes new standards engineering, prototype installation, application development, data interoperability, system design, system management and maintenance, data collection, analysis, and other management and implementation efforts in support of data translation, data mediation, and data mapping. ISHPI is seeking a Data Architect who can leverage experience and expertise in data exploration, engineering, and ETL to explore, architect, develop, and deploy scripts for processing structured and unstructured data into usable data formats for long term storage, search, and analysis.
Requirements
- Education: Technical Training in Data Design or Database Architecture or Metadata Management Platforms.
- Experience: Eighteen (18) years of hands-on experience architecting software solutions for IT projects, to include these areas: Designed and built relational databases in a data warehouse environment, which includes data design, database architecture, and metadata repository creation. Performed data access analysis design, and archive/recovery design and implementation.
- Advanced understanding of and ability to apply principles, theories, and concepts of all-things data – databases, data integration, data governance, data science, advanced analytics & reporting, cloud-based data management, and artificial intelligence/machine learning.
- The ability to understand business objectives for data and engineer business solutions that leverage current and innovative data technology capabilities and provide valuable insights to relevant stakeholders.
- The ability to set architectural direction and standards while applying analytical, engineering, hardware, and software design theories to develop/maintain organizational strategy.
- Experience building application and\or data architecture roadmaps.
- Experience designing, integrating, and managing complex applications & data solutions.
- Experience working in a fast-paced, competitive information technology organization.
- Must be a U.S. Citizen with an active secuirty clearance and the ability to obtain T5 eligibility
- Must have at least one of the following: CCNA (Cisco Certified Network Associate Security), CySA+ (CompTIA Cybersecurity Analyst), GICSP (Global Industrial Cyber Security Professional), GSEC (GIAC Security Essentials Certification), CompTIA Security+ CE, CND (Certified Network Defender), or SSCP (Systems Security Certified Practitioner) or the ability to obtain one within 3 months of hire date.
Responsibilities
- Experience Engineer ELT pipelining for data ingest and egress processes in a Databricks Lakehouse Architecture with consistent performance and scalability using established Data Framework
- Experience with Medallion Architecture utilizing Landing Zone and Bronze, Silver and Gold delta tables.
- Expert experience with SPARKS, Python and Databricks SQL in ELT pipeline development to include knowledge of Databricks, Python, and PySpark
- Have experience writing and tuning complex SQL queries used in the ELT development
- Architecting, implementing and Enhance ELT Framework to include Structured Streaming.
- Experience with the AWS preferably GovCloud, and Data Ingest/Transformation/Settings processes.
- Experience with AWS Services like Relational Database Services (RDS), Data Migration Service (DMS), CloudFormation, Terraform, S3 bucket, lambda function, SNS and Event Viewer.
- Architecting, implementing, and supporting software and data technology, in the cloud.
- Have worked on teams that practice Agile methodologies.
- Experience working with Databricks Workspace Notebooks
- Perform Data Engineering on Databricks Development and Production Environments.
- Understanding of programming and data engineering concepts and best practice.
- Experience working with both structured, semi-structured, and unstructured data to include data parsing, transformation, schema definition, and query/analysis.
- Create Standard Operation Procedure (SOP) for onboarding new application solutions.
- Provide assistance and guidance on implementing current Data Management Solutions.
- Provide technical advice to Data Engineering and BI Modernization Efforts.
- Provide management feedback from research and investigation to latest trends in Data Management Systems.
- Troubleshoot, fix, tune and enhance the end to end ELT Pipeline Processes.
- Ability to work both independently and collaboratively.
- Experience using GIT, JIRA/ServiceNow, and Microsoft tools (365 Office, Excel, Teams).
- Consulting with leadership, peers, teammates, and business partners to appreciate current and anticipate future software and data technology needs.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
