Senior Data Engineer

Clarity Innovations•Tampa, FL

1d•$93,600 - $159,100•Onsite

About The Position

Clarity Innovations is hiring a Senior Data Engineer to directly support U.S. Special Operations Command (SOCOM) at MacDill Air Force Base in Florida. The role is embedded within SOCOM headquarters and provides subject matter expertise and technical capability for integrating complex data. It supports SOCOM data governance and modernization efforts and helps the command use its data resources more effectively. The engineer develops and maintains data-generation infrastructure and pipelines, making data from structured and unstructured sources useful for analytics and downstream users. The work requires advanced programming knowledge, SQL database design, performance optimization, distributed data processing, and familiarity with machine learning concepts. The engineer also supports stakeholders' data infrastructure needs and administers cloud computing and CI/CD pipelines. The position requires a bachelor's degree in a STEM field, at least one year of experience, and a Secret clearance. Work is onsite five days per week. A Top Secret clearance with SCI eligibility and familiarity with Palantir Foundry and the Department of War are preferred. The posted national salary range is $93,600–$159,100 USD; the actual offer may vary based on location, contract requirements, and job-related factors.

Requirements

At least 1 year of experience.
Bachelor's degree in a STEM field; Computer Science and Software Engineering are preferred areas of study.
Verifiable work experience with data structures, database management, distributed computing, and API-driven architectures using SQL and NoSQL engines.
Proficiency in modeling frameworks such as Universal Modeling Language (UML), Agile Development, and Git Operations.
Proficiency in one or more programming languages.
Secret clearance required.
Ability to work onsite five days per week.
Knowledge of performance optimization, data pipelining, and SQL database design.
Basic knowledge of machine learning.

Nice To Haves

Top Secret clearance with SCI eligibility.
Familiarity with Palantir Foundry.
Familiarity with DoW.

Responsibilities

Develop, maintain, and test infrastructure for generating and transforming data from structured and unstructured sources.
Develop complex queries to provide data accessibility while optimizing NoSQL and/or big data infrastructure performance.
Create and maintain optimal data pipeline architecture.
Build and maintain infrastructure for extracting, transforming, and loading (ETL) data from a wide variety of sources.
Extract and integrate data from relational SQL and NoSQL databases and platform APIs.
Configure and manage data analytics frameworks and pipelines using databases and tools such as NoSQL, SQL, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, OrientDB, Spark, Hadoop, Kafka, Hive, and Pig.
Apply distributed-systems concepts, including consistency and availability, liveness and safety, durability, reliability, fault tolerance, and consensus algorithms.
Administer cloud computing and CI/CD pipelines, including Azure, Google, and Amazon Web Services (AWS).
Coordinate with product, data, and design stakeholders on data-related technical issues and data infrastructure needs.
Integrate complex models and use advanced software library frameworks to distribute large, clustered data sets.
Build efficient and accurate data pipelines for downstream users, including data scientists.