Data Scientist
Avalore, LLC•Chantilly, VA
About The Position
As a Data Scientist at Avalore, you will support requirements for new system capabilities, extensions and maintenance of bulk data pipelines, and enhancements for multiple applications in customers’ cloud computing environments. The role involves transforming and analyzing structured and unstructured data, creating reports and dashboards, and supporting Agile development. An active security clearance with the appropriate polygraph is required. Travel may be up to 10% and occasional.
Requirements
- Active security clearance with the appropriate polygraph.
- Demonstrated experience using big data processing technologies such as Spark, PySpark, and Python.
- Demonstrated experience with data mapping, extraction, transformation, and loading.
- Demonstrated experience building analytic reports using tools such as CloudWatch and Kibana.
- Demonstrated experience processing and converting operating-system and data logs into reports and metrics dashboards.
- Demonstrated experience with regular expressions (RegEx).
- Demonstrated experience with SQL, MySQL, and PostgreSQL.
- Demonstrated experience processing XML and JSON data files.
- Demonstrated experience with IDEs and data modeling through notebooks and Visual Studio.
- Demonstrated experience ETL’ing disparate structured and unstructured data into enriched, query-friendly structured data in indexed files.
- Demonstrated experience performing extensive data review and data quality analysis.
- Demonstrated experience developing ETL design documentation, including source and target mapping and data dictionary information.
- Demonstrated experience interfacing with customers and integration partners to gain and clarify detailed objectives.
- Demonstrated experience supporting Agile development by contributing to tasking definition, scope, and review.
Nice To Haves
- Demonstrated experience deploying capabilities on the Databricks unified analytics platform.
- Demonstrated experience with Elastic MapReduce to run big data workloads.
- Demonstrated experience joining multiple complex data sets using Spark.
- Demonstrated experience tuning Spark streaming and batch jobs for cluster utilization and speed.
- Demonstrated experience deploying complex, notebook-based pipelines.
- Demonstrated experience with Python data analysis libraries such as Pandas.
- Demonstrated experience using cloud services such as Lambda, SNS/SQS, or EC2.
- Demonstrated experience with DevOps tools including CloudWatch, Lambda, SQS, Dynamo, and RDS.
- Demonstrated experience working with Elastic, Elasticsearch/Logstash/Kibana (ELK stack).
Responsibilities
- Support requirements for new system capabilities and the extension and maintenance of bulk data pipelines.
- Enhance multiple applications in customers’ cloud computing environments.
- Map, extract, transform, and load data from disparate structured and unstructured sources into enriched, query-friendly structured data in indexed files.
- Build analytic reports and dashboards, including processing and converting operating-system and data logs into reports and metrics dashboards.
- Perform extensive data review and data quality analysis.
- Develop ETL design documentation, including source and target mapping and data dictionary information.
- Interface with customers and integration partners to gain and clarify detailed objectives.
- Support Agile development by contributing to task definition, scope, and review.
Benefits
- Employer contributions to health care plan (medical, dental, and vision).
- Retirement plan (401k, IRA) with a generous matching program.
- Life insurance (basic, voluntary, and AD&D).
- Paid time off (vacation, sick, and public holidays).
- Short-term and long-term disability.
- Training and development.
- Employee Assistance Program.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Education Level
No Education Listed
