Data Scientist
About The Position
As a Data Scientist at Avalore, you will support requirements for new system capabilities, the extension and maintenance of bulk data pipelines, and enhancements for multiple applications in customers’ cloud computing environments. The role involves developing and supporting data processing and analytics capabilities, collaborating with customers and integration partners, and contributing to Agile development. The work environment may include a business office with computers, phones, and printers, or occasional loud noise from an airfield or large equipment. The position requires the ability to sit at a computer terminal for extended periods. Occasional travel of up to 10% is expected.
Requirements
- Active security clearance with appropriate polygraph.
- Demonstrated experience using big data processing technologies such as Spark, PySpark, and Python.
- Demonstrated experience with data mapping, extraction, transformation, and loading.
- Demonstrated experience building analytic reports using tools such as CloudWatch and Kibana.
- Demonstrated experience processing and converting operating system and data logs into reports and metrics dashboards.
- Demonstrated experience with regular expressions (RegEx).
- Demonstrated experience with SQL, MySQL, and PostgreSQL.
- Demonstrated experience processing XML and JSON data files.
- Demonstrated experience with IDEs and data modeling through notebooks and Visual Studio.
- Demonstrated experience ETL’ing disparate structured and unstructured data into enriched, query-friendly structured data in indexed files.
- Demonstrated experience performing extensive data review and data quality analysis.
- Demonstrated experience developing ETL design documentation, including source and target mapping and data dictionary information.
- Demonstrated experience interfacing with customers and integration partners to gain and clarify detailed objectives.
- Demonstrated experience supporting Agile development through task definition, scope, and review.
- Ability to sit at a computer terminal for extended periods.
- Ability to sit, stand, talk, and hear, and to use hands and fingers to operate a computer.
Nice To Haves
- Demonstrated experience deploying capabilities on the Databricks unified analytics platform.
- Demonstrated experience using Elastic MapReduce to run big data workloads.
- Demonstrated experience joining multiple complex data sets using Spark.
- Demonstrated experience tuning Spark streaming and batch jobs for cluster utilization and speed.
- Demonstrated experience deploying complex, notebook-based pipelines.
- Demonstrated experience with Python data analysis libraries such as Pandas.
- Demonstrated experience using cloud services such as Lambda, SNS/SQS, or EC2.
- Demonstrated experience with DevOps tools including CloudWatch, Lambda, SQS, Dynamo, and RDS.
- Demonstrated experience working with Elastic and the ElasticSearch/Logstash/Kibana (ELK) stack.
Responsibilities
- Support requirements for new system capabilities.
- Extend and maintain bulk data pipelines and enhance multiple applications in customers’ cloud computing environments.
- Map, extract, transform, load, review, and assess the quality of data from structured and unstructured sources.
- Convert operating system and data logs into reports, metrics, and dashboards.
- Create ETL design documentation, including source and target mappings and data dictionary information.
- Interface with customers and integration partners to gather and clarify detailed objectives.
- Support Agile development by contributing to task definition, scope, and review.
Benefits
- Employer contributions to health care plan (medical, dental, and vision).
- Retirement plan (401k, IRA) with a generous matching program.
- Life insurance (basic, voluntary, and AD&D).
- Paid time off (vacation, sick, and public holidays).
- Short-term and long-term disability.
- Training and development.
- Employee assistance program.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Education Level
No Education Listed
