Data Architect (Databricks Data Engineer)

NISC-posted about 7 hours ago
Full-time • Mid Level
Hybrid • Lake Saint Louis, MO
501-1,000 employees
Resume
Match Score
Upload and Match ResumeTrack Jobs with Teal

We are seeking an experienced Data Engineer to join our growing team of data analytics experts. The hire will be responsible for curating and optimizing our data and data pipeline architecture in Databricks, as well as optimizing data flow and collection for various application teams. The Data Engineer will support our application experts, software developers, database architects, and data analysts on a Data Roadmap strategy and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be comfortable supporting the data needs of multiple teams, systems, and products. We look for individuals who will thrive in a team environment, be committed to accomplishing a common goal and excited by the prospect of optimizing or even re-designing our company’s data architecture and have some fun along the way.

  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Understanding of Data Warehouse and Data Lakehouse paradigms.
  • Design and build optimal data pipelines from a wide variety of data sources using AWS and Databricks technologies.
  • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing a unified data stream.
  • Work with other data engineering experts to strive for greater functionality while making data more discoverable, addressable, trustworthy, and secure.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Create and maintain a culture of engagement and one that is conducive of NISC’s Statement of Shared Values.
  • Commitment to NISC’s Statement of Shared Values.
  • Experience building and optimizing data pipelines, architectures, and data sets.
  • Hands-on experience developing and optimizing data pipelines and workflows using Databricks.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build ETL processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • Working knowledge of message queuing, stream processing, and highly scalable data stores.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Candidate with experience in a Data Engineer role, who has attained a BS or MS degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field. They should also have experience using the following software/tools:
  • Experience with AWS: Lambda, S3, SQS, SNS, CloudWatch, etc.
  • Experience with Databricks and Delta Lake.
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL and NoSQL databases, including Oracle, Postgres Cassandra, and DynamoDb.
  • Experience with data pipeline and workflow management tools: Hevo Data, Airflow, etc.
  • Experience with AWS cloud services: EC2, Databricks, EMR
  • Experience with stream-processing systems: Apache Spark, Kafka Streams, Spring Cloud, etc.
  • Experience with object-oriented languages: Java, Scala.
  • Experience with scripting languages: Python, JavaScript, Bash, etc.
  • Strong verbal and written communication skills.
  • Ability to demonstrate composure and think analytically in high pressure situations.
  • Medical, Dental and Vision Insurance.
  • Health Savings Account (HSA) with $100 monthly contributions from NISC.
  • Like to walk? Improve your overall wellness knowledge? Ability to earn up to $800 additional dollars into your HSA each year through our Wellness Rewards program.
  • Dependent Care Flexible Spending Account (FSA) thru Paylocity.
  • Fully covered life insurance up to x3 annual base salary.
  • Fully covered short- and long-term disability.
  • 401(k), traditional or Roth, with employee match up to 6% and employer 4% salary base contributions.
  • PTO accrual levels dependent on years of service, 120 Life Leave Event hours, 9 paid holidays and an annual holiday week.
  • $2,500 Interest-FREE technology loan program.
  • $25,000 employee educational assistance program.
  • Volunteer, Wellness, Family Events and other employee fun supplied by our committees.
  • Employee Assistance Program; assisting employees and dependents with virtually any life event
  • Benevolence Committee to support employees with financial hardships like unexpected medical bills, funerals and other unfortunate hardships.
Track Jobs with Teal

Job Search Resources

•
AI Resume Builder
•
Data Architect Resume Examples
•
Data Architect Cover Letter Examples

Tools

Career Hubs

Guides

Company

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service