Data Engineer

Atlassian • San Francisco, CA

10d

About The Position

Atlassian is looking for a Data Engineer to join our Markets Data Engineering Team. You will build top-notch data solutions and applications that inspire important decisions across the organization. You will be reporting to the Senior Data Engineering Manager.A typical day may involve collaborating with partners, you will design data models, acquisition processes, and applications to address needs. With experience in large-scale data processing systems (batch and streaming), you will lead business growth and enhance product experiences. And will collaborate with Technology Teams, Global Analytical Teams, and Data Scientists across programs.You'll take ownership of problems from end-to-end: extracting/cleaning data, and understanding generating systems. Improving the quality of data by adding sources, coding rules, and producing metrics is crucial as requirements evolve. Agility and smart risk-taking are important qualities in this industry where digital innovation meets partner/customer needs over time.

Requirements

• BS in Computer Science or equivalent experience with 3+ years as a Data Engineer or a similar role
• Programming skills in Python & Java (good to have)
• Design data models for storage and retrieval to meet product and requirements
• Build scalable data pipelines using Spark, Airflow, dbt, AWS data services (Redshift, Athena, EMR), Apache projects (Spark, Flink, Hive, and Kafka) and databricks
• Experience with modern software development practices (Agile, TDD, CICD) applied to data engineering
• Enhance data quality through internal tools/frameworks detecting DQ issues.
• Working knowledge of relational databases and SQL query authoring

Nice To Haves

• Followed a Kappa architecture with any of your previous deployments
• Built and ran continuous integration pipelines.
• Familiar with building pipelines using Databricks.
• Have some experience with their API's and creating dashboards
• Contributed to open source projects (Ex: Operators in Airflow)

Responsibilities

• influence product teams
• inform Data Science and Analytics Platform teams
• partner closely with data consumers and producers to ensure quality and usefulness of data assets
• strategizing measurement
• collecting data
• generating insights
• Defining metrics
• Instrumenting logging
• Acquiring/ingesting data
• Architecting & modeling data
• Transforming data
• Ensuring data quality, governance, and enablement
• Alerting, visualization, and reporting
• Developing at scale and improving efficiency

Benefits

• Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. Our offerings include health and wellbeing resources, paid volunteer days, and so much more.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees