Senior Software Engineer – Identity Resolution

Acxiom•Homebased - Conway, AR

1d•Remote

About The Position

The Senior Software Engineer will join the Identity Resolution engineering team and design, develop, test, and support high-scale Identity Resolution and Entity Resolution systems that match, link, and resolve identities across large and diverse datasets. The role includes large-scale distributed data-processing workloads and high-performance application services, including low-latency APIs for real-time identity resolution. The engineer will work with Java, Python, Scala, Apache Spark, SQL, AWS, and Databricks to build scalable, reliable, secure, and high-performance solutions. The position collaborates with architects, engineers, data teams, product stakeholders, security teams, and other partners to turn technical requirements into production-quality software. The role also includes technical guidance and mentoring for junior and mid-level engineers.

Requirements

At least 5 years of professional software development experience, including developing and supporting production software systems.
Strong proficiency in Java and enterprise application development.
Strong proficiency in Python for application development, data processing, automation, or distributed workloads.
Strong proficiency in Scala, particularly for large-scale data-processing applications.
Strong hands-on experience with Apache Spark and distributed data processing.
Advanced proficiency in SQL, including complex queries, data transformations, and query optimization.
Experience developing production workloads using Databricks.
Experience developing cloud-based applications and services using AWS.
Experience with Identity Resolution, Entity Resolution, record linkage, data matching, or similar large-scale data-processing systems.
Experience developing REST APIs, backend services, microservices, or distributed applications.
Experience building and optimizing high-throughput, low-latency services and APIs.
Strong understanding of distributed systems concepts, including concurrency, partitioning, caching, resiliency, scalability, and fault tolerance.
Experience optimizing Spark workloads, including partitioning, joins, caching, memory utilization, and execution performance.
Strong understanding of software engineering principles, object-oriented design, data structures, algorithms, and design patterns.
Experience with automated testing, CI/CD, source control, and modern software delivery practices.
Experience with Git and collaborative software development workflows.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent written and verbal communication skills.
Ability to independently own complex development tasks while collaborating effectively with architects and other engineering team members.
Bachelor’s degree in Computer Science, Software Engineering, Computer Engineering, or a related technical field, or equivalent professional experience.

Nice To Haves

Experience developing Identity Resolution platforms or graphs.
Experience implementing deterministic and probabilistic identity-matching algorithms.
Experience with fuzzy matching, similarity algorithms, record linkage, or entity-resolution techniques.
Experience developing Spark applications using both Scala and PySpark.
Experience with Databricks performance optimization, cluster configuration, and production workload management.
Experience with event-driven or streaming architectures.
Experience with graph databases or graph-oriented data models.
Experience with Docker, Kubernetes, or containerized application environments.
Experience with infrastructure-as-code technologies such as Terraform or CloudFormation.
Experience building monitoring and observability using tools such as CloudWatch, Grafana, or similar technologies.
Experience working with large-scale consumer, marketing, advertising, financial, or customer identity datasets.
Experience with or strong familiarity with Identity Resolution, Entity Resolution, Customer 360, Master Data Management, identity graphs, record linkage, or similar matching systems.

Responsibilities

Design, develop, test, and maintain software for large-scale Identity Resolution and Entity Resolution platforms.
Develop systems that match, link, consolidate, and resolve identities across multiple datasets and data sources.
Implement real-time and batch identity-resolution workflows.
Develop high-performance backend services and APIs using Java, Python, and Scala.
Build and optimize low-latency APIs for real-time identity lookup and resolution.
Develop large-scale distributed data-processing applications using Apache Spark, including Spark workloads in Scala and Python.
Develop complex SQL queries and data-processing logic for identity matching, analysis, and data transformation.
Develop, optimize, and operate large-scale data-processing workloads using Databricks.
Develop cloud-native applications and data-processing solutions using AWS.
Work with architects to translate solution designs and technical requirements into production-quality software.
Contribute to technical design discussions and recommend implementation approaches based on performance, scalability, reliability, and maintainability.
Implement deterministic and probabilistic matching logic, fuzzy matching, data normalization, identity linking, and related capabilities.
Optimize application code, Spark workloads, SQL queries, and data pipelines for performance and scalability.
Troubleshoot application, distributed-processing, data-quality, and production performance issues.
Develop automated tests and validation processes to ensure the accuracy and reliability of identity-matching logic.
Build monitoring, logging, metrics, and observability into production applications and data-processing workloads.
Participate in code reviews and help establish strong software engineering practices across the team.
Mentor junior and mid-level engineers and provide technical guidance on complex development tasks.
Collaborate with architects, engineering teams, data engineers, product teams, security teams, and other stakeholders.
Stay current with evolving technologies and engineering practices related to Identity Resolution, distributed systems, cloud computing, and large-scale data processing.