Senior Software Engineer – Identity Resolution
Conway, AR - USA
Job Summary
This role will focus on designing developing testing and supporting high-scale Identity Resolution and Entity Resolution systems that match link and resolve identities across large and diverse datasets. The engineer will work on both large-scale distributed data-processing workloads and high-performance application services including low-latency APIs used for real-time identity resolution.
The ideal candidate will have strong software engineering experience across Java Python Scala Apache Spark and SQL along with hands-on experience with AWS and Databricks.
This position will work closely with architects engineers data teams and product stakeholders to implement scalable reliable secure and high-performance solutions.
Key Responsibilities
- Design develop test and maintain software supporting large-scale Identity Resolution and Entity Resolution platforms.
- Develop systems that match link consolidate and resolve identities across multiple datasets and data sources.
- Implement both real-time and batch identity-resolution workflows.
- Develop high-performance backend services and APIs using Java Python and Scala.
- Build and optimize low-latency APIs supporting real-time identity lookup and resolution.
- Develop large-scale distributed data-processing applications using Apache Spark.
- Build and maintain Spark workloads using Scala and Python.
- Develop complex SQL queries and data-processing logic to support identity matching analysis and data transformation.
- Work with Databricks to develop optimize and operate large-scale data-processing workloads.
- Develop cloud-native applications and data-processing solutions using AWS.
- Work closely with architects to translate solution designs and technical requirements into production-quality software.
- Contribute to technical design discussions and recommend implementation approaches based on performance scalability reliability and maintainability.
- Implement deterministic and probabilistic matching logic fuzzy matching data normalization identity linking and related Identity Resolution capabilities.
- Optimize application code Spark workloads SQL queries and data pipelines for performance and scalability.
- Troubleshoot complex application distributed-processing data-quality and production performance issues.
- Develop automated tests and validation processes to ensure the accuracy and reliability of identity-matching logic.
- Build monitoring logging metrics and observability into production applications and data-processing workloads.
- Participate in code reviews and help establish strong software engineering practices across the team.
- Mentor junior and mid-level engineers and provide technical guidance on complex development tasks.
- Collaborate with architects engineering teams data engineers product teams security teams and other stakeholders.
- Stay current with evolving technologies and engineering practices related to Identity Resolution distributed systems cloud computing and large-scale data processing.
Identity Resolution Experience
The Senior Software Engineer should have experience with or strong familiarity with Identity Resolution Entity Resolution Customer 360 Master Data Management identity graph record linkage or similar matching systems.
Relevant concepts include:
- Deterministic matching
- Probabilistic matching
- Exact and fuzzy matching
- Entity and record linkage
- Identity stitching and consolidation
- Match confidence and scoring
- Attribute normalization and standardization
- Duplicate detection and resolution
- Source prioritization
- Identity graphs
- Real-time identity lookup
- Batch identity processing
- Incremental identity processing
- Data quality and match accuracy
- Large-scale identity datasets
Required Qualifications
- 5 years of professional software development experience including experience developing and supporting production software systems.
- Strong proficiency in Java and enterprise application development.
- Strong proficiency in Python for application development data processing automation or distributed workloads.
- Strong proficiency in Scala particularly for large-scale data-processing applications.
- Strong hands-on experience with Apache Spark and distributed data processing.
- Advanced proficiency in SQL including complex queries data transformations and query optimization.
- Experience developing production workloads using Databricks.
- Experience developing cloud-based applications and services using AWS.
- Experience with Identity Resolution Entity Resolution record linkage data matching or similar large-scale data-processing systems.
- Experience developing REST APIs backend services microservices or distributed applications.
- Experience building and optimizing high-throughput low-latency services and APIs.
- Strong understanding of distributed systems concepts including concurrency partitioning caching resiliency scalability and fault tolerance.
- Experience optimizing Spark workloads including partitioning joins caching memory utilization and execution performance.
- Strong understanding of software engineering principles object-oriented design data structures algorithms and design patterns.
- Experience with automated testing CI/CD source control and modern software delivery practices.
- Experience with Git and collaborative software development workflows.
- Strong analytical troubleshooting and problem-solving skills.
- Excellent written and verbal communication skills.
- Ability to independently own complex development tasks while collaborating effectively with architects and other engineering team members.
Preferred Qualifications
- Experience developing Identity Resolution platforms/graphs.
- Experience implementing deterministic and probabilistic identity-matching algorithms.
- Experience with fuzzy matching similarity algorithms record linkage or entity-resolution techniques.
- Experience developing Spark applications using both Scala and PySpark.
- Experience with Databricks performance optimization cluster configuration and production workload management.
- Experience with event-driven or streaming architectures.
- Experience with graph databases or graph-oriented data models.
- Experience with Docker Kubernetes or containerized application environments.
- Experience with infrastructure-as-code technologies such as Terraform or CloudFormation.
- Experience building monitoring and observability using tools such as CloudWatch Grafana or similar technologies.
- Experience working with large-scale consumer marketing advertising financial or customer identity datasets.
Core Technical Skills
Languages & Data Processing
- Java
- Python
- Scala
- Apache Spark
- SQL
Platforms
- AWS
- Databricks
Engineering Areas
- Identity Resolution / Entity Resolution
- Distributed Systems
- Low-Latency APIs
- Large-Scale Data Processing
- Real-Time and Batch Processing
- Cloud-Native Application Development
Education
Bachelors degree in Computer Science Software Engineering Computer Engineering or a related technical field or equivalent professional experience.
Primary Location City/State:
Homebased - Conway ArkansasAdditional Locations (if applicable):
Acxiom is an equal opportunity employer including disability and protected veteran status (EOE/Vet/Disabled) and does not discriminate in recruiting hiring training promotion or other employment of associates or the awarding of subcontracts because of a persons race color sex age religion national origin protected veteran military status physical or mental disability sexual orientation gender identity or expression genetics or other protected status.
Attention California Applicants: Please see our CCPA/CPRA Privacy Act notice here.
Attention Colorado California Connecticut Massachusetts Maryland NevadaNew Jersey New York City Ohio Rhode Island Virginia and Washington Applicants: This position is not located in the aforementionedlocationsbut applications for remote work may be considered. For information about this role under state or local equal pay or pay transparency laws please contact.
Required Experience:
Senior IC
About Company
We help brands connect, realize, and maximize the power and potential of data and technology.