Requirements

Expected technologies

SQL

Python

PySpark

Hadoop

Spark

AWS

Databricks

CICD

Optional technologies

Terraform

Scala

laC

Operating system

Windows

Our requirements

• Bachelor's (or better) degree in Computer Science, Engineering, Information Systems, or a related field
• 1 year of prior experience in data engineering, Databricks experience preferred.
• Proficiency in Python / PySpark
• Proficiency with big data technologies including SQL, Spark, Hadoop
• Experience designing data models to optimize storage and retrieval
• Experience working with AWS based solutions
• Experience with CICD (shift left) development practices
• Strong problem-solving skills and a commitment to excellence
• Strong written and oral communication skills with an ability to work collaboratively in a fast-paced, team-oriented environment

Optional

• Prior experience with IaC and Terraform
• Prior experience developing in Scala
• ML skills and experience deploying AI models into solution

Your responsibilities

• Design, develop, and maintain scalable data workflows and pipelines using big data technologies, including Map/Reduce, Spark, Databricks and Acxiom proprietary tools
• Collaborate with data analysts, product managers, and other stakeholders to understand and develop product requirements
• Tune workflows to enhance processing efficiency and optimize use of resources
• Write well-crafted, tested, readable, and maintainable code
• Participate in code reviews to ensure code quality and distribute knowledge
• Drive innovation. Stay up to date with advancements in data engineering tools, cloud services, and generative AI; seeking opportunities to drive leaps in value creation for Acxiom’s clients