Sr. Staff Engineer (Python,Pyspark,AWS)
- Full-time
- Employee Status: Regular
- Role Type: Hybrid
- Department: Technology
- Schedule: Full Time
Company Description
Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money.
We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments.
We invest in people and new advanced technologies to unlock the power of data. As a FTSE 100 Index company listed on the London Stock Exchange (EXPN), we have a team of 22,500 people across 32 countries. Our corporate headquarters are in Dublin, Ireland. Learn more at experianplc.com.
Job Description
- Lead the architecture and development of cloud-native applications, services, and platforms using Python and AWS.
- Build and manage cloud-native microservices leveraging AWS services such as Lambda, ECS, S3,Glue,RDS/DynamoDB, EMR, glue and EKS .
- Provide technical leadership across engineering teams, driving design reviews, architecture decisions, coding standards, and operational excellence.
- Partner with product, security, architecture, data science, and platform teams to translate business problems into scalable technical solutions.
- Develop reusable frameworks, libraries, APIs, and automation patterns that accelerate engineering delivery.
- Drive adoption of engineering best practices including CI/CD, infrastructure as code, test automation, observability, secure SDLC.
- Build and optimize large-scale distributed data processing solutions using Apache Spark, PySpark, SQL, and cloud data services.
- Evaluate emerging AI engineering tools, LLM frameworks, model providers, and agentic development platforms, recommending practical adoption paths.
- Design, build, and maintain secure, lightweight Docker images for Python, Spark, and GenAI applications.
- Build and maintain Infrastructure as Code using Terraform for AWS cloud resources and platform components.
- You will be reporting to a Senior Manager
Qualifications
- You need to have 11+ years of software engineering experience, with significant experience designing and delivering enterprise-scale systems.
- Need to have deep experience with AWS, including services such as Lambda, ECS/EKS, API Gateway, S3, IAM,EMR, CloudWatch, Step Functions, EventBridge, RDS/DynamoDB, Bedrock, Glue, or equivalent cloud-native services.
- Build application in React, TypeScript, and modern JavaScript (ES6+)
- Practical experience with Generative AI concepts and implementation patterns, including LLM integration, prompt engineering, embeddings, vector databases, RAG, AI safety, and model evaluation.
- Strong hands-on expertise in Python, including API development, backend services, automation, testing, packaging, and production-grade code quality.
- Strong working knowledge of Jupyter notebooks for experimentation, prototyping, and analytical development.
Technical Skills
- Languages: Python, SQL, PySpark, typescript
- Cloud: AWS, S3, Lambda, Glue, EMR, SageMaker, Bedrock, IAM, CloudWatch
- AI/GenAI: LLMs, RAG, embeddings, AI agents, model evaluation
- Data: Spark, distributed processing, data lakes, ETL/ELT, batch
- Tools: Jupyter, Git, CI/CD, Docker, Kubernetes, Terraform or CloudFormation
- Engineering: APIs, microservices, observability, testing, security, architecture design
Additional Information
Our uniqueness is that we truly celebrate yours. Experian's culture and people are important differentiators. We take our people agenda very seriously and focus on what truly matters; DEI, work/life balance, development, authenticity, engagement, collaboration, wellness, reward & recognition, volunteering... the list goes on. Experian's strong people first approach is award winning; Great Place To Work™ in 24 countries, FORTUNE Best Companies to work and Glassdoor Best Places to Work (globally 4.4 Stars) to name a few. Check out Experian Life on social or our Careers Site to understand why.
Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is a critical part of Experian's DNA and practices, and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work, irrespective of their gender, ethnicity, religion, color, sexuality, physical ability or age. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.
Experian Careers - Creating a better tomorrow together
Benefits
Experian care for employee's work life balance, health, safety and wellbeing. In support of this endeavor, we offer best-in-class family well-being benefits, enhanced medical benefits and paid time off.
#LI-Onsite
Experian Careers - Creating a better tomorrow together
Find out what its like to work for Experian by clicking here