Principal Engineer Big Data/ Data Platforms

  • 701 Experian Pkwy, Allen, TX 75013, USA
  • Employees can work remotely
  • Full-time
  • Department: Information Technology & Systems
  • Role Type: Hybrid
  • Employee Status: Regular
  • Schedule: Full Time
  • Shift: Day Shift
  • Flexible Time Off: 20 Days

Company Description

Experian is the world’s leading global information services company, unlocking the power of data to create more opportunities for consumers, businesses and society. We are thrilled to share that FORTUNE has named Experian one of the 100 Best Companies to work for. In addition, for the last five years we’ve been named in the 100 “World’s Most Innovative Companies” by Forbes Magazine

 

Job Description

As a key aide to both the IT Infrastructure and Development teams, you will help support existing systems 24x7 and responsible for leading the current Big Data and Open platform environments globally.  The candidate will be required to work with cross-functional teams & help leverage innovative technologies such as Hadoop Distributions, Spark, Cassandra, Ansible, Graph etc. to build next generation Multi-Cloud products and may also be called upon to support Data platform design and development efforts. To support the product development process in line with the product roadmap for product maintenance and enhancement such that the quality of software deliverables maintains excellent customer relationships and increases the customer base.

If you have the skills and “can do” attitude, we would love to talk to you!

 

Responsibilities:

  • Lead global teams to effectively handle design discussions with Business, software developers and platform engineers.
  • Translate business requirements and logical designs into working physical platform designs.
  • Will collaborate and communication with all levels of technical and senior business management.
  • Will require on-call 24X7 support of production systems on a rotation basis with other team members
  • Responsible for review design, roadmaps, setup, configure, & maintain data platform with highly available infrastructure globally that are scalable, deploy appropriate monitors for alerting etc.
  • Responsible for deployments, performance tuning, capacity planning and security within the data platforms in Multi-Cloud (AWS, GCP, OCI, Azure).
  • Involve in Design discussions with business, software developers and platform engineers to deliver technical solutions.
  • Work with Architecture & BU teams to proactively improve the evolving environment based on architecture specifications & business requirements.
  • Perform operational duties such as Spark/Hadoop/Cassandra cluster upgrades, patching, monitoring jobs, capacity management, etc.
  • Experience in Automation using (ex: Ansible -Python, Terraform, PowerShell etc.)
  • Interface with infrastructure, network, security and operations teams to resolve problems with application/Big Data systems.
  • Will collaborate and communication with all levels of technical and senior business management
  • Will require on-call 24X7 support of production systems on a rotation basis with other team members
  • Pro-actively evaluate evolving technologies and recommend solutions to business problems.
  • Assist in the review and audit of platform security policies, and experience to work closely with the security and auditing teams (internal audit, PWC and PCI payment card industry).
  • Open and coordinate service requests with different Vendor Support
  • Ensure alignment with current IT standards and controls including SDLC & ITIL processes (Incident, Problem, Change management).
  • Review and evaluate performance of the databases
  • Schedule Monthly, Quarterly maintenance windows when required.

 

Teamwork

  • Lead the team to coordinate BU activities to meet the departmental standards.
  • To work together with other departments and divisions within the organisation to identify any process improvements and improve standards, efficiency and profitability.

 

Qualifications

Required Knowledge / Skills / Experience:

  • Bachelor's degree (in Computer Science or related field) or equivalent experience
  • 12+ years of IT and 6+ years of related experience in open platforms technologies. Production implementation experience desired. (Hadoop, Spark, Kafka, HBase, Solr, Elastic, Logstash, Kibana etc.)
  • Strong Experience in Cloud AWS  with exposure to EMR services.
  • Must have working knowledge of Big Data components such as YARN, HDFS, HBase, Spark, etc.
  • Experience in automating deployments and monitoring/alerting tasks (preferably Ansible).
  • Knowledge of programming & scripting languages a plus – Java, C, Python, R, Perl, Hive, MapReduce etc.
  • Strong Problem Solving and creative thinking skills
  • Ability to multi-task and manage multiple assignments simultaneously
  • Effective oral and written communications
  • Experience working with geographically distributed teams
  • Bachelors or Master’s degree in Computer Science or equivalent experience
  • At least 3 years of Big Data implementations
  • Knowledge and understanding of the business strategy and use of back office applications.
  • Ability to adapt to multi-lingual and multicultural environment, additional language skills are a bonus.
  • Ability to handle conflicting priorities.

 

 Role Dimensions:

·       Ensuring high availability for platforms for service excellence.

·       Monitoring and tuning of DB instances

·       Customer Service

·       Teamwork

·       Knowledge

·       Out of Hours Support where required

·       Experience of working in high pressure results oriented organization.

·       Strong strategic process and procedure methodology with attention to maintaining robust audit controls.

·       Ability and flexibility to travel internationally at short notice.

·       Work within different cultural environments.

·       Work within multi-lingual environments.

·       Work with the implications of different cultural and business environments across the company.

Additional Information

Culture at Experian

Our uniqueness is that we truly value yours.

Experian's culture, people and environments are key differentiators. We take our people agenda very seriously. We focus on what truly matters; diversity and inclusion, work/life balance, flexible working, development, engagement, collaboration, wellness, reward & recognition, volunteering... the list goes on

We’re an award-winning organization due to our strong people focus

Experian isn't just growing, we're leveraging cutting edge data science, design thinking and passion to build tomorrow's credit solutions. Innovation is a critical part of Experian's DNA and culture

 

Experian is proud to be an Equal Opportunity and Affirmative Action employer. Our goal is to create a thriving, inclusive and diverse team where people love their work and love working together. We believe that diversity, equity and inclusion is essential to our purpose of creating a better tomorrow. We value the uniqueness of every individual and want you to bring your whole, authentic self to work. For us, this is The Power of YOU and it ensures that we live what we believe.

Privacy Policy