Staff Big Data DevOps Engineer

  • Salarpuria Sattva Knowledge City Parcel 3, Survey No. 83/1, 7th & 8th Floor, Phase 1 Inorbit Mall Road, Raidurg village, Hyderabad, India
  • Full-time
  • Work Persona: Flexible
  • Region: APAC - Asia Pacific
  • Employee Type: Regular

Company Description

ServiceNow is making the world of work, work better for people. Our cloud‑based platform and solutions deliver digital workflows that create great experiences and unlock productivity for employees and the enterprise. We're growing fast, innovating faster, and making an impact on our customers' and employees' lives in significant and important ways. With over 6,900 customers, we serve approximately 80% of the Fortune 500, and we're on the 2020 list of FORTUNE World's Most Admired Companies.®

We’re looking for people who are ready to jump right in and help us build on our incredible momentum, our diverse, engaged workforce, and our purpose to make the world of work, work better.

Learn more on Life at Now blog and hear from our employees about their experiences working at ServiceNow.

Job Description


The Big Data team plays a critical and strategic role in ensuring that ServiceNow can exceed the availability and performance SLAs of the ServiceNow Platform powered Customer instances - deployed across the ServiceNow cloud and Azure cloud.  Our mission is to:

Deliver state of the art Monitoring, Analytics and Actionable Business Insights by employing new tools, Big Data systems, Enterprise Data Lake, AI, and Machine Learning methodologies that improve efficiencies across a variety of functions in the company: Cloud Operations, Customer Support, Product Usage Analytics, Product Upsell Opportunities enabling to have a significant impact both on the top-line and bottom-line growth. The Big Data team is responsible for:

  • Collecting, storing, and providing real-time access to large amount of data
  • Provide real-time analytic tools and reporting capabilities for various functions including:
    • Monitoring, alerting, and troubleshooting
    • Machine Learning, Anomaly detection and Prediction of P1s
    • Capacity planning
    • Data analytics and deriving Actionable Business Insights



Role Responsibilities

  • Responsible for maintaining and supporting Big Data infrastructure on ServiceNow Cloud and Azure
  • Leveraging UI, SQL, and Full-stack technologies like React, Redux, Node.js, JSON, jQuery to develop interactive dashboards like the Big Data Console to help DevOps and SRE in Deployment and Monitoring of Big Data Clusters in many geographies and Regulated markets
  • Establishing Continuous Integration, and Continuous Deployment (CI/CD) pipelines for applications using tools such as Jenkins, Docker and Ansible.
  • Providing production support to resolve critical data pipelines and application issues and mitigating or minimizing any impact on Big Data applications. Providing support to Development, QA, and System engineering teams in replicating complex issues leveraging experience with UI, SQL, Full-stack, and Big Data technologies.
  • Responsible for developing Big Data Console – a single pane of glass Dashboard for DevOps and SRE teams to administer and monitor various data pipelines by leveraging Full-stack technologies like React, Redux, Node.js, JSON, jQuery, and Hadoop components like HDFS, YARN, Spark, and Impala Big Data APIs etc.
  • Supporting Cloudera based production Big Data analytics platform which includes resolving incident tickets created by Site Reliability Engineers (SRE).
  • Performance tuning and troubleshooting of various Hadoop components and other data analytics tools in the environment: HDFS, YARN, Hive, HBase. Spark, Kafka, RabbitMQ, Impala, Kudu, Redis, Kerberos, Tableau, Grafana and Prometheus.
  • Implement Hadoop cluster security and responsible for enforcing data governance policies
  • Perform production monitoring and support for Big Data infrastructure and Big Data applications in ServiceNow cloud and Azure cloud. 



Technical Skills

  • Expert level of experience in building data pipelines on top of Hadoop Big Data infrastructure and good knowledge of Hadoop administration (preferably Cloudera CDP)
  • Expert knowledge in Querying and analyzing large amount of data on Hadoop HDFS using Hive and Spark Streaming and working on systems like HDFS, YARN, Hive, HBase. Spark, Kafka, RabbitMQ, Impala, Kudu, Redis, Tableau, Grafana and Prometheus.
  • Good level of experience in building Full-stack Big Data applications leveraging React, Redux, Node.js, JSON, AngularJS, jQuery, AJAX, CSS, REST etc.
  • Good knowledge of scripting/programming languages like Perl, Bash, Groovy, Python, and Java.
  • Experience with Ansible, Terraform, Puppet and similar technologies
  • CI/CD automation leveraging Docker/Kubernetes orchestration
  • Good knowledge in Querying and analyzing large amount of data on Hadoop HDFS using Hive and Spark Streaming and working on systems like HDFS, YARN, Hive, HBase. Spark, Kafka, RabbitMQ, Impala, Kudu, Redis, Tableau, Grafana and Prometheus.
  • Good skills working with SQL queries, including performance tuning, utilizing indexes/partitions, and materialized views to improve query performance.
  • Experience securing Hadoop stack with Sentry, Ranger, LDAP, Kerberos KDC
  • In-depth knowledge of Linux internals (Centos 7.x) and shell scripting
  • Ability to learn quickly in a fast-paced, dynamic team environment
  • Required BS Degree in Computer Science or equivalent experience
  • 12+ years of overall experience with at least 7+ years as a Big Data DevOps Engineer



Additional Information

ServiceNow is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status or any other category protected by law.

If you require a reasonable accommodation to complete any part of the application process, or are limited in the ability or unable to access or use this online application process and need an alternative method for applying, you may contact us at [email protected] for assistance.

For positions requiring access to technical data subject to export control regulations, including Export Administration Regulations (EAR), ServiceNow may have to obtain export licensing approval from the U.S. Government for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by the U.S. Government.

Please Note: Fraudulent job postings/job scams are increasingly common. Click here to learn what to watch out for and how to protect yourself. All genuine ServiceNow job postings can be found through the ServiceNow Careers site.

Videos To Watch

Privacy Policy