About Trident:
Trident Consulting is an award-winning IT/engineering staffing company founded in 2005 and headquartered in San Ramon, CA. We specialize in placing high-quality vetted technology

Some of our recent awards include:
2022, 2021, 2020 Inc. 5000 fastest-growing private companies in America
2022, 2021 SF Business Times 100 fastest-growing private companies in Bay Area

Position: Senior Splunk Engineer 
Location: Holmdel, NJ & Bethlehem, PA
Mode: Contract W2
Hybrid – 3 Days onsite / 2 Days remote
Duration: 6+ Months (Possible extension)
Pay rate: 75-78/hr. on W2

Final round Interview: In-Person Interview.

Job Overview

We are seeking a Senior Observability Engineer with strong expertise in Splunk administration and monitoring platforms to join the Enterprise Observability Engineering team.

The ideal candidate will be responsible for configuring, administering, and maintaining enterprise observability tools including Splunk (primary), AppDynamics, OpenTelemetry, and Zenoss to ensure reliability, visibility, and optimal performance of enterprise IT systems.

This role involves working closely with DevOps, infrastructure, and application teams to implement monitoring strategies and improve system observability.

Key Responsibilities

Observability Platform Administration

• Administer and configure Splunk, AppDynamics, OpenTelemetry (OTEL), and Zenoss platforms.
• Implement monitoring solutions aligned with enterprise observability standards.
• Perform upgrades, patching, and security hardening of observability tools.

Monitoring & System Reliability

• Monitor the performance and health of observability platforms.
• Ensure high availability and data integrity of monitoring systems.
• Troubleshoot and resolve monitoring platform issues.

Dashboard & Alert Management

• Design and maintain monitoring dashboards, alerts, and reports.
• Collaborate with stakeholders to define monitoring requirements.
• Implement alerting mechanisms for proactive issue detection.

Data Management & Optimization

• Manage data ingestion and onboarding into monitoring systems.
• Optimize platform performance through configuration tuning.
• Manage resource utilization and storage within observability platforms.

Incident Response & Troubleshooting

• Support incident investigation and root cause analysis.
• Leverage observability data (metrics, logs, events, traces) to resolve issues.
• Collaborate with IT and DevOps teams during incident response.

Documentation & Best Practices

• Maintain documentation for monitoring configurations and procedures.
• Establish observability standards and best practices across the organization.

User Support & Training

• Provide technical support to internal teams using monitoring platforms.
  Conduct training sessions to improve observability tool adoption.

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 5–7+ years of experience in Observability, Monitoring, or Site Reliability Engineering.
• Strong hands-on experience with:
  • Splunk (Administration, configuration, and implementation)
  • AppDynamics
  • Zenoss

Technical Skills

• • Strong understanding of MELT framework:
    • Metrics
    • Events
    • Logs
    • Traces
  • Experience with OpenTelemetry including:
    • Instrumentation patterns
    • Context propagation
    • Collectors
    • Sampling
  • Experience with Kubernetes observability
  • Strong knowledge of IT infrastructure, applications, and networking
  • Experience with scripting or automation (Python, Bash)
  • Experience with cloud platforms such as AWS or Azure

Preferred Qualifications

• • Experience with monitoring tools such as:
    • Prometheus
    • Grafana
  • Knowledge of DevOps practices and CI/CD pipelines
  • Experience with Infrastructure as Code (Terraform or Ansible)
  • Familiarity with Git-based workflows

All your information will be kept confidential according to EEO guidelines.