Senior Systems Engineer- Grafana Experience

DTCC

DTCC

Software Engineering
Dallas, TX, USA
USD 75k-150k / year
Posted on Jul 23, 2025

Senior Systems Engineer- Grafana Experience

Dallas, TX, United States

Job Info

  • Job Identification 210966
  • Job Category Information Technology
  • Posting Date 07/23/2025, 06:47 PM
  • Locations 1333 Crestside Drive, Coppell, TX, 75019, US
  • Apply Before 07/28/2025, 06:46 PM
  • Job Schedule Full time
  • Salary Range Senior Associate-75,000-150,000-USD
  • Featured Opportunities Yes
  • FLSA Status Exempt

Job Description

Are you ready to make an impact at DTCC?

Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We are committed to helping our employees grow and succeed. We believe that you have the skills and drive to make a real impact. We foster a thriving internal community and are committed to creating a workplace that looks like the world that we serve.

The Information Technology group delivers secure, reliable technology solutions that enable DTCC to be the trusted infrastructure of the global capital markets. The team delivers high-quality information through activities that include development of essential, building infrastructure capabilities to meet client needs and implementing data standards and governance.

Pay and Benefits:
  • Competitive compensation, including base pay and annual incentive
  • Comprehensive health and life insurance and well-being benefits, based on location
  • Pension / Retirement benefits
  • Paid Time Off and Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.
  • DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third day unique to each team or employee).
The Impact you will have in this role:

At DTCC, the Observability team is at the forefront of ensuring the health, performance, and reliability of our critical systems and applications. We empower the organization with real-time access to infrastructure and business applications by using innovative monitoring, reporting, and visualization tools.

Our team collects and analyzes metrics, logs, and traces using platforms like Splunk and other telemetry solutions. This data is crucial for assessing application health and availability, and for enabling rapid root cause analysis when issues arise—helping us maintain resilience in a fast-paced, high-volume trading environment.

If you're passionate about observability, data-driven problem solving, and building systems that make a real-world impact, we’d love to have you on our team.

Primary Responsibilities:

As a member of DTCC’s Observability team, you will play a pivotal role in enhancing our monitoring and telemetry capabilities across critical infrastructure and business applications. Your responsibilities will include:

  • Lead the migration from OpenText monitoring tools to Grafana and other open-source platforms.
  • Design and deploy monitoring rules for infrastructure and business applications.
  • Develop and manage alerting rules and notification workflows.
  • Build real-time dashboards to visualize system health and performance.
  • Configure and manage OpenTelemetry Collectors and Pipelines.
  • Integrate observability tools with CI/CD, incident management, and cloud platforms.
  • Deploy and manage observability agents across diverse environments.
  • Perform upgrades and maintenance of observability platforms.
Qualifications:
  • Minimum of 6-8 years of related experience.
  • Bachelor's degree preferred or equivalent experience.
Talent needed for success
  • Demonstrable experience designing intuitive, real-time dashboards (e.g., in Grafana) that effectively communicate system health, performance trends, and business critical metrics.
  • Expertise in defining and tuning monitoring rules, thresholds, and alerting logic to ensure accurate and actionable incident detection.
  • Good understanding of both application-level and operating system-level metrics, including CPU, memory, disk I/O, network, and custom business metrics.
  • Experience with structured log ingestion, parsing, and analysis using tools like Splunk, Fluentd, or OpenTelemetry.
  • Familiarity with implementing and analyzing synthetic transactions and real user monitoring to assess end-user experience and application responsiveness.
  • Hands-on experience with application tracing tools and frameworks (e.g., OpenTelemetry, Jaeger, Zipkin) to diagnose performance bottlenecks and service dependencies.
  • Proficiency in configuring and using AWS CloudWatch for collecting and visualizing cloud-native metrics, logs, and events.
  • Understanding of containerized environments (e.g., Docker, Kubernetes) and how to monitor container health, resource usage, and orchestration metrics.
  • Ability to write scripts or small applications in languages such as Python, Java, or Bash to automate observability tasks and data processing.
  • Experience with automation and configuration management tools such as Ansible, Terraform, Chef, or SCCM to deploy and lead observability components at scale.

The salary range is indicative for roles at the same level within DTCC across all US locations. Actual salary is determined based on the role, location, individual experience, skills, and other considerations. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

About Us

With over 50 years of experience, DTCC is the premier post-trade market infrastructure for the global financial services industry. From 20 locations around the world, DTCC, through its subsidiaries, automates, centralizes, and standardizes the processing of financial transactions, mitigating risk, increasing transparency, enhancing performance and driving efficiency for thousands of broker/dealers, custodian banks and asset managers. Industry owned and governed, the firm innovates purposefully, simplifying the complexities of clearing, settlement, asset servicing, transaction processing, trade reporting and data services across asset classes, bringing enhanced resilience and soundness to existing financial markets while advancing the digital asset ecosystem. In 2024, DTCC’s subsidiaries processed securities transactions valued at U.S. $3.7 quadrillion and its depository subsidiary provided custody and asset servicing for securities issues from over 150 countries and territories valued at U.S. $99 trillion. DTCC’s Global Trade Repository service, through locally registered, licensed, or approved trade repositories, processes more than 25 billion messages annually. To learn more, please visit us at www.dtcc.com or connect with us on LinkedIn, X, YouTube, Facebook and Instagram.

DTCC proudly supports Flexible Work Arrangements favoring openness and gives people freedom to do their jobs well, by encouraging diverse opinions and emphasizing teamwork. When you join our team, you’ll have an opportunity to make meaningful contributions at a company that is recognized as a thought leader in both the financial services and technology industries. A DTCC career is more than a good way to earn a living. It’s the chance to make a difference at a company that’s truly one of a kind.

Learn more about Clearance and Settlement by clicking here.

About the Team

Serves as a dedicated technology resource for advancing DTCC’s business opportunities and providing industry thought leadership for leveraging new technology. The goal of this new department is to partner internally with IT, our business and regulatory divisions and externally with clients, regulators, and fintech vendors, to help build new platforms and business models to advance DTCC’s mission to support the financial markets.

Similar Jobs