Kafka Systems Engineer - Messaging Engineering - Middleware

Location(s) US-TX-Dallas
Job ID
Schedule Type
Full Time
Vice President
Systems Engineer
Business Unit
Foundational Infrastructure
Employment Type



Goldman Sachs is a leading global investment banking, securities and investment management firm that provides a wide range of services worldwide to a substantial and diversified client base that includes corporations, financial institutions, governments and high net-worth individuals.

Founded in 1869, it is one of the oldest and largest investment banking firms. The firm is headquartered in New York and maintains offices in London, Bangalore, Frankfurt, Tokyo, Hong Kong and other major financial centres around the world.

We are committed to growing our distinctive Culture and holding to our core values which always place our client's interests first. These values are reflected in our Business Principles, which emphasise integrity, commitment to excellence, innovation and teamwork.




Our team of engineers builds solutions to the most complex problems. We develop cutting-edge systems and processes that form the core of our key business and enable transactions to move in milliseconds. We provide real-time access to critical deal information and crunch billions of data points each day to inform firm-wide market insights and strategies. Team members have the opportunity to work at the forefront of technology innovation alongside industry leaders and make significant contributions to the field.


The team ensures knowledge, best practices and expertise are all shared between regions promoting teamwork and collaboration.


Candidates should be able to demonstrate sound technical knowledge. They will be motivated by their passion for technology. They will be able to manage the balance of innovation over risk, and act as a source of thought leadership within the data community.




The role is to be the Subject Matter Expert (SME) of Apache Kafka messaging product. The role is not limited and extends to other messaging products such as RabbitMQ. The engineer will be responsible for the safe deployment and maintenance of Apache Kafka messaging services and other messaging products. They will ensure that monitoring is in place for the early detection of issues, and that systems are resilient and have capacity to deal with changing demands. We have a growing number of messaging products deployed in the public cloud and this role provides direct exposure to products like Confluent Cloud, Amazon MSK as well as other cloud native messaging technologies.


Responsibilities include:

  • Take a central role in the running and development of Apache Kafka and/or other messaging infrastructure.
  • Analyse and resolve issues in production environments
  • Develop effective monitoring solutions, automation and procedures to improve reliability and reduce manual intervention
  • Liaise with global product engineering teams, and contribute to improvements in products and processes
  • Provide technical guidance on established infrastructure best practices to application system owners and business
  • Perform some administration tasks where no automation exists.




  • Java development experience, including interaction with Messaging Technologies ( Apache Kafka, RabbitMQ, TIBCO EMS/RV ).
  • Experience with SDLC and Github/Gitlab.
  • Experience with shell scripting and Python.
  • Experience with core concepts of Apache Kafka.
  • Familiar with Linux, especially performance monitoring tools.
  • Familiar with RESTful web services and microservices architectures.
  • Familiar with networking concepts, routing and firewalls.
  • Familiar with SRE principles, SLO monitoring and management.
  • Ability to work effectively with a globally distributed team, while able to operate independently.
  • Strong analytical skills with the ability to break down and communicate complex issues, ideas and solutions
  • Excellent written and verbal communication skills


  • Technical Skills - Demonstrates strong technical skills required for the role, pays attention to detail, takes initiative to broaden his/her knowledge and demonstrates appropriate financial/analytical skills
  • Drive and Motivation - Successfully handles multiple tasks, takes initiative to improve his/her own performance, works intensely towards extremely challenging goals and persists in the face of obstacles or setbacks
  • Client and Business Focus - Effectively handles difficult requests, builds trusting, long-term relationships with clients, helps the client to identify/define needs and manages client/business expectations
  • Teamwork – Gives evidence of being a strong team player, collaborates with others within and across teams, encourages other team members to participate and contribute and acknowledges others' contributions 
  • Communication Skills - Communicates what is relevant and important in a clear and concise manner and shares information/new ideas with others
  • Judgement and Problem solving - Thinks ahead, anticipates questions, plans for contingencies, finds alternative solutions and identifies clear objectives.  Sees the big picture and effectively analyses complex issues  
  • Creativity/Innovation - Looks for new ways to improve current processes and develop creative solutions that are grounded in reality and have practical value
  • Influencing Outcomes - Presents sound, persuasive rationale for ideas or opinions.  Takes a position on issues and influences others' opinions and presents persuasive recommendations



© The Goldman Sachs Group, Inc., 2021. All rights reserved.

Goldman Sachs is an equal employment/affirmative action employer

Female/Minority/Disability/Veteran/Sexual Orientation/Gender Identity