Staff Engineer – Distributed Messaging & Event Streaming, Cloud Data Platforms at General Motors

Warren, Michigan, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

AutomotiveIndustries

Requirements

Minimum eight to ten years of experience working with distributed systems or messaging infrastructure in an engineering capacity (design, build, deploy, run)
Six years or more of combined hands-on experience with Apache or Confluent Kafka and Apache Pulsar in a production environment
One year or more of hands-on experience with Azure Event Hub and/or Event Grid Technologies
Experience with containerization (Docker, Kubernetes) preferably focused on Kafka on Kubernetes, Strimzi, Pulsar or Streamnative
Direct experience with Azure Stream Analytics or Azure Service Bus is viewed favorably
Proven track record designing and implementing scalable & highly available distributed messaging solutions
Solid understanding of security practices: OAuth, role-based access control (RBAC), SSL/TLS, encryption-at-rest/in-transit, secrets management
Experience with infrastructure as code using technologies such as Terraform, Ansible, Chef
Proficiency in Linux file system hierarchy, package management, command line interface, and bash scripting
Experience with working in an agile DevOps framework using Jira, Azure DevOps or similar tools
Ability to multitask and work collaboratively as part of a cross-functional team
Strong written and verbal communication skills with an ability to tailor messaging to different audiences
Bachelor’s degree in computer science or engineering

Responsibilities

Lead the design, deployment, and optimization of distributed messaging and event streaming systems, primarily Apache Kafka, Apache Pulsar and Azure Event Hub
Provide hands on technical leadership on architecture, scalability, security, and performance tuning of messaging platforms
Support implementation and integration of Kafka, Pulsar and Event Hub with other systems (databases, stream processors, cloud services)
Evaluate and recommend complementary cloud based technologies like Azure Event Grid, or Azure Service Bus where appropriate
Develop best practices, standards, and documentation for event streaming and messaging workflows following a hybrid cloud first strategy
Troubleshoot and resolve issues related to messaging infrastructure and streaming data pipelines
Mentor and train engineering teams on distributed messaging concepts, Kafka ecosystem components (Kafka Connect, Kafka Streams, KSQL, Mirrormaker; Pulsar Adapters & Connectors, Geo-replication), and event-driven design patterns
Stay current with emerging trends and advancements in streaming technologies and help steward continuous improvement and adaptability of the platforms for business benefit
Collaborate with security teams to ensure compliance with data governance, privacy, and security policies
Conduct proofs of concept for evaluation and adoption of new tools & technologies

Skills

Apache Kafka

Apache Pulsar

Azure Event Hub

Kafka Connect

Kafka Streams

KSQL

Azure Event Grid

Amazon Kinesis

Azure Service Bus

General Motors

Designs, manufactures, and sells vehicles

About General Motors

General Motors designs, manufactures, and sells vehicles and vehicle parts, catering to individual consumers, businesses, and government entities. The company operates in both traditional internal combustion engine vehicles and the growing electric vehicle (EV) market, generating revenue through vehicle sales and financing services. GM stands out from competitors with its commitment to community service, sustainability, and diversity, as evidenced by a majority female Board of Directors. The company's goal is to balance traditional automotive manufacturing with technological advancements in electric and autonomous vehicles.

Detroit, MichiganHeadquarters

1908Year Founded

$486.7MTotal Funding

IPOCompany Stage

Automotive & Transportation, Financial ServicesIndustries

10,001+Employees