Sr Staff Software Engineer, Platform
Cribl- Full Time
- Senior (5 to 8 years)
Candidates must possess a BS, MS, or PhD in Computer Science or a related field and have at least 4 years of industry experience in software development. Experience with large web crawlers is a plus, along with strong expertise in large stateful distributed systems and data processing. Proficiency in Kubernetes and Infrastructure-as-Code concepts is required, as well as a willingness to try new approaches and technologies. Candidates should also demonstrate the ability to handle multiple tasks, adapt to changing priorities, and possess strong written and verbal communication skills.
The Software Engineer will own and lead engineering projects in data acquisition, including web crawling, data ingestion, and search. They will collaborate with sub-teams such as Data Processing, Architecture, and Scaling to ensure smooth data flow and system operability. The role involves working closely with the legal team on compliance and data privacy matters, developing and deploying scalable distributed systems for handling petabytes of data, and architecting algorithms for data indexing and search capabilities. Additionally, the engineer will build and maintain backend services for data storage, deploy solutions in a Kubernetes Infrastructure-as-Code environment, and conduct experiments to analyze system performance.
Develops safe and beneficial AI technologies
OpenAI develops and deploys artificial intelligence technologies aimed at benefiting humanity. The company creates advanced AI models capable of performing various tasks, such as automating processes and enhancing creativity. OpenAI's products, like Sora, allow users to generate videos from text descriptions, showcasing the versatility of its AI applications. Unlike many competitors, OpenAI operates under a capped profit model, which limits the profits it can make and ensures that excess earnings are redistributed to maximize the social benefits of AI. This commitment to safety and ethical considerations is central to its mission of ensuring that artificial general intelligence (AGI) serves all of humanity.