Staff Software Engineer, Data
FlexSalary not specified
- Full Time
- Senior (5 to 8 years)
$245,000 – $310,000Compensation
Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
AI & Machine LearningIndustries
Requirements
Candidates should have at least 3 years of experience as a data engineer and 8 years of any software engineering experience, including data engineering. Proficiency in at least one programming language commonly used in Data Engineering, such as Python, Scala, or Java is required. Experience with distributed processing technologies and frameworks, such as Hadoop, Flink, and distributed storage systems like HDFS or S3 is necessary. Expertise with ETL schedulers such as Airflow, Dagster, or Prefect is also required. A solid understanding of Spark and the ability to write, debug, and optimize Spark code is essential.
Responsibilities
The Data Engineer will design, build, and manage data pipelines to ensure seamless integration of user event data into the data warehouse. They will develop canonical datasets to track key product metrics, including user growth, engagement, and revenue. The role involves collaborating with various teams such as Infrastructure, Data Science, Product, Marketing, Finance, and Research to understand their data needs and provide solutions. Additionally, the engineer will implement robust systems for data ingestion and processing and participate in data architecture and engineering decisions, ensuring the security, integrity, and compliance of data according to industry and company standards.
Skills
Python
Scala
Java
Hadoop
Flink
HDFS
S3
Airflow
Dagster
Prefect
Spark
Data Security
Data Integrity
OpenAI
Develops safe and beneficial AI technologies
About OpenAI
OpenAI develops and deploys artificial intelligence technologies aimed at benefiting humanity. The company creates advanced AI models capable of performing various tasks, such as automating processes and enhancing creativity. OpenAI's products, like Sora, allow users to generate videos from text descriptions, showcasing the versatility of its AI applications. Unlike many competitors, OpenAI operates under a capped profit model, which limits the profits it can make and ensures that excess earnings are redistributed to maximize the social benefits of AI. This commitment to safety and ethical considerations is central to its mission of ensuring that artificial general intelligence (AGI) serves all of humanity.
Key Metrics
San Francisco, CaliforniaHeadquarters
2015Year Founded
$18,433.2MTotal Funding
LATE_VCCompany Stage
AI & Machine LearningIndustries
1,001-5,000Employees