Data Engineer at Quora

Colombo, Western Province, Sri Lanka

Quora Logo
Not SpecifiedCompensation
Mid-level (3 to 4 years)Experience Level
Full TimeJob Type
UnknownVisa
Education, TechnologyIndustries

Requirements

  • Bachelor’s degree in Computer Science, Data Science, or a related technical field
  • Strong experience in SQL with hands-on expertise in writing optimized queries
  • Proficiency in Java and Python for data engineering and analytics tasks
  • Hands-on experience with cloud platforms, particularly GCP
  • Experience in OLTP and OLAP databases
  • Knowledge of ETL/ELT development, workflow orchestration, and data modeling
  • Familiarity with version control tools (e.g., Git)
  • Experience solving complex analytical problems using data engineering tools
  • Experience with Apache data engineering services (e.g., Apache Beam, Spark, Kafka, Airflow). Experience with Apache Beam will be an added advantage
  • Exposure to machine learning languages and frameworks
  • Familiarity with statistical methods for data analysis and reporting

Responsibilities

  • Design, develop, and optimize SQL queries and scripts for data transformation, aggregation, and integration
  • Build, maintain, and enhance scalable ETL/ELT pipelines on Big Data platforms
  • Support development and optimization of relational and NoSQL databases, data warehouses, and data lakes
  • Work with cloud-native GCP services, including BigQuery, Cloud Spanner, Workflow and Dataflow, to enable high-performance data processing
  • Apply version control and collaborative development practices using tools like Git
  • Implement workflow orchestration and support data modeling efforts with the BI team
  • Collaborate with cross-functional teams to ensure data quality, integrity, and security
  • Solve complex analytical problems leveraging SQL, data engineering tools, and programming expertise with Java and Python
  • Participate in sprint planning, code reviews, and quality assurance processes
  • Stay current with modern data engineering tools, machine learning workflows, and best practices

Skills

SQL
Java
Python
GCP
ETL
ELT
Big Data
NoSQL
Data Warehouses
Data Lakes
Data Pipelines

Quora

Global knowledge sharing and AI integration platform

About Quora

Quora is a global platform for knowledge sharing that attracts over 400 million unique visitors each month. It allows users to share insights on a wide variety of topics, creating a community focused on learning and connection. Users include individuals looking for information, experts sharing their knowledge, and businesses engaging with a knowledgeable audience. Quora also features Poe, a platform that combines several AI language models like GPT-4 and DALL-E 3, enabling users to chat and explore these technologies in one place. Unlike many competitors, Quora's business model relies on targeted advertising to its large user base, allowing it to continuously expand its offerings to meet user needs.

Mountain View, CaliforniaHeadquarters
2009Year Founded
$351.2MTotal Funding
LATE_VCCompany Stage
Consumer Software, AI & Machine Learning, EducationIndustries
1,001-5,000Employees

Benefits

Health Insurance
Dental Insurance
Vision Insurance
Company Equity
Remote Work Options
Unlimited Paid Time Off
Mental Health Support

Risks

Increased competition from Reddit and Stack Exchange could dilute Quora's user base.
AI-generated content may lead to misinformation without proper oversight.
Privacy concerns over data collection for ads could lead to regulatory scrutiny.

Differentiation

Quora integrates AI models like GPT-4 and DALL-E 3 through its Poe platform.
Quora's Writing Sessions offer a unique alternative to Reddit's AMA for expert Q&A.
Quora's partnership with Bombora enhances B2B audience targeting for advertisers.

Upsides

Quora attracts over 400 million unique visitors monthly, boosting its advertising potential.
AI-driven content moderation can improve user experience by reducing misinformation.
Personalized learning experiences through AI can enhance user retention and satisfaction.

Land your dream remote job 3x faster with AI