Sr. Data Engineer II
TrueML- Full Time
- Senior (5 to 8 years)
Candidates should possess 3+ years of professional software development experience, a Computer Science or Engineering degree (Masters preferred), and proficiency in SQL and Python. Strong ability in distributed systems for processing large-scale data processing is also required. Experience with AWS or similar cloud environments, including services like Kinesis, Firehose, Lambda, and Sagemaker, is a significant plus. Experience with GCP services like BigQuery and Cloud Functions is also beneficial. Familiarity with operational tools such as Terraform, Datadog, and Pagerduty is desired.
The Data Engineer II will design and develop applications to process large amounts of critical information to power analytics and user-facing features, monitor and resolve data pipeline or data integrity issues, and work across multiple teams to understand their data needs. They will also maintain and expand the company’s data infrastructure, leveraging open-source data infrastructure projects such as Airflow, Kafka, Avro, Parquet, Hadoop, Hive, HBase, Presto, or Druid, and building scalable data pipelines and real-time data streams.
Mobile marketplace for local buying and selling
OfferUp operates a mobile marketplace that connects local buyers and sellers, allowing them to trade a variety of items such as furniture, electronics, and cars. The platform is user-friendly, enabling users to browse listings, check seller profiles, view ratings and transaction histories, and communicate securely to negotiate prices and arrange meetups. Unlike traditional marketplaces, OfferUp focuses on peer-to-peer transactions, eliminating intermediaries and fostering direct interactions between individuals. The company generates revenue through advertising, premium listings, and transaction fees, providing sellers with options to enhance their visibility. OfferUp's goal is to create a marketplace that adds value, connects people, and empowers communities, while promoting a strong sense of neighborly culture among its users.