Big Data Engineer - P50 at Adobe

Bengaluru, Karnataka, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

TechnologyIndustries

Requirements

A bachelor's degree in computer science or related fields
8-12 years of experience as a server-side developer, with at least 4 years in Data Engineering, with a consistent track record of designing, implementing, and delivering large scale, high-quality solutions
Solid understanding and programming skill in languages such as Java or Python and frameworks and libraries based on them with a focus on data engineering
Strong expertise and familiarity with various Big Data technologies and frameworks including Delta Lake, Apache Hive, Datahub, Apache Spark, Apache Flink, Apache Storm, Trino, and AWS EMR
Strong familiarity with the concepts of RDBMS, Data Lake, Data Warehouse, Data Lakehouse, and Medallion Architecture
Knowledge of at least one workflow orchestration tools such as Airflow or Oozie
Experience working with ML engineers, Data Scientists, product and engineering leadership on their data and analysis needs
Experience working with the DevOps teams to drive operationally excellent infrastructure
Excellent problem-solving skills, with a consistent track record of delivering innovative solutions
Ability to thrive in a collaborative, inclusive, and diverse workplace, embracing different perspectives and ideas
Being comfortable with the ambiguity and having the ability to adapt to evolving priorities
Be a role model and a mentor for the team by doing diligent code and design reviews, by doing knowledge sharing sessions and showcasing sound technical decision making in day-to-day work
Being ahead of the curve by familiarizing yourself with the latest and the best in the technological landscape and turning them into effective solutions for our customers

Responsibilities

Build a data platform using big data processing and warehousing technologies
Build, maintain, and ideate on frameworks and tools required to ingest, store, process and serve data for global scale, data-intensive systems
Build data pipelines to publish reports and to power dashboards for ALM clients
Collaborate with cross-functional teams to determine key interfaces for your projects and build them with quality and agility
Do analysis and present key findings, insights and concepts to key influencers and leaders to help them make data driven decisions on business and product roadmap
Support Machine Learning engineers and Data Scientists with their dataset needs for training the ML or statistical models and evaluating them
Be aware of the latest open-source projects and technological breakthroughs in the data engineering space and explore them to build better and more effective solutions
Drive innovation through research and experimentation, encouraging an environment where new ideas can thrive
Mentor junior engineers on the team

Skills

Key technologies and capabilities for this role

Big Data ProcessingData WarehousingData PipelinesETL FrameworksDashboardsReportsMachine LearningData AnalysisOpen Source Technologies

Questions & Answers

Common questions about this position

What is the salary for the Big Data Engineer position?

This information is not specified in the job description.

Is this Big Data Engineer role remote or office-based?

This information is not specified in the job description.

What skills and experience are required for this Data Engineer role?

Candidates need 8-12 years of experience as a server-side developer with at least 4 years in Data Engineering, solid programming skills in Java or Python, and strong expertise in Big Data technologies like Delta Lake, Apache Hive, Apache Spark, Apache Flink, and others. A bachelor's degree in computer science or related fields is also required.

What is the company culture like at Adobe for this role?

Adobe is committed to creating exceptional employee experiences where everyone is respected with equal opportunity, encourages new ideas from everywhere, and fosters an innovative environment through research, experimentation, and mentoring junior engineers.

What makes a strong candidate for the Big Data Engineer position?

A strong candidate has 8-12 years of server-side development experience with 4+ years in Data Engineering, expertise in Java/Python and Big Data tools like Spark and Flink, and a track record of delivering large-scale solutions while collaborating cross-functionally and mentoring others.

Adobe

Software solutions for content creation and marketing

About Adobe

Adobe provides a range of software solutions focused on digital experiences, catering to creative professionals, businesses, and educational institutions. Its main offerings include Adobe Creative Cloud, which contains tools for photography, graphic design, video editing, illustration, UI/UX design, 3D and augmented reality, and social media content creation. Adobe also offers marketing solutions through Adobe Experience Cloud and document management services via Adobe Document Cloud. The company operates on a subscription-based model, allowing users to access its software through monthly or annual plans, with special pricing available for students, teachers, and businesses. Adobe differentiates itself from competitors by providing a comprehensive suite of tools that cover various aspects of content creation and marketing, all integrated into one platform. The goal of Adobe is to empower users to create, manage, and optimize their digital content effectively.

San Jose, CaliforniaHeadquarters

1994Year Founded

$668.9MTotal Funding

IPOCompany Stage

Consumer Software, Enterprise Software, DesignIndustries

10,001+Employees