Data Engineer - GCP at Egen

Hyderabad, Telangana, India

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years)Experience Level

Full TimeJob Type

UnknownVisa

N/AIndustries

Requirements

4–6 years of hands-on experience in Python for backend or data engineering projects
Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.)
Solid understanding of data pipeline architecture, data integration, and transformation techniques
Experience in working with version control systems like GitHub and knowledge of CI/CD practices
Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.)

Responsibilities

Design, develop, test, and maintain scalable ETL data pipelines using Python
Work extensively on Google Cloud Platform (GCP) services such as: Dataflow for real-time and batch data processing, Cloud Functions for lightweight serverless compute, BigQuery for data warehousing and analytics, Cloud Composer for orchestration of data workflows (based on Apache Airflow), Google Cloud Storage (GCS) for managing data at scale, IAM for access control and security, Cloud Run for containerized applications
Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery
Implement and enforce data quality checks, validation rules, and monitoring
Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions
Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects
Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL
Document pipeline designs, data flow diagrams, and operational support procedures

Skills

Key technologies and capabilities for this role

PythonGCPDataflowBigQueryCloud FunctionsCloud ComposerGoogle Cloud StorageIAMCloud RunSQLGitHubCI/CDETL

Questions & Answers

Common questions about this position

What is the salary for this Data Engineer position?

This information is not specified in the job description.

Is this Data Engineer role remote or does it require office work?

This information is not specified in the job description.

What are the key required skills for this role?

The role requires 4–6 years of hands-on experience in Python, strong understanding of GCP services like Dataflow and BigQuery, solid knowledge of data pipeline architecture, experience with GitHub and CI/CD, and strong SQL skills with enterprise databases.

What does the team structure look like for this position?

You will join the data engineering team and collaborate with data scientists, analysts, and other engineering teams.

What makes a strong candidate for this Data Engineer role?

A strong candidate has 4–6 years of Python experience, expertise in GCP services like Dataflow, BigQuery, and Cloud Composer, knowledge of data pipelines and ETL, GitHub/CI/CD proficiency, and strong SQL skills; optional experience with Snowflake, Databricks, or Azure Data Factory is a plus.

Egen

Provides API strategies and cloud solutions

About Egen

Egen Solutions specializes in API strategies and cloud solutions to help businesses modernize and scale. They offer two main paths for application development: Rebuild, which improves existing functionalities, and Replace, which creates new applications in the cloud. Egen stands out by providing tailored digital transformation services that focus on delivering measurable ROI and quick results. Their goal is to enhance productivity and reduce operational costs for clients across various sectors, including retail and public health.

Naperville, IllinoisHeadquarters

2000Year Founded

$1.3MTotal Funding

PRE_SEEDCompany Stage

Consulting, Consumer Software, Enterprise SoftwareIndustries

1,001-5,000Employees

Benefits

Fun team outings

Health insurance

401(K)

Dental & vision insurance

Paid time-off

Food & drinks

Parental leave

Risks

Emerging tech startups offering similar solutions at lower costs threaten Egen's market share.

Rapid technological changes may outpace Egen's ability to update its solutions.

Economic downturns in retail and e-commerce could impact Egen's revenue.

Differentiation

Egen offers tailored digital transformation services with a focus on ROI and innovation.

The company specializes in secure, dynamic API strategies for seamless business growth.

Egen provides two application development paths: Rebuild and Replace, ensuring flexibility.

Upsides

Rising demand for cloud-native applications boosts Egen's cloud solutions offerings.

Growing interest in API-first development enhances Egen's API strategies and integration services.

Increased focus on cybersecurity in API development aligns with Egen's secure solutions.

Land your dream remote job 3x faster with AI

Try Jobo Free