Data Engineer - GCP at Egen

Hyderabad, Telangana, India

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years)Experience Level

Full TimeJob Type

UnknownVisa

N/AIndustries

Requirements

4–6 years of hands-on experience in Python for backend or data engineering projects
Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.)
Solid understanding of data pipeline architecture, data integration, and transformation techniques
Experience in working with version control systems like GitHub and knowledge of CI/CD practices
Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.)

Responsibilities

Design, develop, test, and maintain scalable ETL data pipelines using Python
Work extensively on Google Cloud Platform (GCP) services such as: Dataflow for real-time and batch data processing, Cloud Functions for lightweight serverless compute, BigQuery for data warehousing and analytics, Cloud Composer for orchestration of data workflows (based on Apache Airflow), Google Cloud Storage (GCS) for managing data at scale, IAM for access control and security, Cloud Run for containerized applications
Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery
Implement and enforce data quality checks, validation rules, and monitoring
Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions
Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects
Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL
Document pipeline designs, data flow diagrams, and operational support procedures

Skills

Python

GCP

Dataflow

BigQuery

Cloud Functions

Cloud Composer

Google Cloud Storage

IAM

Cloud Run

SQL

GitHub

CI/CD

ETL

Egen

Provides API strategies and cloud solutions

About Egen

Egen Solutions specializes in API strategies and cloud solutions to help businesses modernize and scale. They offer two main paths for application development: Rebuild, which improves existing functionalities, and Replace, which creates new applications in the cloud. Egen stands out by providing tailored digital transformation services that focus on delivering measurable ROI and quick results. Their goal is to enhance productivity and reduce operational costs for clients across various sectors, including retail and public health.

Naperville, IllinoisHeadquarters

2000Year Founded

$1.3MTotal Funding

PRE_SEEDCompany Stage

Consulting, Consumer Software, Enterprise SoftwareIndustries

1,001-5,000Employees

Benefits

Fun team outings

Health insurance

401(K)

Dental & vision insurance

Paid time-off

Food & drinks

Parental leave

Risks

Emerging tech startups offering similar solutions at lower costs threaten Egen's market share.

Rapid technological changes may outpace Egen's ability to update its solutions.

Economic downturns in retail and e-commerce could impact Egen's revenue.

Differentiation

Egen offers tailored digital transformation services with a focus on ROI and innovation.

The company specializes in secure, dynamic API strategies for seamless business growth.

Egen provides two application development paths: Rebuild and Replace, ensuring flexibility.

Upsides

Rising demand for cloud-native applications boosts Egen's cloud solutions offerings.

Growing interest in API-first development enhances Egen's API strategies and integration services.

Increased focus on cybersecurity in API development aligns with Egen's secure solutions.

Land your dream remote job 3x faster with AI

Try Jobo Free