Senior Data Engineer - GCP at Egen

Hyderabad, Telangana, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

N/AIndustries

Requirements

7–10 years of hands-on experience in Python for backend or data engineering projects
Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, GCS, IAM, Cloud Run)
Experience in Apache Spark, Kafka, Redis/Bigtable, FastAPI, Airflow, GCP Composer DAGs
Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL)
Experience in data migrations from on-premise data sources to Cloud platforms
Experience in working with version control systems like GitHub and knowledge of CI/CD practices
Solid understanding of data pipeline architecture, data integration, and transformation techniques
Excellent problem-solving and analytical skills
Strong communication skills and ability to collaborate in a team environment

Responsibilities

Work extensively on Google Cloud Platform (GCP) services such as Dataflow, Cloud Functions, BigQuery, Cloud Composer, GCS, IAM, Cloud Run
Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery
Implement and enforce data quality checks, validation rules, and monitoring
Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions
Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects
Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL
Document pipeline designs, data flow diagrams, and operational support procedures

Skills

Key technologies and capabilities for this role

PythonFastAPIApache SparkKafkaMongoDBRedisBigtableAirflowDataflowBigQueryCloud ComposerGCSCloud FunctionsCloud RunIAMGitHubSQL

Questions & Answers

Common questions about this position

What is the salary for this Senior Data Engineer position?

This information is not specified in the job description.

Is this a remote position or what is the location requirement?

This information is not specified in the job description.

What are the key required skills for this role?

The role requires 7–10 years of hands-on experience in Python, strong GCP services knowledge (Dataflow, BigQuery, Cloud Functions, Cloud Composer), Apache Spark, Kafka, Redis, FastAPI, Airflow, GCP Composer DAGs, and strong SQL experience with enterprise databases.

What does the data engineering team at Egen look like?

This information is not specified in the job description.

What experience level and skills make a strong candidate for this position?

Candidates with 7 to 10 years of relevant IT experience, strong Python and GCP expertise, and skills in Spark, Kafka, Airflow, and SQL stand out, along with excellent problem-solving and communication skills.

Egen

Provides API strategies and cloud solutions

About Egen

Egen Solutions specializes in API strategies and cloud solutions to help businesses modernize and scale. They offer two main paths for application development: Rebuild, which improves existing functionalities, and Replace, which creates new applications in the cloud. Egen stands out by providing tailored digital transformation services that focus on delivering measurable ROI and quick results. Their goal is to enhance productivity and reduce operational costs for clients across various sectors, including retail and public health.

Naperville, IllinoisHeadquarters

2000Year Founded

$1.3MTotal Funding

PRE_SEEDCompany Stage

Consulting, Consumer Software, Enterprise SoftwareIndustries

1,001-5,000Employees

Benefits

Fun team outings

Health insurance

401(K)

Dental & vision insurance

Paid time-off

Food & drinks

Parental leave

Risks

Emerging tech startups offering similar solutions at lower costs threaten Egen's market share.

Rapid technological changes may outpace Egen's ability to update its solutions.

Economic downturns in retail and e-commerce could impact Egen's revenue.

Differentiation

Egen offers tailored digital transformation services with a focus on ROI and innovation.

The company specializes in secure, dynamic API strategies for seamless business growth.

Egen provides two application development paths: Rebuild and Replace, ensuring flexibility.

Upsides

Rising demand for cloud-native applications boosts Egen's cloud solutions offerings.

Growing interest in API-first development enhances Egen's API strategies and integration services.

Increased focus on cybersecurity in API development aligns with Egen's secure solutions.

Land your dream remote job 3x faster with AI

Try Jobo Free