Senior Python / PySpark Engineer - GenAI at AIG

Atlanta, Georgia, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

InsuranceIndustries

Requirements

Minimum of 7 years of professional software development experience
Strong proficiency in Python (7+ years)
Hands-on experience with Apache Spark and PySpark for large-scale data processing
Strong proficiency in PySpark (3+ years)
Write clean, efficient, and well-documented Python and TypeScript code
Experience with testing frameworks (pytest, unittest)
Design, develop and implement data processing pipelines using Python and Spark
Proficient in cloud-native platforms and tools, including Hadoop, HDFS, Spark, Kubernetes, and ElasticSearch
Experience with containerization technologies (Docker) and orchestration tools (Kubernetes, Docker Compose)
Strong background in deploying and maintaining AI/ML models, with hands-on experience using platforms like Palantir Foundry, Snowflake, and AWS SageMaker
Build and maintain scalable and reliable APIs to expose data and functionalities to other services and applications
Identify and implement performance optimizations

Responsibilities

Collaborating with stakeholders to identify and deliver innovative data solutions that meet the evolving needs of the business
Building and maintaining cloud-native big data solutions, advanced analytics products and GenAI models
Partnering with data architects and senior engineers to implement best practices, ensuring sustainable and scalable technical designs
Working closely with analytics, application development, and data science teams to foster collaboration and drive innovation
Delivering on-time, high-quality results on fast-paced schedules while maintaining rigorous standards for development and code management

Skills

Key technologies and capabilities for this role

PythonPySparkGenerative AIBig DataCloud NativeData EngineeringSparkAI Models

Questions & Answers

Common questions about this position

What experience level is required for this Senior Python / PySpark Engineer role?

A minimum of 7 years of professional software development experience is required.

Is this a full-time position?

Yes, this is a full-time employment opportunity.

What are the main technical responsibilities for this role?

Responsibilities include building and maintaining cloud-native big data solutions, advanced analytics products, and GenAI models, as well as leading the design, development, and operationalization of cutting-edge solutions.

What is the team culture like at AIG for this GenAI role?

The role involves working alongside talented colleagues in a brand-new, innovative Generative AI team, collaborating across teams to foster innovation, and contributing to groundbreaking projects that transform risk management.

What makes a strong candidate for this position?

Strong candidates have at least 7 years of software development experience and can collaborate with stakeholders, data architects, analytics teams, and others to deliver scalable, high-quality data solutions on fast-paced schedules.

AIG

Global insurance provider for individuals and businesses

About AIG

AIG provides a variety of insurance products and services aimed at individuals, families, and businesses. Their offerings include life insurance, retirement planning, and commercial insurance, which help clients manage risk and protect their assets. AIG operates by underwriting insurance policies and managing risk, while also investing the premiums collected to generate income. This company stands out from competitors by not only focusing on traditional insurance but also emphasizing cybersecurity and data protection to keep clients' information safe. AIG's goal is to help clients achieve financial security and peace of mind through comprehensive insurance solutions.

New York City, New YorkHeadquarters

1919Year Founded

IPOCompany Stage

Cybersecurity, Financial ServicesIndustries

10,001+Employees

Benefits

Health, dental, & vision coverage

Flexible Spending Accounts (FSA)

401(k)

PTO

Commuter Expense Reimbursement Account

Risks

Sale of personal travel business may reduce AIG's market presence in travel insurance.

Expansion in Atlanta could pose financial risks if expected growth does not materialize.

Deconsolidation of Corebridge Financial might lead to loss of synergies and increased costs.

Differentiation

AIG offers a wide range of insurance products globally, serving diverse client needs.

Corebridge Financial, a subsidiary, enhances AIG's offerings in retirement planning and financial futures.

AIG emphasizes cybersecurity and data protection, ensuring clients' information remains secure.

Upsides

AI adoption in underwriting and claims processing enhances efficiency and reduces costs for AIG.

InsurTech partnerships offer AIG opportunities to enhance digital capabilities and drive innovation.

Telematics and usage-based insurance allow AIG to offer personalized and flexible products.

Land your dream remote job 3x faster with AI

Try Jobo Free