Senior Python / PySpark Engineer - GenAI at AIG

Atlanta, Georgia, United States

AIG Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
InsuranceIndustries

Requirements

  • Minimum of 7 years of professional software development experience
  • Strong proficiency in Python (7+ years)
  • Hands-on experience with Apache Spark and PySpark for large-scale data processing
  • Strong proficiency in PySpark (3+ years)
  • Write clean, efficient, and well-documented Python and TypeScript code
  • Experience with testing frameworks (pytest, unittest)
  • Design, develop and implement data processing pipelines using Python and Spark
  • Proficient in cloud-native platforms and tools, including Hadoop, HDFS, Spark, Kubernetes, and ElasticSearch
  • Experience with containerization technologies (Docker) and orchestration tools (Kubernetes, Docker Compose)
  • Strong background in deploying and maintaining AI/ML models, with hands-on experience using platforms like Palantir Foundry, Snowflake, and AWS SageMaker
  • Build and maintain scalable and reliable APIs to expose data and functionalities to other services and applications
  • Identify and implement performance optimizations

Responsibilities

  • Collaborating with stakeholders to identify and deliver innovative data solutions that meet the evolving needs of the business
  • Building and maintaining cloud-native big data solutions, advanced analytics products and GenAI models
  • Partnering with data architects and senior engineers to implement best practices, ensuring sustainable and scalable technical designs
  • Working closely with analytics, application development, and data science teams to foster collaboration and drive innovation
  • Delivering on-time, high-quality results on fast-paced schedules while maintaining rigorous standards for development and code management

Skills

Python
PySpark
Generative AI
Big Data
Cloud Native
Data Engineering
Spark
AI Models

AIG

Global insurance provider for individuals and businesses

About AIG

AIG provides a variety of insurance products and services aimed at individuals, families, and businesses. Their offerings include life insurance, retirement planning, and commercial insurance, which help clients manage risk and protect their assets. AIG operates by underwriting insurance policies and managing risk, while also investing the premiums collected to generate income. This company stands out from competitors by not only focusing on traditional insurance but also emphasizing cybersecurity and data protection to keep clients' information safe. AIG's goal is to help clients achieve financial security and peace of mind through comprehensive insurance solutions.

New York City, New YorkHeadquarters
1919Year Founded
IPOCompany Stage
Cybersecurity, Financial ServicesIndustries
10,001+Employees

Benefits

Health, dental, & vision coverage
Flexible Spending Accounts (FSA)
401(k)
PTO
Commuter Expense Reimbursement Account

Risks

Sale of personal travel business may reduce AIG's market presence in travel insurance.
Expansion in Atlanta could pose financial risks if expected growth does not materialize.
Deconsolidation of Corebridge Financial might lead to loss of synergies and increased costs.

Differentiation

AIG offers a wide range of insurance products globally, serving diverse client needs.
Corebridge Financial, a subsidiary, enhances AIG's offerings in retirement planning and financial futures.
AIG emphasizes cybersecurity and data protection, ensuring clients' information remains secure.

Upsides

AI adoption in underwriting and claims processing enhances efficiency and reduces costs for AIG.
InsurTech partnerships offer AIG opportunities to enhance digital capabilities and drive innovation.
Telematics and usage-based insurance allow AIG to offer personalized and flexible products.

Land your dream remote job 3x faster with AI