Specialist Data/AI Engineering (Azure Databricks platform engineer) at AT&T

Bengaluru, Karnataka, India

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

TelecommunicationsIndustries

Requirements

Minimum 6+ years of experience in architecting/designing/building/managing/optimizing core frameworks for cloud-based system platforms and end-to-end solutions
6 to 8 years of hands-on experience administering Azure Databricks in cloud environments
In-depth knowledge and experience with Unity Catalog for data governance and security
Proven expertise in cost optimization for Databricks clusters and cloud resources
Strong understanding of Databricks architecture, cluster management, and job orchestration
Experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java, Spark/Pyspark
Proficiency in Spark architecture, including cluster management, job scheduling, and performance tuning
Experience in Azure DevOps, Git/Github
Azure Event Hub/ Azure Event Grid / Kafka
Hands-on experience with scripting languages such as Python, Scala, or SQL
Experience with infrastructure-as-code tools like Terraform or ARM templates
Solid understanding of data security, governance, and compliance standards
Excellent problem-solving skills and ability to work in a collaborative environment
Strong communication skills and ability to explain technical concepts to non-technical stakeholders
Ability to work with international teams spread across multiple time zones

Responsibilities

Optimization of cloud infrastructure, including Databricks, ADLS, Blob, VMs etc
Conduct Proof-of-Concept activities in support of advanced use cases
Architectural focus for ensuring availability, reliability and scalability
Documenting the technical solutions
Administer and manage Azure Databricks workspaces, clusters, and jobs with a focus on maximizing efficiency and performance
Implement and manage Unity Catalog to provide centralized governance and fine-grained access control across data assets
Design and execute cost optimization strategies, including monitoring cluster usage, autoscaling, and resource allocation to minimize cloud expenses
Collaborate with data engineers and security teams to enforce data governance, compliance, and security policies using Unity Catalog
Automate deployment, scaling, and monitoring tasks using scripting and cloud-native tools
Troubleshoot and resolve issues related to Databricks clusters, jobs, and Unity Catalog configurations

Skills

Azure Databricks

Unity Catalog

PySpark

Spark

Python

Java

SQL

PL/SQL

Hadoop

Azure DevOps

Git

ADLS

Azure Blob Storage

AT&T

Telecommunications services including wireless and broadband

About AT&T

AT&T provides telecommunications services, including wireless communications, broadband internet, and digital television, primarily in the United States. Its 5G network offers faster data speeds and more reliable connections, although availability can vary. The company caters to both individual consumers and businesses, offering various subscription plans that include options for unlimited data and bundled services that combine internet, TV, and phone. AT&T generates revenue mainly through subscription fees, device sales, and its streaming service, DIRECTV STREAM, which adds to its diverse offerings. In a competitive market, AT&T distinguishes itself with its extensive service range and strong brand presence.

Dallas, TexasHeadquarters

1876Year Founded

$43.3MTotal Funding

IPOCompany Stage

Consumer Software, EntertainmentIndustries

10,001+Employees

Benefits

Health Insurance

Dental Insurance

Vision Insurance

401(k) Retirement Plan

401(k) Company Match

Paid Vacation

Paid Sick Leave

Paid Holidays

Paid Parental Leave

Adoption Assistance

Disability Insurance

Life Insurance

Employee Assistance Programs

Wellness Program

Employee Discounts

Risks

The customer service guarantee may increase financial liabilities due to compensation for outages.

A recent data breach could damage AT&T's reputation and lead to customer churn.

Resistance to replacing landlines may impact customer retention and satisfaction.

Differentiation

AT&T offers a unique customer service guarantee, setting it apart from competitors.

The company is expanding its fiber network, enhancing broadband offerings in underserved areas.

AT&T's 'Phone-Advanced' device aligns with the trend of replacing traditional landlines.

Upsides

AT&T's fiber network expansion could provide a competitive edge in broadband services.

The new customer service guarantee may attract customers from competitors lacking similar assurances.

Collaboration with The Arc enhances AT&T's brand image through corporate social responsibility.

Land your dream remote job 3x faster with AI

Try Jobo Free