Specialist Data/AI Engineering (Azure Databricks platform engineer) at AT&T

Bengaluru, Karnataka, India

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

TelecommunicationsIndustries

Requirements

Minimum 6+ years of experience in architecting/designing/building/managing/optimizing core frameworks for cloud-based system platforms and end-to-end solutions
6 to 8 years of hands-on experience administering Azure Databricks in cloud environments
In-depth knowledge and experience with Unity Catalog for data governance and security
Proven expertise in cost optimization for Databricks clusters and cloud resources
Strong understanding of Databricks architecture, cluster management, and job orchestration
Experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java, Spark/Pyspark
Proficiency in Spark architecture, including cluster management, job scheduling, and performance tuning
Experience in Azure DevOps, Git/Github
Azure Event Hub/ Azure Event Grid / Kafka
Hands-on experience with scripting languages such as Python, Scala, or SQL
Experience with infrastructure-as-code tools like Terraform or ARM templates
Solid understanding of data security, governance, and compliance standards
Excellent problem-solving skills and ability to work in a collaborative environment
Strong communication skills and ability to explain technical concepts to non-technical stakeholders
Ability to work with international teams spread across multiple time zones

Responsibilities

Optimization of cloud infrastructure, including Databricks, ADLS, Blob, VMs etc
Conduct Proof-of-Concept activities in support of advanced use cases
Architectural focus for ensuring availability, reliability and scalability
Documenting the technical solutions
Administer and manage Azure Databricks workspaces, clusters, and jobs with a focus on maximizing efficiency and performance
Implement and manage Unity Catalog to provide centralized governance and fine-grained access control across data assets
Design and execute cost optimization strategies, including monitoring cluster usage, autoscaling, and resource allocation to minimize cloud expenses
Collaborate with data engineers and security teams to enforce data governance, compliance, and security policies using Unity Catalog
Automate deployment, scaling, and monitoring tasks using scripting and cloud-native tools
Troubleshoot and resolve issues related to Databricks clusters, jobs, and Unity Catalog configurations

Skills

Key technologies and capabilities for this role

Azure DatabricksUnity CatalogPySparkSparkPythonJavaSQLPL/SQLHadoopAzure DevOpsGitADLSAzure Blob Storage

Questions & Answers

Common questions about this position

What experience level is required for this role?

Minimum 6+ years of experience in architecting, designing, building, managing, and optimizing cloud-based system platforms is required, with 6 to 8 years of hands-on experience administering Azure Databricks specifically.

What are the must-have technical skills for this position?

Must-have skills include in-depth knowledge of Unity Catalog for data governance and security, proven expertise in cost optimization for Databricks clusters, strong understanding of Databricks architecture, experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java, Spark/Pyspark, Azure DevOps, Git/Github, and Azure Event Hub/Event Grid/Kafka.

Is this a remote position, or is there a specific location requirement?

This information is not specified in the job description.

What is the salary for this role?

This information is not specified in the job description.

What does the work environment and team collaboration look like?

The role involves working with international teams spread across multiple time zones in a collaborative environment, requiring strong communication skills to explain technical concepts to non-technical stakeholders.

AT&T

Telecommunications services including wireless and broadband

About AT&T

AT&T provides telecommunications services, including wireless communications, broadband internet, and digital television, primarily in the United States. Its 5G network offers faster data speeds and more reliable connections, although availability can vary. The company caters to both individual consumers and businesses, offering various subscription plans that include options for unlimited data and bundled services that combine internet, TV, and phone. AT&T generates revenue mainly through subscription fees, device sales, and its streaming service, DIRECTV STREAM, which adds to its diverse offerings. In a competitive market, AT&T distinguishes itself with its extensive service range and strong brand presence.

Dallas, TexasHeadquarters

1876Year Founded

$43.3MTotal Funding

IPOCompany Stage

Consumer Software, EntertainmentIndustries

10,001+Employees

Benefits

Health Insurance

Dental Insurance

Vision Insurance

401(k) Retirement Plan

401(k) Company Match

Paid Vacation

Paid Sick Leave

Paid Holidays

Paid Parental Leave

Adoption Assistance

Disability Insurance

Life Insurance

Employee Assistance Programs

Wellness Program

Employee Discounts

Risks

The customer service guarantee may increase financial liabilities due to compensation for outages.

A recent data breach could damage AT&T's reputation and lead to customer churn.

Resistance to replacing landlines may impact customer retention and satisfaction.

Differentiation

AT&T offers a unique customer service guarantee, setting it apart from competitors.

The company is expanding its fiber network, enhancing broadband offerings in underserved areas.

AT&T's 'Phone-Advanced' device aligns with the trend of replacing traditional landlines.

Upsides

AT&T's fiber network expansion could provide a competitive edge in broadband services.

The new customer service guarantee may attract customers from competitors lacking similar assurances.

Collaboration with The Arc enhances AT&T's brand image through corporate social responsibility.

Land your dream remote job 3x faster with AI

Try Jobo Free