Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Advertising Technology, MediaIndustries
Requirements
Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related technical field
Two (2) years of experience developing software using Java, Scala, Python, and Shell
Experience leveraging Flink and Spark Streaming to process large-scale, real-time data streams
Experience performing data transformations and aggregations using Spark API and SQL
Experience developing and maintaining scalable, fault-tolerant systems within the Hadoop ecosystem, utilizing HBase, NoSQL, HDFS and YARN to ensure reliable and efficient real-time data processing
Experience transmitting data across systems using Kafka
Experience using AWS Services including EC2, Lambda, S3, and Route 53
Experience monitoring project statuses using DataDog and Grafana
Experience storing and querying relational data using MySQL and Presto
Experience using Linux
Experience containerizing applications using Kubernetes
Responsibilities
Develop and optimize large-scale, real-time data processing pipelines using Spark Streaming, Flink, and languages including Java, Scala, Python, and Shell
Handle large-scale streaming data to meet business requirements for low-latency and high-reliability processing
Perform data transformations and aggregations using Spark API and SQL
Develop and maintain scalable, fault-tolerant systems within the Hadoop ecosystem, utilizing HBase, NoSQL, HDFS, and YARN to ensure reliable and efficient real-time data processing
Transmit data across systems using Kafka
Use AWS Services including EC2, Lambda, S3, and Route 53
Monitor project statuses using DataDog and Grafana
Store and query relational data using MySQL and Presto
Use Linux
Containerize applications using Kubernetes
Support applications under development and customize current applications
Assist with the software update process for existing applications, and roll-outs of software releases
Analyze, test, and assist with the integration of new applications
Document all development activity
Research, write, and edit documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals, and formal recommendations and reports
Monitor and evaluate competitive applications and products
Review literature, patents, and current practices relevant to the solution of assigned projects
Collaborate with project stakeholders to identify product and technical requirements
Conduct analysis to determine integration needs
Work with the Quality Assurance team to determine if applications fit specification and technical requirements
Skills
Spark Streaming
Flink
Java
Scala
Python
Shell
Spark API
Spark SQL
Hadoop
HBase
NoSQL
HDFS
YARN
Kafka
AWS EC2
AWS Lambda
AWS S3
Route 53
DataDog
Grafana
MySQL
Presto
Linux
Kubernetes
Comcast
Comcast Corporation is a global media and technology company.