Staff Big Data Engineer
H1Full Time
Expert & Leadership (9+ years)
Candidates should possess a Bachelor's or Master's degree in Computer Science, Engineering, or a related field, with 4-7 years of experience as a Data Engineer, ideally in professional services or consulting. Proficiency in programming languages like Python, Java, or Scala, and expertise in data processing frameworks such as Spark, Hadoop, and SQL are essential. A deep understanding of database systems (relational and NoSQL), data modeling, data warehousing concepts, and cloud-based data platforms (AWS, Azure, Google Cloud) is required. Familiarity with ETL tools (Apache Airflow, Informatica, Talend), data governance, data quality, and security principles is also necessary, along with strong analytical, problem-solving, communication, and collaboration skills.
The Data Engineer will build and maintain data architecture, develop scalable data pipelines for transforming and moving data from diverse sources, and ensure secure and efficient management of data systems. Responsibilities include designing, testing, and maintaining data architectures like databases, data warehouses, and data lakes, assembling complex datasets to meet requirements, and building high-performance algorithms and predictive models. The role involves integrating systems, managing data workflows, writing and deploying Python scripts, and collaborating with clients, business analysts, data scientists, and other technology teams to ensure data quality and accessibility for analysis and reporting.
Cloud innovation and IT modernization services
Effectual specializes in modernizing IT infrastructure for businesses, focusing on cloud innovation. The company helps both commercial enterprises and public sector customers enhance their IT systems by using established methods and cloud solutions to accelerate digital transformation. Effectual's services include modern application development, cloud strategy, data analytics, and generative AI services, all aimed at improving data-driven decision-making. A significant part of their approach is ensuring data security and compliance, which helps businesses mitigate risks and protect their reputations. Additionally, Effectual assists clients in optimizing their cloud costs by reducing technical debt and the total cost of ownership. The goal of Effectual is to turn business challenges into successful outcomes through effective IT modernization.