Don't see what you're looking for? Join our Talent Network!…
Recorded FutureFull Time
Junior (1 to 2 years)
Candidates must have over 5 years of professional software development experience with Python and SQL, along with a strong understanding of software engineering best practices including testing, version control, and CI/CD. Proficiency in building and optimizing ETL/ELT processes and data pipelines, along with strong SQL and database concepts, is required. Experience with data processing frameworks like Pandas, understanding of software design patterns and architectural principles, and the ability to write clean, maintainable code are essential. Experience with unit testing, test automation, any cloud provider (GCP preferred), CI/CD pipelines, Infrastructure as Code, and containerization technologies like Docker or Kubernetes is also necessary.
The Python Data Engineer will develop and maintain data pipelines and ETL/ELT processes using Python, and design and implement scalable, high-performance applications. They will collaborate with cross-functional teams to define requirements and deliver solutions, and develop and manage near real-time data streaming solutions using PubSub or Beam. Responsibilities also include contributing to code reviews, architecture discussions, and continuous improvement initiatives, as well as monitoring and troubleshooting production systems to ensure reliability and performance.
Data-driven decision-making solutions for organizations
ShyftLabs helps organizations adopt a data-first approach to their decision-making processes. Their services focus on establishing systems that enable companies to make quicker and more informed decisions based on data analysis. This approach allows businesses to gain insights that can keep them ahead of their competitors. Unlike other companies that may offer generic consulting services, ShyftLabs emphasizes the importance of data in driving decisions, ensuring that organizations can leverage their data effectively to enhance their strategic planning and operational efficiency.