IT Data Engineer

Houston, Texas, United States

Apply with AI Apply

Not SpecifiedCompensation

Mid-level (3 to 4 years), Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Environmental Services, Climate TechIndustries

Requirements

Candidates must possess strong knowledge of programming languages including Python, Java, and SQL. Experience with relational databases like PostgreSQL and NoSQL databases such as MongoDB is required, along with proficiency in data warehousing platforms like Snowflake and ETL tools including Databricks. Familiarity with Big Data technologies such as Hadoop, Spark, Kafka, and Hive is necessary, as is expertise in Azure cloud platforms and data modeling. Candidates should also have experience with scripting.

Responsibilities

The Data Engineer will design and implement ETL/ELT processes, build scalable data pipelines, and automate data workflows. They will monitor and troubleshoot pipelines, design and maintain data architecture, and optimize data storage and retrieval. Responsibilities also include evaluating and implementing new data solutions, managing cloud platforms, ensuring data quality and integrity, implementing data governance frameworks, and managing data security. Additionally, the role involves providing data access tools, documenting technical designs, and supporting data-driven decision-making by providing clean and accessible data.

Skills

ETL

ELT

Data Pipelines

Data Warehousing

Data Lakes

SQL

NoSQL

Cloud Storage

Data Modeling

Automation

Scripting

Troubleshooting

Code Climate

Provides engineering intelligence for software development

About Code Climate

Code Climate provides engineering intelligence solutions that enhance software development processes. Its main product, Velocity, analyzes data from code commits and pull requests to deliver actionable metrics and insights. These insights help organizations identify workflow bottlenecks, optimize their processes, and boost productivity. Code Climate operates on a subscription-based model, allowing clients to access the Velocity platform for a fee, with a 14-day free trial available for potential customers. This platform is especially useful for companies aiming to improve their continuous delivery practices and manage technical debt. Code Climate distinguishes itself by focusing specifically on the needs of engineering teams, offering detailed analytics that help diagnose issues and implement improvements. The company's goal is to empower software development teams with data-driven insights to enhance their efficiency and effectiveness.

New York City, New YorkHeadquarters

2011Year Founded

$72.8MTotal Funding

SERIES_CCompany Stage

Data & Analytics, Enterprise SoftwareIndustries

11-50Employees

Risks

Increased competition from emerging platforms could erode Code Climate's market share.

Rapid technological changes may outpace Code Climate's platform updates, risking obsolescence.

Economic downturns could reduce IT budgets, impacting subscription renewals and sales.

Differentiation

Code Climate's Velocity platform offers unique data-driven insights for engineering teams.

The platform helps identify bottlenecks and optimize workflows for improved productivity.

Code Climate's subscription model allows clients to experience benefits before committing.

Upsides

Growing demand for remote work tools aligns with Code Climate's offerings.

Rise of DevOps practices increases demand for engineering efficiency insights.

Shift towards agile methodologies creates need for real-time metrics, benefiting Code Climate.

Land your dream remote job 3x faster with AI

Try Jobo Free