Engineer - Data Engineering
Role Summary
Hatchyard is looking for a skilled Data Engineering Engineer to join their team. This role focuses on building and managing robust data processing applications and sophisticated data pipelines within a cloud environment.
Responsibilities
- Develop and maintain enterprise-grade data processing applications.
- Construct and manage ETL/ELT pipelines using ingestion platforms and orchestration tools.
- Implement low-latency Change Data Capture (CDC) pipelines to move data from relational sources to enterprise warehouses.
- Handle data ingestion and extraction from various ERP systems including SAP, Dynamics 365, and AS400.
- Utilize Google Cloud Platform services for efficient data orchestration and processing.
- Work within a Scrum Agile framework to deliver high-quality data solutions.
Requirements & Qualifications
- A university degree in Computer Science, IT, or a related field.
- Approximately 1 to 2 years of professional experience in data engineering.
- Proficiency in Python, SQL, and Shell/Bash scripting.
- Practical experience with both relational and NoSQL database systems.
- Hands-on expertise with GCP services such as BigQuery, Dataflow, and Cloud Composer.
- Knowledge of DevOps practices, CI/CD tools (GitHub, GitLab, Jenkins), and code management.
- Preferred Skills: Familiarity with Terraform (IaC), Datadog for monitoring, Medallion Architecture, and streaming/batch patterns like Lambda or Kappa.
How to Apply
Please refer to the official Hatchyard recruitment channels to submit your application.
Tags
PythonSQLShell/BashRelational DatabasesNoSQLFivetranETL/ELTCDCGoogle Cloud PlatformBigQueryDatastreamDataflowPub/SubCloud FunctionsCloud RunCloud ComposerAS400SAPDynamics 365GitHub