Junior Data Engineer in Goat

GOAT Interactive is looking for a Junior Data Engineer to join our Data Engineering team, this role will be responsible for the development, testing, and maintenance of data pipelines and data storage systems on Google Cloud Platform (GCP).

You will be working with technologies such as Apache Airflow, BigQuery, Python, and SQL to transform and load large data sets, ensuring high data quality and accessibility for business intelligence and analytics purposes.

Our business is growing quickly and with that so the scale of our data, we are currently working on several initiatives to improve our data solution and you would become an integral part of this.

Key Responsibilities

• Design, construct, install, test, and maintain data pipelines.
• Ensure systems meet business requirements and industry practices for data integrity and quality.
• Manage ETL and ELT pipelines across many data sources (CSV/parquet files, API endpoints, etc)
• Design and build data models for the business end users.
• Write complex SQL queries for standard as well as ad hoc data retrieval needs.
• Use Python for data manipulation and automation tasks.
• Troubleshoot and resolve issues within the data pipelines and databases.
• Participate in code reviews, learning from and teaching others to improve team knowledge and practices.

Experience

• Python3 experience in a business environment
• SQL experience in a business environment
• Knowledge of Data engineering principles and practices
• Experience working in a fast-paced, high-growth environment where requirements can change quickly
• Understanding of cloud computing ideally GCP
• Understanding of software development principles and CI/CD
• Knowledge of Git
• Strong analytical skills and problem-solving attitude.
• Good communication and teamwork skills.

* * * Please note that we operate a hybrid working model of 3 days per week in our office in Southwark, and 2 days from home!