ML Data Engineer Senior

Global-Talent-Exchange

Qatar
Full time
5 - 8 Yrs
Job Openings: 1

Required Skills:

Python

PySpark

SQL

ETL

BigQuery

Databricks

AWS

Python

PySpark

SQL

ETL

Dbt

BigQuery

Databricks

Spark structured streaming

AWS

🚀 Welcome to Your Next Adventure!

We look for experienced engineer for position of dedicated DE for ML team. Main responsibilities will include creating end extending existing feature marts and realtime marts, including investigation of feature drift and performance optimizations. What we also consider as important is having enough skills to take responsibility for full ML-DE interaction, including new pipelines creation in existing DE infrastructure. Main tools used for feature engineering are Dbt, BigQuery, Databricks and Spark structured streaming, having AWS streaming services and infrastructure as a code for DE part. Our workflow emphasizes adaptability, collaboration, with a focus on driving changes in company wide metrics - and you`ll be able to see the impact of your work on the business and customer experience.

🛠 What You’ll Get Your Hands On

  • Feature engineering - support and creating feature marts for ML team, including tests and validation
  • Realtime Feature engineering - creating realtime pipelines, extending realtime feature store with new features
  • Integrating new sources into existing data pipelines for ML needs, ensuring data quality and consistency
  • Monitor and automate ML pipelines processes, including data drift, pipelines performance, alerting

🧙‍♂️ The Magic You Bring

  • Experience in several programming languages or Python frameworks
  • PySpark knowledge i.e. Spark structured streaming, data distribution, optimizations
  • Strong SQL skills, ability to apply subqueries, window functions, CTEs, math specific database functions
  • Experience with modern ETL processes, collection, ingestion, storage, cleaning, transformation, analysis of data
  • Software design skills - software patterns, application, data system design
  • Math statistics knowledge, i.e. stdev, quartiles, ability to apply them for drift or outlier detection
  • Infrastructure as a code is a plus
  • Experience with databricks as a plus

Our Stack

  • GCP platform
  • BigQuery
  • Dbt
  • Databricks
  • Spark structured streaming
  • AWS message brokers
  • Tableau, Redash

Beyond the Code: Giving Back Matters

We don’t just build app. We’re committed to doing business sustainably and giving back to the community that fuels us. From eco-conscious practices to CSR projects, we’re always finding ways to do better—and we invite you to be a part of that mission.

Diversity Isn’t Just a Buzzword

At our organization, fairness and inclusion are the foundation of everything we do. We’re proud to be an equal opportunity workplace that welcomes people from every walk of life. Be bold. Be you. Thrive here.

Let’s Build the Future Together

Apply now to join a tech team where your code sparks change, your voice is heard, and your growth is guaranteed. Let’s make some tech magic together.

About Company

Global-Talent-Exchange
https://globaltalex.com/
Discover high-impact roles Worldwide
10-20 Employees
Information Technology & Services