
ML Data Engineer Senior
Global-Talent-Exchange
Required Skills:
Python
PySpark
SQL
ETL
BigQuery
Databricks
AWS
Python
PySpark
SQL
ETL
Dbt
BigQuery
Databricks
Spark structured streaming
AWS
🚀 Welcome to Your Next Adventure!
We look for experienced engineer for position of dedicated DE for ML team. Main responsibilities will include creating end extending existing feature marts and realtime marts, including investigation of feature drift and performance optimizations. What we also consider as important is having enough skills to take responsibility for full ML-DE interaction, including new pipelines creation in existing DE infrastructure. Main tools used for feature engineering are Dbt, BigQuery, Databricks and Spark structured streaming, having AWS streaming services and infrastructure as a code for DE part. Our workflow emphasizes adaptability, collaboration, with a focus on driving changes in company wide metrics - and you`ll be able to see the impact of your work on the business and customer experience.
🛠What You’ll Get Your Hands On
- Feature engineering - support and creating feature marts for ML team, including tests and validation
- Realtime Feature engineering - creating realtime pipelines, extending realtime feature store with new features
- Integrating new sources into existing data pipelines for ML needs, ensuring data quality and consistency
- Monitor and automate ML pipelines processes, including data drift, pipelines performance, alerting
🧙‍♂️ The Magic You Bring
- Experience in several programming languages or Python frameworks
- PySpark knowledge i.e. Spark structured streaming, data distribution, optimizations
- Strong SQL skills, ability to apply subqueries, window functions, CTEs, math specific database functions
- Experience with modern ETL processes, collection, ingestion, storage, cleaning, transformation, analysis of data
- Software design skills - software patterns, application, data system design
- Math statistics knowledge, i.e. stdev, quartiles, ability to apply them for drift or outlier detection
- Infrastructure as a code is a plus
- Experience with databricks as a plus
Our Stack
- GCP platform
- BigQuery
- Dbt
- Databricks
- Spark structured streaming
- AWS message brokers
- Tableau, Redash
Beyond the Code: Giving Back Matters
We don’t just build app. We’re committed to doing business sustainably and giving back to the community that fuels us. From eco-conscious practices to CSR projects, we’re always finding ways to do better—and we invite you to be a part of that mission.
Diversity Isn’t Just a Buzzword
At our organization, fairness and inclusion are the foundation of everything we do. We’re proud to be an equal opportunity workplace that welcomes people from every walk of life. Be bold. Be you. Thrive here.
Let’s Build the Future Together
Apply now to join a tech team where your code sparks change, your voice is heard, and your growth is guaranteed. Let’s make some tech magic together.
About Company

Send me jobs like this
This one's a match? We'll send more your way
Similar Jobs

Site Reliability Engineer (DevOps)
Celigo
Hyderabad, India
Full time
5 - 10 Years

Senior DevOps Engineer
Celigo
Hyderabad, India
Full time
5 - 10 Years

DevOps Architect
Celigo
Hyderabad, India
Full time
12 - 20 Years

Design Automation Engineer, Scribe Design Non-Array
Micron Technology
Hyderabad, India
Full time
8 - 20 Years

Staff DevOps Engineer
Celigo
Hyderabad, India
Full time
8 - 12 Years

Cloud Security engineer (Devops)
Celigo
Hyderabad, India
Full time
5 - 10 Years

K3S with J2ME developer
Cyient
Bangalore Urban, India
12 - 18 Years

SDX- IVI, SBC with Container, Qnx, Linux, Qt, Android
Cyient
Bangalore Urban, India
Full time
3 - 8 Years

Embedded CUDA
Cyient
Hyderabad, India
Full time
3 - 8 Years

Embedded Software Engineer
Cyient
Bangalore Urban, India
Full time
3 - 8 Years