Data Engineer

Responsibilities:

• Develop, evolve, and support pipelines based on business and engineering needs
• Implement and adopt systems tracking data quality and consistency
• Propose and develop tools supporting self-service data pipeline management (ETL)
• SQL and MapReduce job tuning to improve data processing performance
• Contribute to the DE team tech roadmap and align it with stakeholders
• Build well-crafted, well-tested, readable, maintainable code with data infrastructure cost and scalability in mind
• Participate in code reviews to ensure code quality and distribute knowledge
• Participate in on-call rotations to ensure high availability and reliability of workflows and data
• Unblock, support and communicate with internal & external partners to achieve results

Experience:

• 5+ years of relevant professional experience
• Strong experience with Spark and Airflow
• Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet
• Strong skills in a scripting language (Python, Bash, etc)
• Experience of driving building complex data models and pipelines
• Proficient in at least one of the SQL languages (MySQL, PostgreSQL, etc)
• Experience of working directly with cross-functional data analytics, data scientists, and engineering teams to bridge business goals with data engineering
• Preferred experience of building and maintaining pay, identity, or integrity related data tables as a Data Engineer for large organizations

Benefits:

• Great medical, dental, and vision insurance options with additional programs available when enrolled
• Mental health benefits
• Family building benefits
• Child care and pet benefits
• 401(k) plan to help save for your future
• In addition to 12 observed holidays, salaried team members have discretionary paid time off, hourly team members have 15 days paid time off
• 18 weeks of paid parental leave. Biological, adoptive, and foster parents are all eligible
• Subsidized commuter benefits
• Exclusive opportunity to test new benefits of our Ridership Program

The expected base pay range for this position in the San Francisco area is $128,000 - $160,000. Salary ranges are dependent on a variety of factors, including qualifications, experience and geographic location. Range is not inclusive of potential equity offering, bonus or benefits.