Data Engineer at Jampp
Job Description
At Jampp, we solve the most complex and large-scale technological challenges in mobile advertising today. We process over 2,500,000 ad requests per second, which amounts to over 250TB of data per day, across three global data centers. We rely on real-time machine learning models (with billions of features) that give us predictions in less than 100ms. If you are excited about building real-time data pipelines capable of handling a billion events daily and helping scale our machine learning infrastructure, Jampp might be the right place for you!
As a Data Engineer, you will design, build, and operate large-scale data infrastructure systems across all environments to store, aggregate, and process large amounts of data, creating our next-generation data infrastructure.
If you have strong development skills in Python and you feel challenged to work in a fast-paced environment, you might be the new Jampper we are looking for!
WHAT YOU'LL DO
- Contribute to the development of Jampp's data infrastructure by designing and building scalable distributed data processing systems.
- Design and implement ETL processes from a wide variety of sources.
- Work closely with Data Scientists to design and maintain scalable data models and their associated data pipelines.
- Contribute to guarantee data consistency and reliability among all Jampp's systems and machine learning inputs.
- Benchmark systems, analyze system bottlenecks, and track data quality and consistency, proposing solutions to improve them.
- Work creatively and analytically in a problem-solving environment.
- Build and evolve the tools that empower colleagues across the company to access data and build reliable and scalable transformations.
CURRENT CHALLENGES
- Write a unified data access layer that abstracts away regionality, underlying S3 layout, and table format technology
- Continuing to lower the latency and bridge the gap between our production systems and our data warehouse by rethinking and optimizing our core data ingestion jobs
- Create a robust and easy-to-use unit testing infrastructure for batch processing pipelines
- Build a framework and tools to re-architect data pipelines to run more incrementally
SOME NUMBERS
- We track over 50 billion in-app events per month
- Our Hadoop clusters can query over 600 TB of raw and processed data in S3
- Our Hadoop clusters process 3000+ ad hoc queries per day and 600+ ETL executions
WHAT WE LOOK FOR
At Jampp, we are committed to building teams that represent a variety of backgrounds and skills, as we believe that the more diverse we are, the better our work will be!
- 3+ years of programming experience in Python. Go is a plus!
- Experience designing and developing distributed systems for large-scale data processing.
- Hands-on experience using the AWS Big Data stack (Kinesis, EMR, Lambda, etc).
- Experience managing and working with TrinoDB/PrestoDB clusters.
- Experience developing productive applications on top of Docker, Kubernetes and PySpark.
- Rock-solid knowledge of databases and SQL.
- Familiarity with Databricks is a plus
- Getting deep into the open source community raising issues, pull requests and conversations is an extra!
- Feel very comfortable sharing knowledge and coaching more junior team members.
WHAT WE OFFER
- 📱Learn a ton about the hottest area of growth in Internet advertising - Mobile!
- 💰Competitive salary
- 📈 A great level of responsibility from day one and the chance to develop your potential without limitations.
- 💪🏼 An entrepreneurial environment.
- A dynamic remote-first work culture with the possibility of accessing coworking spaces as needed.
- 🤓 A structured remote onboarding process and continuous training with a supportive team. We win together!
- Work with a talented global team that you can constantly learn from! We have jamppers from 🇧🇷🇬🇧🇺🇸🇮🇪🇫🇷🇩🇪🇦🇷🇷🇺... our customers are not the only ones from around the globe 😉
- 😎 Cool swag and team activities (even when working from home!)
WHO WE ARE
Jampp is the programmatic growth engine behind some of the world's most ambitious mobile businesses. Founded in 2013, Jampp leverages machine learning, creative optimization, and proprietary advertising solutions to drive incremental growth for industry leaders like Uber, Just Eat Takeaway.com, FREENOW, Rappi, and BIGO Live.
Our journey has been remarkable—from rapidly expanding our global presence across 10+ countries and assembling an exceptional team of 100+ mobile growth experts to becoming part of the Affle group, a publicly listed consumer intelligence technology company. Today, Jampp is consistently recognized as a top-tier mobile performance partner by the industry’s leading MMPs, featured across 10 categories in Singular’s ROI Index and consistently ranked as a top-10 performer in AppsFlyer’s Performance Index.
Join us and be part of the next chapter in mobile growth.