Data Engineer, Analytics & Data Management, Advertising Core ServicesWould you like to build highly available & performant data processing architectures for one of the largest data lakes in Amazon? Does Petabyte scale excite you?
The Analytics & Data Management (ADM) team owns the central data lake for Advertising unifying Petabytes of data generated across the Ads pipeline such as campaigns, ad-serving, billing, clicks, impressions and more into a single scalable repository. This is used across the organization to drive hundreds of thousands of complex queries for analysis, measurement and reporting decisions for our customers. The data lake enables customers such as data engineers, software engineers, business analysts, ML engineers, research scientists, economists and data experts to collect what they need via world-class self-service tools.
ADM is building the next version of its data lake for 5x growth. A Data Engineer on the ADM team has a unique opportunity to design and innovate for the Ads scale, work with like-minded SDEs/DEs to deliver robust and scalable data storage, streaming and BI infrastructure solutions all the while improving quality and discoverability of the data lake. Your work will encompass a comprehensive suite of distributed systems technologies, AWS products such as EMR, S3 and Athena, and frameworks such as Spark. You will create value that materially impacts the speed and quality of decision making across the organization resulting in tangible business growth.
Key job responsibilitiesEngage with key decision makers such as Product & Program Managers to understand customer requirements and brainstorm on solutionsDesign and deploy data solutions such as models, optimized storages and self-serve intelligence toolsEnsure testability, maintainability and low operational footprint for your codeParticipate in operational responsibilities with your teamInnovate on AWS technology to improve latency, reduce cost and operationsA day in the lifeFocus on core data engineering opportunities to guarantee high data quality and discoverabilityWork with a skilled team of engineers, managers and decision makers to consistently meet customer demandAutomate monitoring of solutions and systems and deliver operational controls to improve guarantees for our customersBuild frugal solutions that will help make Spektr data lake cost wise the leanest data lake in AmazonAbout the teamThe mission of the Analytics & Data Management (ADM) team is to provide data that helps the advertising organization make informed analyses and decisions for our customers and to determine and deploy investments for future growth via a set of central and unified products and services. Our team focuses on simplicity, usability, speed, compliance, cost efficiency and enabling high-velocity decision making so our customers can generate high quality insights faster.
We are a global team with presence across IN and NA.
BASIC QUALIFICATIONS3+ years of data engineering experienceExperience with data modeling, warehousing and building ETL pipelinesPREFERRED QUALIFICATIONSExperience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissionsExperience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
#J-18808-Ljbffr