Data Engineer III - Fulfillment in Constanţa

Kubernetes (nice to have) CI/CD (regular) Scala (advanced) Spark (master) Kafka (master) Hadoop (master) Company Description Tesco Technology is multi-functional and specialist team that drives operational excellence of services improves scale for our systems and processes globally and creates business leading capabilities. We are an agile team of an industry-leading team of engineers. We create the future continuous integration and delivery tools for Colleague and Customer & Loyalty areas, solving problems, and developing new features through quality, scalable, performant, and maintainable technical solutions. The solutions that we are responsible for will have a global reach, impacting hundreds of thousands of Tesco colleagues worldwide. We operate in a DevOps philosophy. We take responsibility for the software through its entire lifecycle. We practice continuous integration, delivery, and support of our code through to production and beyond. As Tech Hub we cooperate within the group of Tesco Technology Hubs located in the UK, Poland, Hungary, and India. Job Description The Fulfillment Data department at Tesco Technology is at the forefront of data processing and order fulfillment within the retail and technology industry. This vital department handles a range of responsibilities, including: · Analyzing order and delivery data to optimize logistics processes and enhance delivery efficiency.· Managing critical data related to customer orders, suppliers, and products to ensure the seamless flow of our fulfillment operations.· Upholding data integrity and security during the processing of order and delivery-related information. We're expanding and actively seeking a skilled Data Engineer to enhance our data and pipeline architecture, optimizing data flow for cross-functional teams. Our ideal candidate is an experienced data pipeline builder and enthusiast who enjoys optimizing data systems. As a Data Engineer, you'll collaborate closely with various teams, ensuring consistent, optimal data delivery across all projects. This role requires self-direction and the ability to support data needs across teams, systems, and products. If you're excited about optimizing our data architecture for the future, we encourage you to apply and shape the future of our data operations. Responsibilities: Problem Solving & Technical Strategy: Address business problems, devise technical strategies (push vs. pull, real-time vs. batch, sync vs. async), and lead high-level design and implementationAutonomous Collaboration: Work independently with minimal guidance and collaborate effectively with cross-functional Software Development Engineers (SDEs)Exemplary Work: Demonstrate exemplary work in design, delivery, and coding processes, setting examples for the teamInfluence & Communication: Influence the team's technical and business strategy, communicate ideas effectively with stakeholders, and drive convergence for desired outcomesMentorship & Leadership: Proactively mentor the team, participate in hiring, and address design/architectural deficienciesDelivery & Process Improvement: Consistently lead the delivery of valuable features and propose/process improvementsRequirements & Programming: Elaborate on requirements when necessary and showcase deep knowledge of the chosen programming language and toolsetCode Proficiency: Implement critical components, optimize code, understand threading models, and comfortably use test-driven development (TDD) practicesDiverse Knowledge: Display knowledge of various programming languages, paradigms, and debugging skillsDesign Skills: Apply appropriate design patterns, develop large features, and understand idempotence, cohesion, SOLID principles, and domain modellingForward Thinking: Anticipate medium-term changes, understand simplicity and code removal, and apply design patterns like CQRS and eventual consistencyPerformance & Development Practices: Focus on automation, build CI/CD pipelines, automate security scanning, and performance testingInfrastructure Knowledge: Understand multiple operating systems, scripting techniques, databases, data storage paradigms, PaaS technologies, and infrastructure technologiesSecurity Awareness: Write secure code, utilize security tools, and understand server hardening practices Qualifications Mandatory skills: Hadoop hiveAny stream processingScalaSpark/PySpark Nice to have skills: Functional programmingKafka and basics of containerization/Kubernetes Additional information: Hybrid working We’ve recently moved to hybrid working. We love working from home, but we also love connecting, collaborating, and innovating with our colleagues in person. We meet in our office in Kraków for 2 days a week. Benefits Tesco is a diverse and exciting employer, dedicated to being #aplacetogeton, providing career-defining opportunities to all of our colleagues. If you choose to join our business, we will provide you with: · Permanent contract from the go – as a sign of our trust in your abilities· Up to 20% yearly salary bonus – for employment contract colleagues only – based on both individual and business performance· MacBook as your tool for work· Private healthcare (LuxMed)· Cafeteria & Multisport· Learning opportunities - certified technical training and learning platforms like Udemy, Pluralsight and O’reily.· Referral Bonus· Relocation Help If that sounds exciting, then we'd love to hear from you. #LI-AW1