Big Data DevOps Engineer @ING Tech in Bucuresti

Discover ING TechING Tech Romania is ING’s global hub for technology established in 2015. Focused on building strategic key capabilities, the hub provides approximately 121 services for 24 ING units globally. These services are grouped in the following main categories: software development; data management; non-financial risk & compliance and audit. Now, in 2021, our fast-growing organization gathers more than 1000 high-performing engineers and non-financial risk & compliance specialists that work together in global tribes.The Mission:Data is a game-changer. It’s all around us. Implementing a uniform approach as to how we manage data throughout the bank allows us to enhance the customer experience, lower IT operational costs, and swiftly and correctly report to external regulators. You will be responsible for the smooth functioning of the infrastructure and operational environments that support application/solution developing and deployment, including the network infrastructure, server and software management. You will also be responsible for development of new tools or functionalities for system improvement.Your Day-to-DayContributing to the design, implementation and lifecycle management of Data Lake by:- Administration, operation and deployment of big data clusters in private cloud environment- Automate deployment, testing and configuration for Hortonworks and Cloudera platforms (CDP(7.1.7.6 , HDP 3.5 and HDF 3.5) via Ansible and Azure DevOps pipelines- Implementing and configuring new components in existing clusters based on end user requirements (Atlas, Impala, Hue, etc.)- Migrate existing data and flows from legacy HDP/HDF clusters to CDP/CDF platforms - Optimization and automation of workflows and activities- Tune configuration to optimize cluster performance and ensure high availability of services- Fault Management, Problem Management, Incident Management which include oncall duties outside business hours. Fault handling and corrective actions (troubleshooting, reporting and improvement plan)- Develop, test and optimize custom in house big data applications via Python - Provide work instructions and improvements of the processesTools used in your day by day activities:Big data: Apache Hadoop (Ambari, Cloudera Manager, HDFS, Ranger, Hive, Spark, Nifi, etc.)OS : Red Hat Enterprise Linux Server 7&8Databases : Hive and PostgreSQLCI/CD: Azure DevOps pipelines + AnsibleVersioning: GITMonitoring : ELK stackWhat you bring to the team- In depth experience in administrating, tuning and debugging Hadoop ecosystems- In depth experience in administrating, tuning and debugging Linux OS (RHEL)- In depth experience with Ansible and Python- Experience with Azure DevOps CI/ CD tools is a plus- Experience with Hive databases best practices- Experience with Agile - Scrum methodologyNice to have : Experience working with real time streamingExperience in behavior driven development is a plusExperience with creating/editing/debugging Nifi flowsInvolvement in open source projectsWhat’s in it for you:Flexible working schedule, which usually includes two days of WFH, but we can adapt to any situation, we work fully remote for the moment;Extra vacation days, depending on your entire working experience;We encourage personal and professional development, so we invest in your learning by putting at your disposal a budget for trainings, workshops and certifications;Because everybody is working from home and we really understand that is not always easy, we have built an online well-being programme that can help you manage this stressful period;We also have cool communities and your colleagues will help you to integrate fast;We support each other, and we share our work and passions on an online Tech Neighbourhood; A relaxing environment will be awaiting for you back at the office, with a flexible desk policy that allows you to work from an office desk, but also from a couch or from the terrace;And when you will need a break, you can have a tea from Teapigs and/or a coffee from Nespresso which you can enjoy while reading a book from Bookster.