Data Quality Tester in Constanţa

SAP (nice to have) SQL (regular) Snowflake (regular) Azure / AWS (regular) DAX (regular) Power BI (regular) At Idego Group, you’ll work with people who find pleasure in programming and have deep knowledge about variety of technologies. You’ll work for our clients worldwide and provide support in great software development, including IoT, machine learning and blockchain related projects. You will work in a relaxed atmosphere using the latest technology, software and Agile methodology of project management. Simply, at Idego we are trying to provide the perfect conditions for work and personal development. The challenge is to build the data bridge between SAP & Snowflake ( AWS is basically a landing zone) - even if that doesn’t sound like a rocket science, those pipelines will be massive ( in storage 2-3 hundreds GB, daily GB estimated pipelines) We are currently setting up a POC of a favoured toolset. We will need to ingest the COPA module of SAP, probably using Fivetran and DBT, into a suitable data structure on Snowflake to build Datavault models and Power BI DAX models to support financial reporting. --------- The project is about building a proper data pipeline from SAP CO-PA system to the enterprise data platform, which is a BI & data analytics reporting system. 1. One of the problems is that a lot of the logic that is used in SAP was documented, neither at the SAP level nor at the database level. It was all done at the reporting level. So what has happened is that people are using particular financial metrics and don't know why. 2. Additionally, the old processes are heavy and large. The old SAP system, the old on-prem system, and the old connection between them. On the other hand, the cloud platform is a very new, modern data stack and new technologies. The current pipelines break down, and the quality is unreliable, leading to a lot of time spent fixing these problems. So at this point, the Data team is spending a lot of time fixing these problems, plus it affects the finance team, which has to do regulatory audits. Finance team - internal customer. Working closely with the accountants is needed to determine what the data model should look like, how it should be interpreted, and how it should be documented. There is also a governance team that also helps with documentation. The client is a very large publishing house in the UK, selling huge volumes of books, which involves working with various authors of these books and paying them a part of their salary. Estimating this is also problematic. The whole SAP data flow to reporting systems is not working properly. And again there is the aspect that no one knows what the data means, how it should be interpreted, and how it should be combined. So the client wants to build a proper, robust data platform in the cloud that can scale up and down as things change. Because sometimes there won't be a lot of data, but at certain times, like before school starts or before the holiday season, it's book-buying season, so the amount of data grows. The final product is a financial profitability report in Power BI and a financial model underneath, from which further reporting can be derived. In terms of technology:The client has all three major cloud platforms, but this team mainly uses AWS and Azure.Azure is there for Power BI reporting, Analysis Services and Azure Database (for DAX).But the vast majority of the technology stack is tied to AWS. They don't use AWS too much as components, except for Lambda and S3 Buckets.DBT tool will be used for SQL transformation.Confluence for documentation.No decision has yet been made on a specific integration tool. It will be either HVR from FiveTran or SNP Glue from SAP. This role will not be involved much. What perks are waiting for you:Work environment with zero micromanagement – we cherish autonomy.100% remote work (unless you want to work from our HQ Gdynia), recruitment & onboarding.100% paid holidays (24 working days) paid leave (2 weeks) if you feel sick or dizzy.Really cool seaside apartments available for free for both leisure & work.Experienced team from 8 to 15+ years in commercial projects.Unique memes channel.Private medical insurance (basic dental services included) and Multisport.We want you to join our team. We are neither the agency giving you projects from time to time, nor huge corporation where you are a “dev XYZ”. At Idego – you matter!