Senior Developer
Job description:
**Please note that Quantexa certification is required for the assignment.** **Roles/Responsibilities of the support team:** - Take in queries from the DROC team and understand the request/requirements - Be the first level of support - If the case cannot be resolved by oneself, triage/classify the issues and identify which team to reach out to - dev team/Nordea platform team - Track and report the progress to DROC and PO - Execute ETL runs on DROC validation on Hadoop infrastructure - Refresh UIs for DROC validation using elastic search - Support DROC to write spark/hive queries if needed to analyze a dataset - Support dev team and DROC team for config changes if specified by the relevant team. **Competences needed:** - Understand end to end ETL pipeline - Competent within data engineering principles: - Write Hive SQL (SPARK) queries (crucial) - SCALA knowledge (crucial) o Shell scripting (important) - How to work on Cloudera distribution (Oozie) (important) - Elasticsearch (basic knowledge) o Quantexa (important) - Familiar with but not needed to expert in: - IntelliJ - Zeppelin - Bamboo, Jenkins, Nexus, Artifactory, Kafka - Hands-on development experience (Java, Scala, etc.) via system integration projects - Quantexa certified - Upgrade experience - Fraud, financial crime, customer insight or compliance-based projects experience that utilize detection or predictive models - Familiarity with agile development methodology - Experience with projects involving statistical approaches or detection logic - Experience with data mapping, relational data and object orientation - Experience with data processing such as ETL as well as parsing and handling data quality related issues - Understanding of operational environments and DevOps processes - Development environment skills (code control, IDEs), and a solid understanding of development processes such as unit testing, design, and documentation - Hand-on experience with Hadoop, Spark and Scala - Ideally: Python, Elastic, Restful APIs JSON, Tomcat - Extensive us of external tools such as GIT and Jenkins