Expert Data Engineer

Job description:

**💻 Ework Group** 
- founded in 2000, listed on Nasdaq Stockholm, with around 13,000 independent professionals on assignment 
- we are the total talent solutions provider who partners with clients, in both the private and public sector, and professionals to create sustainable talent supply chains.
With a focus on IT/OT, R&D, Engineering and Business Development, we deliver sustainable value through a holistic and independent approach to total talent management.
By providing comprehensive talent solutions, combined with vast industry experience and excellence in execution, we form successful collaborations. We bridge clients and partners & professionals throughout the talent supply chain, for the benefit of individuals, organizations and society.
🔹 For our Client from banking industry we are looking for **Expert Data Engineer**🔹
**Possible location in Poland :** Gdańsk, Gdynia, Łódź or Warsaw. (Hybrid work possible with 1 day/week office presence 
- once/twice per year physical presence in Gdynia/Gdańsk for quarterly PI Planning (2 days) may be required)
**Key responsibilities:**
* Building data systems and applications to support decision making processes.
* Developing and maintaining data pipelines in public clouds like AWS.
* Building distributed and highly parallelized Big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time
* Participating in data migration from on-premise to public clouds and building components for central enterprise data platforms.
* Leveraging Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics.
* Working closely with analysts and business stakeholders to develop analytics models
* Continuous delivering on Hadoop and other Big Data Platforms
* Automating processes where possible and are repeatable and reliable
* Working closely with QA team
**Must have skills:**
**To succeed in this role, we believe that you:**
* Are collaborative and achieve your expectations through communication and teamwork in Agile setup (SAFe Framework)
* Are curious, responsive and can understand the needs of others to ensure delivery of the desired results
* Work qualitatively and strive to always do things better
* Have a high level of self-motivation
**Your experience and background:**
As an Expert Data Engineer/Developer, you are expected to have:
* Experience in **Spark** & **Scala** 
- minimum 5 years
* Experience in **Python** 
- minimum 7 years
* Experience in **Linux** 
- minimum 5 years
* Experience with distributed data processing engines like **Spark**
* Experience with **Hadoop** and (**Hive**, **Oozie**, map reduce, YARN, EMR, Sqoop ect)
* Strong/Advanced **SQL** skills
* Previous experience in creating data flows
* **BitBucket** and **GIT** expert
* AWS certification or experience
* Unit testing Experience (**Junit** **5**, **Mockito**, **Spark testing**)
* Code versioning strategy & Branching strategy
* Advanced English skills
Contact person: aleksandra.rosikiewicz@eworkgroup.com
Client code: BN01
Do you know someone who would fit this position? Recommend a candidate by sending her/his CV to: polecenia@eworkgroup.com
Whistleblowing Policy, which provides guidelines for reporting misconduct can be found on Ework website: https://www.eworkgroup.com/about-us/our-responsibility

Be a part of our comminity

Join us on Telegram or Discord to get instant notifications about the newest freelance projects and talk to some of the smartest software engineers in the world.