We are looking for a talented and experienced Hadoop and Spark developer with exposure to Market risk domain for one of our Global Investment Banking Clients

• Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand

• Implementing software components in Java, Scala and Python languages

• Consulting with various data warehousing engagement, handling large data volumes, architecting big data environments

• Designing, developing, testing, tuning, and building a large-scale data processing system, for Data Ingestion and Data products that allow the Client to improve quality, velocity, and monetization

• Architecting and crafting new features or improvements

• Full ownership and delivery accountability of the assigned Epics/Stories/Task

Strong programming skills in one of the mainstream programming languages. Preferred would be Java SE

• Excellent hands-on application development experience on Python

• Excellent hands-on with Spark core and Spark SQL using Scala

• Strong knowledge of Big Data querying tools, such as Hive, Impala, Kudu, etc.

• Proven understanding of YARN, Sqoop, and at least one orchestration tool like Oozie

• Large-scale distributed data analytic platforms and compute environments (Spark, Impala, etc.)

• Distributed file systems and storage technologies (HDFS, HBase, Hive)

• Hands on with Git, Jenkins, SQL and Linux/Unix shell scripts

• Assist in the evaluation of new solutions for integration into the Hadoop Roadmap/Strategy • Experience in Data Modeling and ML pipelines on Big Data landscape

• Proven understanding of Control-M (application and data workflow orchestration solution)

• Understanding of visualization tools like QlikView/QlikSense and CI/CD profile- Jenkins, TeamCity, Git, Docker, etc. Very desirable

• Knowledge/exposure of Microsoft Azure

• Good understanding of the software development lifecycle (SDLC) and agile methodologies