Software Engineer III - BigData Engineer (Cloud)

Job Description
There's nothing more exciting than being at the center of a rapidly growing field in technology and applying your skillsets to drive innovation and modernize the world's most complex and mission-critical systems.
As a Software Engineer III at JPMorgan Chase within the Corporate Technology, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives..
Job responsibilities

• Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
• Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
• Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
• Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
• Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture.
• Develop, test, and maintain data and analytics needed for risk and finance models
• Process analysis and process improvement,create and maintain technical documentation,
• Contribute to the group's knowledge base by finding new and valuable ways to approach problems and projects.
• Experience manipulating and summarizing large quantities of data.
• Knowledge of the consumer lending lifecycle, including loan origination, sale/servicing, default management/loss mitigation
• Collaborate with the appropriate individuals (LOB users, Subject Matter Experts, Architects, DBAs, etc.) to design and implement the appropriate solution

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 3+ years applied experience..
• 8+ years of professional development experience on any of the programming language e.g. pySpark, scala, Python, big data tech stack, unix, shell scripting etc
• Solid understanding of object oriented design, data structures, and algorithms
• Should have good hands on experience in working with Hadoop Distribution platform like Cloudera, Hortonworks, and advanced knowledge and experience in Bigdata Hadoop components Spark, Hive and Impala.
• Should have experience in managing large Machine Learning Platform with petabytes of storage to develop and train the Machine Learning Models using Python, and support advanced Machine Learning tools like XgBoost, Tensorflow, Dask and Anaconda Packages like Pandas, Mathplotlib, Numpy, Scipy etc.
• Should have experience in creating the platform design and onboarding for Bigdata environment and managing a large cluster with huge user base to support the platform activities. Also should have experience in planning and onboarding infrastructure needs like Cluster Compute, VSIs, NAS Storage to support the busines use cases across different LOBs.
• Should have experience in setting up the platform controls and governance process by designing user access controls, Hadoop permissions and Sentry roles, and Unix Keon and Sophia roles. Also should have experience in installing new tools or packages in line with firm wide control process for Machine Learning Model Development in Bigdata platform.
• Should have good understanding and knowledge in design, development and support of the Machine Learning Models using the Graph Database. Should have knowledge in Graph database software installation, configuration and upgrades, and also in troubleshooting performance bottlenecks and query optimization.
• Should have good understanding and knowledge in planning and managing AWS Cloud infrastructure, and enabling necessary platform security by using best in class Cloud Security Solutions. Also should have hands on experience in migrating Spark applications from Bigdata Hadoop platform to AWS Cloud using AWS EMR, S3 Buckets, EBS and EC2 Instances.
• Should have experience in the platform monitoring tools like Geneos for monitoring the server utilization and in setting up the thresholds and performance alerts. Should have hands on experience in developing automation scripts using Python and Unix Shell Scripting.

Preferred qualifications, capabilities, and skills

• Good knowledge on Cloud technology

About Us
J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world's most prominent corporations, governments, wealthy individuals and institutional investors. Our first-class business in a first-class way approach to serving clients drives everything we do. We strive to build trusted, long-term partnerships to help our clients achieve their business objectives.
We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.
About the Team
Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we're setting our businesses, clients, customers and employees up for success.