Sr. Big Data Engineer

Company Description
At ServiceNow, our technology makes the world work for everyone, and our people make it possible. We move fast because the world can't wait, and we innovate in ways no one else can for our customers and communities. By joining ServiceNow, you are part of an ambitious team of change makers who have a restless curiosity and a drive for ingenuity. We know that your best work happens when you live your best life and share your unique talents, so we do everything we can to make that possible. We dream big together, supporting each other to make our individual and collective dreams come true. The future is ours, and it starts with you.
With more than 7,700+ customers, we serve approximately 85% of the Fortune 500®, and we're proud to be one of FORTUNE 100 Best Companies to Work For® and World's Most Admired Companies™.
Learn more on Life at Now blog and hear from our employees about their experiences working at ServiceNow.
Unsure if you meet all the qualifications of a job description but are deeply excited about the role? We still encourage you to apply! At ServiceNow, we are committed to creating an inclusive environment where all voices are heard, valued, and respected. We welcome all candidates, including individuals from non-traditional, varied backgrounds, that might not come from a typical path connected to this role. We believe skills and experience are transferrable, and the desire to dream big makes for great candidates.
Job Description
What you get to do in this role:
Interact with stakeholders in departments across the company, identify opportunities for Data Engineering to enhance our business, match the optimal techniques to the specific business need, and then build the models that get the job done. This is an opportunity for the right candidate to go from end-to-end in the process, from recognizing a problem to implementing the solution, and integrating it with the business teams. You will:

• Solicit requirements for Data Engineering models, including what data they will use and how the company will use them after they are built
• Build Big Data Analytics and Visualization platform for handling high-volume batch-oriented and real-time data streams.
• Help with building big data deployment infrastructure
• Work on ETL and high-volume real-time data pipeline
• Work on Rest API Layer to support analytical/ui requirements
• Analytics built on top of Python

Qualifications
To be successful in this role you have:

• Successful project experience in Data Engineering in an Enterprise setting.
• Hands-on Expertise with Java 8, Spring Boot Programming
• Good understanding of Object-Oriented methodologies, design patterns and data structures
• Excellent working knowledge of Cloudera CDH Tech stack : Apache Spark, Hdfs, Hbase, Hive, impala, kudu and Parquet along with Kafka
• Excellent hands-on experience with shell scripts and SQL including performance tuning utilizing indexes/partitions
• Should have hands-on experience and knowledge of spark programming both batch and streaming and should have working knowledge of ETL programming.
• Experience working on Hadoop Cloudera distribution and has conceptual understanding of Cloudera Administration and Management.
• Good understanding of streaming technologies and real time analytics
• Exceptional debugging, testing and problem solving skills
• Ability to learn quickly in a fast-paced, dynamic team environment
• Highly effective communication and collaboration skill
• BS or MS Degree in Computer Science or equivalent experience.
• 5+ years of overall experience with at least 1 in big data end-to-end implementation.

Desired Skills:

• Experience on Cloudera CDP environment
• Good to have working and conceptual knowledge of data cleaning and preparation methods prior to building ML models.
• Fundamental knowledge of Python Programming and usage of packages like Pandas/Numpy should help here.

FD21
Additional Information
ServiceNow is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status or any other category protected by law.
At ServiceNow, we lead with flexibility and trust in our distributed world of work. Click here to learn about our work personas: flexible, remote and required-in-office.
If you require a reasonable accommodation to complete any part of the application process, or are limited in the ability or unable to access or use this online application process and need an alternative method for applying, you may contact us at [email protected] for assistance.
For positions requiring access to technical data subject to export control regulations, including Export Administration Regulations (EAR), ServiceNow may have to obtain export licensing approval from the U.S. Government for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by the U.S. Government.
Please Note: Fraudulent job postings/job scams are increasingly common. Click here to learn what to watch out for and how to protect yourself. All genuine ServiceNow job postings can be found through the ServiceNow Careers site .
From Fortune. © 2022 Fortune Media IP Limited All rights reserved. Used under license.
Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of, ServiceNow.