Data Engineer III

Database Engineer III / Mid level Data Engineer has full accountability to design and develop rich data-driven frameworks, applications and services. This role will be responsible for development of applications on the Cloud platform and migration of existing on-premise data systems and processes to the Cloud, while also engaging with the Teams navigate through Technology stack evaluation and incubation of newer Cloud technologies. If you are that person, you'll help us continue to improve and innovate our Data Applications and Services, and we’ll help you grow!

Job responsibilities:

• Participate in the full software lifecycle (requirements, design, code, unit test, deployment, sustaining) for assigned modules
• Interact with Product Management to determine Product / Feature requirements and perform technical analysis

• Interact with Application & Analyst Teams to determine Data dependencies and perform technical analysis

• Acquire and maintain a clear understanding of the technologies used in Lytx’s products and services and help steer future technology vision
• Participate in scrum sprints with other developers, business users, and testers
• Other duties as assigned

Education requirements:

• Bachelor’s degree in computer science, computer information systems, or equivalent experience

Experience requirements:

• 6+ years of industry experience developing Data products and/or developing enterprise-scale Big Data solutions
• 3+ years’ experience in a senior developer role with focus in data Ingest, data processing and data publishing design
• 2+ years in design/development of high-volume high-throughput Data systems ranging from OLTP to data lake & data warehouse environments

• 2+ years of solid experience developing software products and/or developing enterprise-scale Data solutions on Cloud Platform

Technical expertise requirements:

Languages & Tools:

• 1+ years of experience with core Java, Java springboot is preferable

• Knowledge of IAC using terraform & terragrunt

Cloud Platform:

• Experience developing Data solutions on AWS platform is preferable

• Experience developing frameworks and point solutions for Data ingest, Data processing and Data publishing (AWS platform experience is preferable)

• Experience with building Streaming data solutions using Apache Kafka, Apache Flink, Apache Airflow or equivalent

• Experience with ingesting data using Kafka connect (AWS managed and/or confluent open source)

• Experience developing Data warehouse solutions on Redshift is preferable

Databases (RDBMS):

• Experience in SQL Server development, including high proficiency in writing and analyzing SQL/T-SQL, and developing/managing SSIS workloads is preferable

• SQL Server database performance management background is preferable
• Experience with alternate RDBMS technologies such as MySQL or PostgreSQL

Databases (no-sql):

• Experience with DynamoDB or MongoDB or Redis

Data APIs:

• Experience building RESTful interfaces is preferable

• Experience building graphQL API interfaces

CI & CD:

• Experience in an environment with continuous deployment, integration, automated testing

• Experience developing software using agile methodologies delivering solutions within bounded sprints

Production support:

• Ability to diagnose and decompose problems at the appropriate levels of the stack

• Ability to quickly resolve the problems, keeping in mind upstream and downstream systems dependencies, to bring systems to acceptable SLA levels 

• Ability to perform root cause analysis (RCA) and suggest & perform system changes accordingly