Embark on an exciting journey into the realm of software development with 3Pillar!
We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries. If your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering!
Responsibilities:
- Understanding the business requirements
- Writing code and implementing the proposed solutions
- Versioning and change management
- Building and maintaining ETL processes
- Ensuring data quality
- Strong debugging skills to analyze and fix a defect in data process
- Should be a good team played and a great collaborator
Qualification:
- Demonstrated expertise with a minimum of 3+ years of experience as data engineer or similar role
- Advanced SQL skills and experience with relational and non-relational databases
- Should have worked on Elastic Search
- Strong exposure to write ETL
- Experience in Data collection from multiple sources and integrating based on business needs
- Familiarity with the AWS/GCP data engineering services
- Knowledge of AWS services viz., S3, Lambda,, GLUE ETL, Athena, RDS, Redshift, EC2
- Proficiency in the English language.
- Knowledge of BigQuery
- Exposure to Tableau, PowerBI
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Sr. Data Engineer will work on projects involving PySpark and Scala with a focus on data analysis and debugging. They will utilize their skills in Spark, GIT, and familiar CICD tools to manage the Big Data Application Life Cycle while ensuring efficient incident management using Control-M and Service Now.
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Responsible for data modeling, AI development, and optimizing data processes. Collaborate on digital outcomes and enhance data quality in healthcare solutions.
Top Skills:
Amazon NeptuneAmazon RedshiftApache AirflowApache NifiApache SolrAWSAzureDockerElasticsearchGoogle BigqueryGoogle Cloud PlatformHadoopInformaticaJavaKafkaKubernetesNeo4JPrefectPythonScalaSnowflakeSparkSQLTalend
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Manage data engineering projects focusing on AI and automation, develop AI models, optimize data pipelines, and lead data architecture efforts.
Top Skills:
Amazon NeptuneAmazon RedshiftApache AirflowApache NifiApache SolrAWSAzureDockerElasticsearchGoogle BigqueryGoogle Cloud PlatformHadoopInformaticaJavaKafkaKubernetesNeo4JPrefectPythonScalaSnowflakeSparkSQLTalend
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
