Designs and maintains AWS data architectures, ETL/ELT pipelines, data warehouses, analytics datasets, dashboards, and visualization solutions. Uses SQL, Python, Spark, Glue, Lambda, S3, Athena, Redshift, and QuickSight to prepare, transform, validate, and govern data. Collaborates with product, engineering, and operations teams, optimizing performance, cost, scalability, and data quality while integrating data systems with AI and natural-language query tools.
About QualMinds:
We at QualMinds design & develop world-class digital products and custom software for Startups, Scale- ups & Enterprises with our world-class engineering team. We assemble a great team of frontend, backend, full-stack, QA automation, UI/UX, DevOps, data science, machine learning, and agile experts to help our clients propel their pursuit of digital excellence. Our engineering community at QualMinds is always passionate about building customer-centric software with the highest quality, performance, security, scalability, and lowest failure rates.
Role Overview:
The AWS Data Engineer will support the design, development, and maintenance of reporting and analytics solutions. This includes building dashboards and reports, preparing and validating data for analysis, supporting data models and pipelines, and working with cross-functional teams to turn business questions into clear, actionable insights.
Core Technical Responsibilities:
- Design and maintain scalable data architectures on AWS.
- Build and manage data pipelines (ETL/ELT) using AWS Glue, Lambda, S3, and Athena.
- Model and optimize data warehouses (primarily Amazon Redshift).
- Implement and manage data visualization and self-service analytics (e.g., AWS QuickSight).
- Develop and maintain data transformation processes using SQL, Python, and Apache Spark.
- Establish and enforce data governance, documentation, and data quality standards.
- Optimize data performance, cost efficiency, and scalability across environments.
- Collaborate with product, engineering, and operations teams to deliver analytics-ready datasets.
- Integrate data systems with AI tools for natural language and dashboarding functionality.
Required Technical Skills:
- 2+ years in Business Intelligence reporting preferably AWS QuickSight.
- Deep expertise in AWS data stack (Redshift, Glue, Lambda, S3, Athena).
- Strong SQL and Python skills for data manipulation and automation.
- Experience with Apache Spark for large-scale data processing.
- Experience with data visualization tools, preferably AWS QuickSight.
Preferred Skills:
- Experience in startups or fast-scaling tech environments.
- Familiarity with workflow orchestration tools (e.g., Airflow, Step Functions).
- Understanding of AI/ML data interfaces or natural language query tools.
QualMinds Hyderabad, Telangana, IND Office
1st Floor, Maximus Towers 2B,Raheja Mindspace,, HITEC City, Hyderabad, Telangana 500081, HI-Tech City, , Hyderabad, Telangana , India, 5000081
Similar Jobs
Insurance • Software
Build and maintain scalable AWS data platforms, pipelines, storage, orchestration, and infrastructure using Python, SQL, Terraform, Snowflake, Airflow, dbt, and related tools. Implement observability, data quality, governance, access controls, lineage, and cost optimization. Deploy containerized services, support streaming integrations, troubleshoot platform issues, and collaborate with senior engineers and cross-functional data teams.
Top Skills:
AirbyteAmazon AuroraAmazon EcsAmazon EksAmazon KinesisAmazon MwaaAmazon RdsAmazon S3Apache AirflowAWSAws IamAws LambdaClaudeCortex CodeDbtDbt CloudDockerGitGithub ActionsKafkaKubernetesPythonSnowflakeSQLTerraform
Big Data • Cloud • Analytics • Consulting
Design, develop, optimize, and maintain scalable AWS data processing and ETL/ELT pipelines using Python, PySpark, Apache Spark, and SQL. Responsibilities include data extraction, transformation, validation, performance tuning, integration across databases, APIs, and cloud storage, monitoring, error handling, and data quality management. The role collaborates with engineering, architecture, analytics, and business teams while following Git, Agile, and software development best practices.
Top Skills:
AirflowSparkAWSAws GlueAzure Data FactoryCi/CdCsvDatabricksDelta LakeDockerGitJSONKafkaParquetPysparkPythonSpark SqlSQL
Information Technology
Lead development of an alarm-management ingestion, correlation, and rationalization engine for utility events. Define alarm schemas, asset and topology mappings, and sequence rules. Build low-latency processing for SCADA, ADMS, protection relay, and IED events using Kafka and Flink. Implement flood handling, deduplication, chattering detection, suppression, shelving, prioritization, and escalation. Tune performance for over 200 alarms per second, three-to-five-second event visibility, and operator guidance within 30 seconds.
Top Skills:
AdmsAmazon Api GatewayAmazon Aurora PostgresqlAmazon EventbridgeAmazon S3Amazon SnsApache FlinkAws GlueAws LambdaAws Step FunctionsConfluent KafkaIec 61968/61970 CimIec 62682Isa-18.2Kafka ConnectScadaSchema Registry
What you need to know about the Hyderabad Tech Scene
Because of its proximity to leading research institutions and a government committed to the city's growth, Hyderabad's tech scene is booming. With plans to establish India's first "AI city," the city is on track to become one of the world's most anticipated tech hubs, with companies like TransUnion, Schrödinger and Freshworks, among others, already calling the city home.
