Bangalore
Job Title: Data Engineer
Experience: 6+ Years
Location: Bangalore
Job Summary
We are seeking an experienced Data Engineer with 6+ years of experience in designing, developing, and supporting modern data engineering solutions. The ideal candidate will have strong expertise in Azure, Databricks, PySpark, SQL, Python, AI/ML, and production support. Experience in the Healthcare, Claims, or Payer domain is highly preferred.
Key Skills & Requirements
Data Engineering & Cloud
6+ years of experience in Data Engineering.
Strong hands-on experience with Microsoft Azure and Azure Data Services.
Expertise in Azure Data Factory (ADF), including pipelines, triggers, monitoring, and troubleshooting.
Strong experience with Azure Databricks.
Hands-on experience with Delta Tables, PySpark, and Spark SQL.
Experience with workflow orchestration tools such as Apache Airflow.
Database & SQL
Experience with Oracle and Snowflake databases.
Strong understanding of SQL-based RDBMS platforms.
Advanced SQL skills, including:
Complex joins
Query optimization and performance tuning
Analytical functions
Programming & AI/ML
Strong proficiency in Python (Mandatory).
Knowledge of additional programming languages such as Java or Scala is preferred.
Hands-on exposure to AI/ML technologies (Mandatory).
Experience with AI tools, AI Builder, ML pipelines, or analytics-driven use cases.
Production Support & Quality
Experience in production support and issue resolution.
Strong knowledge of incident management, RCA, and SLA adherence.
Experience in data validation, reconciliation, and testing.
Exposure to QA automation and data testing frameworks is preferred.
Preferred Qualifications
Experience working with Optum is preferred.
Strong experience in the Healthcare, Claims, or Payer domain.
Candidates with Optum experience should clearly mention the duration and role on their resume.
Must-Have Skills
Azure
Azure Data Factory (ADF)
Databricks / PySpark / Spark SQL
Python
Advanced SQL
AI/ML
Good-to-Have Skills
Apache Airflow
Oracle and Snowflake
Healthcare / Claims / Payer domain
Optum experience
Production Support & QA Automation
| Experience | 6 - 8 Years |
| Salary | Not Disclosed |
| Industry | IT Software - Application Programming / Maintenance |
| Qualification | |
| Key Skills | Azure Azure Data Factory ADF Azure Databricks Databricks PySpark Spark SQL Python Advanced SQL Delta Lake Apache Airflow Oracle Snowflake AIML ML Pipelines Production Support Healthcare Data |
(74)Sales & Marketing / Business D...
(53)IT Software - Application Prog...
(25)Engineering / Engineering Desi...
(24)Health Care / Pharmaceuticals ...
(17)HR / Recruitment / Administrat...
(15)Accounting / Auditing / Taxati...
(15)Manufacturing / Production / Q...
(13)Supply Chain / Purchase / Proc...
(13)Real Estate / Construction
(11)Financial Services / Banking, ...
(9)ITES / BPO / KPO / LPO / Custo...
(9)Education / Teaching / Trainin...
(8)IT Software - QA / Testing / D...
(8)Corporate Planning & Strategy ...
(7)IT Software - ERP / CRM / EDP ...
(7)Front Office / Reception / Com...
(7)IT Software - Ecommerce / Inte...
(6)Analytic and Business Intellig...
(5)Architecture / Interior Design
(4)Media / Entertainment / TV / ...
(4)IT Software - System Programmi...
(4)Cargo / Freight / Transportati...
(3)IT Software - Client Server
(3)Self Employed / Entrepreneur /...
(3)Fashion Designing & Merchandis...
(3)Marketing / Advertising / PR /...
(2)Legal / Law Services / Judicia...
(2)Hotel / Restaurants / Travel /...
(2)IT Software - Network Administ...
(1)IT Software - Mobile Technolog...
(1)IT Hardware / Technical Suppor...
(1)Oil & Filter
(1)Other
(1)IT Software - DataBase / Dataw...
View MoreRaise your Query
Hi! Simply click below and type your query.
Our experts will reply you very soon.