Data Engineering Lead Analyst - HIH - Evernorth
HIH - Hyderabad, India
INR 1431K-2000K (estimate) Senior-level Full Time
Tasks
- Build data catalogs
- Collaborate with AI and ML teams
- Design ETL data pipelines
- Develop ETL data pipelines
- Encrypt data
- Implement data quality checks
- Implement data security best practices
- Integrate Databricks with external data sources
- Maintain ETL data pipelines
- Manage metadata
- Monitor Databricks clusters
- Monitor data pipelines
- Optimize AWS cloud services for data storage and compute
- Orchestrate data workflows
- Process batch data with Spark
- Process real time data with Spark Structured Streaming
- Troubleshoot Databricks jobs
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS | AWS Cloud | Apache Spark | CI/CD | Cassandra | Databricks | DynamoDB | ETL | Memcached | MongoDB | MySQL | PostgreSQL | Python | Redis | Scala | Snowflake | Spark Structured Streaming | Structured Streaming
Education
N/A
Related jobs
-
Lead Consultant, Gen_AI Engineer with MCP server expertise! INR 2500K-4000KAWS | Agentic AI | Amazon SageMaker | Azure | Azure OpenAISenior-level Full TimeIndia-Bangalore5h ago
-
AWS Lead Data Engineer INR 2000K-2040KAWS | AWS Glue | AWS architecture | Agile methodology | Amazon AuroraSenior-level Full TimeGurugram, Haryana, India7h ago
-
Business Analytics Associate INR 825K-1044KAlteryx | Automation | Cause analysis | Dashboards | Data MiningMid-level Full TimeMumbai, Maharashtra, India7h ago
-
Lead Software Engineer - AWS, PySpark, BigData INR 2000K-2450KAWS | AWS CDK | AWS Lambda | Agile | AirflowSenior-level Full TimeHyderabad, Telangana, India8h ago
-
Senior Data Analyst INR 2516K-2829KAgile | Business Intelligence | Data Modeling | Data integration | Database DesignEmployee assistance program | Flexible time off | Medical insurance plans | Paid parental leave | Vacation and holiday leaveSenior-level Full TimeCHANDIGARH, India11h ago
-
Alternate data | Asset Quality | Asset Quality Analytics | Credit Risk | Credit policyAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Inclusive health benefitsExecutive-level Full TimeGurugram, India11h ago
-
Senior-level Full TimeChennai, TN, India12h ago
-
Senior Data Analyst INR 2516K-3356KData Mining | Data Modeling | Data segmentation | Decision Trees | ETLBirthday leave | Confidential Assistance Programme | Custom benefits package | FlexWork | Medical insuranceSenior-level Full TimeBangalore, India12h ago
-
Lead Data Scientist INR 2500K-3380KApache Spark | Boosted Trees | Deep learning | Graph Neural Networks | LightGBMBirthday leave | Employee assistance programme | Flexible benefits | Medical insurance | Parental leaveSenior-level Full TimeBangalore, India13h ago
-
Mid-level Full TimeBengaluru, KA, India13h ago
-
Azure DevOps | Business Intelligence | CI/CD | Data Assurance | Data ManagementSenior-level Full TimeKolkata DN 57, India18h ago
-
AVP Quantitative Analytics CCR Modeler INR 500K-800KBacktesting | Basel framework | C++ | CVA | Collateral modelingExecutive-level Full TimeMumbai, Nirlon Knowledge Park (BX) 9th …18h ago
-
Lead AI/Data Science Engineer INR 2100K-3220KAnomaly Detection | CE Compliance | Computer Vision | DICOM | Data AugmentationFlexible benefits packageSenior-level Full TimeIND-TS Hyderabad Nanakramguda, India18h ago
-
AI/Data Science Engineer II INR 1100K-1890KAWS | AWS Glue | AWS S3 | Agentic Systems | AlertingFlexible benefits package | Short term incentive called Medtronic Incentive PlanMid-level Full TimeIND-TS Hyderabad Nanakramguda, India18h ago
-
Senior-level Full TimeHyderabad TS IN 26, India18h ago
-
Lead Developer (SQL,Python) INR 2500K-3380KAWS | Cost Optimization | DBT | Data Modeling | Data QualitySenior-level Full TimeVirtual Office (Telangana), India R18h ago
-
Group Audit – Analytics Senior Analyst INR 2105K-2572KAgile | Apache Hadoop | Cloud SQL | Cloud platform | Data ScienceAccident insurance | Best in class leave policy | Childcare reimbursement | Employee assistance program | Gender neutral parental leaveSenior-level Full TimeMumbai Nirlon Knowledge Pk B1, India18h ago
-
Sourcing and Procurement Analytics - Lead INR 1000K-2040KDashboard Development | Data Analysis | Data Quality | Excel | Financial ModelingCollaborative workspaces | On-site clinic | On-site gymSenior-level Full TimeBengaluru, India18h ago
-
Palantir Lead INR 1500K-2400KAPI Integration | AWS | Access Control | Apache Spark | Batch Data ProcessingSenior-level Full TimePune, India18h ago
-
Business Intelligence | Hadoop | Hive | Impala | Power BIEntry-level Full TimeGurgaon, India18h ago
-
AI machine learning | Azure | Azure Data | Azure Data Services | Cloud NativeFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportExecutive-level Full TimeBengaluru Millenia, India18h ago
-
Azure DevOps | CI/CD | SQLFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India18h ago
-
Director, Data Engineering, ITC INR 1500K-3000KAWS | Airflow | Analytics enablement | Azure | Batch ProcessingExecutive-level Full TimeINDIA TECHNOLOGY CENTER, India18h ago
-
Principal Data Engineer INR 1200K-2000KData Engineering | Data Modeling | Data Operations | Data Quality | Data SecuritySenior-level Full TimeIND-Bangalore, India18h ago
-
Senior Lead Business Intelligence Analyst INR 2520K-3440KAI/ML | AIOps | AWS SAM | Agile | Amazon Web ServicesSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …18h ago