Data Engineering Lead Analyst - HIH - Evernorth
HIH - Hyderabad, India
INR 1431K-2000K (estimate) Senior-level Full Time
Tasks
- Build data catalogs
- Collaborate with AI and ML teams
- Design ETL data pipelines
- Develop ETL data pipelines
- Encrypt data
- Implement data quality checks
- Implement data security best practices
- Integrate Databricks with external data sources
- Maintain ETL data pipelines
- Manage metadata
- Monitor Databricks clusters
- Monitor data pipelines
- Optimize AWS cloud services for data storage and compute
- Orchestrate data workflows
- Process batch data with Spark
- Process real time data with Spark Structured Streaming
- Troubleshoot Databricks jobs
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS | AWS Cloud | Apache Spark | CI/CD | Cassandra | Databricks | DynamoDB | ETL | Memcached | MongoDB | MySQL | PostgreSQL | Python | Redis | Scala | Snowflake | Spark Structured Streaming | Structured Streaming
Education
N/A
Related jobs
-
Senior-level Full TimePune, India3h ago
-
Lead Consultant, Gen_AI Engineer with MCP server expertise! INR 2500K-4000KAWS | Agentic AI | Amazon SageMaker | Azure | Azure OpenAISenior-level Full TimeIndia-Bangalore6h ago
-
AWS Lead Data Engineer INR 2000K-2040KAWS | AWS Glue | AWS architecture | Agile methodology | Amazon AuroraSenior-level Full TimeGurugram, Haryana, India8h ago
-
Business Analytics Associate INR 825K-1044KAlteryx | Automation | Cause analysis | Dashboards | Data MiningMid-level Full TimeMumbai, Maharashtra, India9h ago
-
Lead Software Engineer - AWS, PySpark, BigData INR 2000K-2450KAWS | AWS CDK | AWS Lambda | Agile | AirflowSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Senior Data Analyst INR 2516K-2829KAgile | Business Intelligence | Data Modeling | Data integration | Database DesignEmployee assistance program | Flexible time off | Medical insurance plans | Paid parental leave | Vacation and holiday leaveSenior-level Full TimeCHANDIGARH, India12h ago
-
Alternate data | Asset Quality | Asset Quality Analytics | Credit Risk | Credit policyAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Inclusive health benefitsExecutive-level Full TimeGurugram, India13h ago
-
Senior-level Full TimeChennai, TN, India13h ago
-
Senior Data Analyst INR 2516K-3356KData Mining | Data Modeling | Data segmentation | Decision Trees | ETLBirthday leave | Confidential Assistance Programme | Custom benefits package | FlexWork | Medical insuranceSenior-level Full TimeBangalore, India13h ago
-
Lead Data Scientist INR 2500K-3380KApache Spark | Boosted Trees | Deep learning | Graph Neural Networks | LightGBMBirthday leave | Employee assistance programme | Flexible benefits | Medical insurance | Parental leaveSenior-level Full TimeBangalore, India14h ago
-
Mid-level Full TimeBengaluru, KA, India15h ago
-
Azure DevOps | Business Intelligence | CI/CD | Data Assurance | Data ManagementSenior-level Full TimeKolkata DN 57, India19h ago
-
AVP Quantitative Analytics CCR Modeler INR 500K-800KBacktesting | Basel framework | C++ | CVA | Collateral modelingExecutive-level Full TimeMumbai, Nirlon Knowledge Park (BX) 9th …19h ago
-
Lead AI/Data Science Engineer INR 2100K-3220KAnomaly Detection | CE Compliance | Computer Vision | DICOM | Data AugmentationFlexible benefits packageSenior-level Full TimeIND-TS Hyderabad Nanakramguda, India19h ago
-
AI/Data Science Engineer II INR 1100K-1890KAWS | AWS Glue | AWS S3 | Agentic Systems | AlertingFlexible benefits package | Short term incentive called Medtronic Incentive PlanMid-level Full TimeIND-TS Hyderabad Nanakramguda, India19h ago
-
Senior-level Full TimeHyderabad TS IN 26, India19h ago
-
Lead Developer (SQL,Python) INR 2500K-3380KAWS | Cost Optimization | DBT | Data Modeling | Data QualitySenior-level Full TimeVirtual Office (Telangana), India R19h ago
-
Group Audit – Analytics Senior Analyst INR 2105K-2572KAgile | Apache Hadoop | Cloud SQL | Cloud platform | Data ScienceAccident insurance | Best in class leave policy | Childcare reimbursement | Employee assistance program | Gender neutral parental leaveSenior-level Full TimeMumbai Nirlon Knowledge Pk B1, India19h ago
-
Sourcing and Procurement Analytics - Lead INR 1000K-2040KDashboard Development | Data Analysis | Data Quality | Excel | Financial ModelingCollaborative workspaces | On-site clinic | On-site gymSenior-level Full TimeBengaluru, India19h ago
-
Palantir Lead INR 1500K-2400KAPI Integration | AWS | Access Control | Apache Spark | Batch Data ProcessingSenior-level Full TimePune, India19h ago
-
Business Intelligence | Hadoop | Hive | Impala | Power BIEntry-level Full TimeGurgaon, India19h ago
-
AI machine learning | Azure | Azure Data | Azure Data Services | Cloud NativeFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportExecutive-level Full TimeBengaluru Millenia, India19h ago
-
Azure DevOps | CI/CD | SQLFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeKolkata DN 57, India19h ago
-
Director, Data Engineering, ITC INR 1500K-3000KAWS | Airflow | Analytics enablement | Azure | Batch ProcessingExecutive-level Full TimeINDIA TECHNOLOGY CENTER, India19h ago
-
Principal Data Engineer INR 1200K-2000KData Engineering | Data Modeling | Data Operations | Data Quality | Data SecuritySenior-level Full TimeIND-Bangalore, India19h ago