Data Engineering Lead Analyst - HIH - Evernorth
HIH - Hyderabad, India
INR 1431K-2000K (estimate) Senior-level Full Time
Tasks
- Build data catalogs
- Collaborate with AI and ML teams
- Design ETL data pipelines
- Develop ETL data pipelines
- Encrypt data
- Implement data quality checks
- Implement data security best practices
- Integrate Databricks with external data sources
- Maintain ETL data pipelines
- Manage metadata
- Monitor Databricks clusters
- Monitor data pipelines
- Optimize AWS cloud services for data storage and compute
- Orchestrate data workflows
- Process batch data with Spark
- Process real time data with Spark Structured Streaming
- Troubleshoot Databricks jobs
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS | AWS Cloud | Apache Spark | CI/CD | Cassandra | Databricks | DynamoDB | ETL | Memcached | MongoDB | MySQL | PostgreSQL | Python | Redis | Scala | Snowflake | Spark Structured Streaming | Structured Streaming
Education
N/A
Related jobs
-
Business Analyst (Remote) INR 1800K-2400KAWS | Azure | Confluence | Data Modeling | Data QualityRemote workMid-level Full TimeGurgaon, India R5h ago
-
Mid-level Full TimeMumbai, Maharashtra, India7h ago
-
Analytics Solution Associate INR 800K-1100KAWS | Alteryx | Data Quality | Data Visualization | Data analyticsMid-level Full TimeMumbai, Maharashtra, India7h ago
-
Lead Software Engineer - Big Data INR 2040K-3380KAmazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache ParquetSenior-level Full TimeMumbai, Maharashtra, India10h ago
-
Lead Software Engineer - Java, AWS, GraphSQL, Data science INR 2500K-4500KAWS | Amazon ECS | Amazon EKS | Application Resiliency | CI/CDSenior-level Full TimeHyderabad, Telangana, India11h ago
-
Mid-level Full TimeMumbai, Maharashtra, India12h ago
-
Analytics Solutions Associate - Data Strategy INR 800K-1250KAWS Databricks | AWS Redshift | Data Governance | Data Privacy | Data QualityMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Strategy Analytics, Auto Risk Data and Reporting, VP INR 3300K-4000KData Governance | Data Quality | Data Visualization | Power BI | Project ManagementExecutive-level Full TimeBengaluru, Karnataka, India13h ago
-
Senior Analytics Analyst INR 2520K-3380KClustering | Dashboarding | Data Preprocessing | Data Quality | Data WranglingCollaborative team environment | Cross-functional collaboration | Hybrid work modelSenior-level Full TimeBangalore, KA, IN17h ago
-
Senior Analyst, Data Science & Analytics INR 2755K-3380KAWS | Azure | Cloud Computing | Deep learning | Distributed ComputingConferences and seminars | Flexible time off | Tuition reimbursement | Workplace flexibilitySenior-level Full TimePune, India17h ago
-
Data Analytics and AI Solutions Lead INR 3150K-4500KAutomation platforms | Copilots | Dashboarding | Data Governance | Data ProcessingSenior-level Full TimeIndia - Hyderabad17h ago
-
Analytics | Clickstream Data | Cloud platform | Dashboard Development | Data LakesSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India17h ago
-
Finance Data Analyst INR 2800K-4000KData Integrity | Data Modeling | Data Visualization | ERP | Payroll accountingSenior-level Full TimeIndia - Hyderabad17h ago
-
Amazon Redshift | Apache Airflow | Application Programming | Application Programming Interfaces | AzureSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India17h ago
-
Senior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …17h ago
-
Data Science Analyst INR 1800K-2146KBERT | Data Visualization | Deep learning | Fine Tuning | Hugging FaceSenior-level Full TimeAMRUTHAHALLI, NH 7,INTERNATION, India17h ago
-
SMTS/LMTS - AI ML Engineers INR 2000K-4500KCloud Native | Context engineering | Continuous Deployment | Continuous integration | Data Pipelines1 to 1 coaching | Adoption Assistance | Fertility benefits | Generous parental leave | Health and well being reimbursementSenior-level Full TimeIndia - Bangalore17h ago
-
Senior Quantitative Analyst INR 2535K-4225KAnalytics | Credit research | Equity research | Investment research | MATLABSenior-level Full TimeMumbai, India17h ago
-
Advanced Analytics Analyst INR 2100K-2700KAI Builder | Copilot | DAX | Data Modeling | Data TransformationFlexible benefits package | Short-term incentive planSenior-level Full TimeIND-TS Hyderabad Nanakramguda, India17h ago
-
Manager - Data Analysis INR 800K-1200KAgile | Azure DevOps | Dashboards | Data Analysis | Data QualityFlexible working | Inclusive work culture | Wellbeing supportMid-level Full TimeBangalore Karle Town SEZ, India17h ago
-
AI/Data Science Engineer II INR 2520K-3380KAWS | Apache Spark | Azure | Cloud platform | Data ControlsFlexible benefits package | Short-term incentive planSenior-level Full TimeIND-TS Hyderabad Nanakramguda, India17h ago
-
Model Risk Quantitative Analyst, VP INR 4055K-5849KC# | Derivatives pricing | FX derivatives | Model Risk Valuation Adjustment | Model riskInclusive team | Purpose-driven role | Purpose-led workExecutive-level Full TimeBengaluru, India17h ago
-
AIML - Tech Lead INR 2500K-4500KApache Airflow | ETL | Entity recognition | Language Processing | Machine LearningSenior-level Full TimeIN-MH-Pune1d ago
-
Data Analyst INR 346K-346KData Analysis | Data Visualization | Data Warehouse | Database Development | ETLEntry-level Full TimeGurugram, HARYANA, India1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago