Data Engineering Lead Analyst - HIH - Evernorth
HIH - Hyderabad, India
INR 1431K-2000K (estimate) Senior-level Full Time
Tasks
- Build data catalogs
- Collaborate with AI and ML teams
- Design ETL data pipelines
- Develop ETL data pipelines
- Encrypt data
- Implement data quality checks
- Implement data security best practices
- Integrate Databricks with external data sources
- Maintain ETL data pipelines
- Manage metadata
- Monitor Databricks clusters
- Monitor data pipelines
- Optimize AWS cloud services for data storage and compute
- Orchestrate data workflows
- Process batch data with Spark
- Process real time data with Spark Structured Streaming
- Troubleshoot Databricks jobs
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS | AWS Cloud | Apache Spark | CI/CD | Cassandra | Databricks | DynamoDB | ETL | Memcached | MongoDB | MySQL | PostgreSQL | Python | Redis | Scala | Snowflake | Spark Structured Streaming | Structured Streaming
Education
N/A
Related jobs
-
Mid-level Full TimeMumbai, Maharashtra, India4h ago
-
Analytics Solution Associate INR 800K-1100KAWS | Alteryx | Data Quality | Data Visualization | Data analyticsMid-level Full TimeMumbai, Maharashtra, India5h ago
-
Lead Software Engineer - Big Data INR 2040K-3380KAmazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache ParquetSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Lead Software Engineer - Java, AWS, GraphSQL, Data science INR 2500K-4500KAWS | Amazon ECS | Amazon EKS | Application Resiliency | CI/CDSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Mid-level Full TimeMumbai, Maharashtra, India10h ago
-
Analytics Solutions Associate - Data Strategy INR 800K-1250KAWS Databricks | AWS Redshift | Data Governance | Data Privacy | Data QualityMid-level Full TimeBengaluru, Karnataka, India10h ago
-
Strategy Analytics, Auto Risk Data and Reporting, VP INR 3300K-4000KData Governance | Data Quality | Data Visualization | Power BI | Project ManagementExecutive-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Analytics Analyst INR 2520K-3380KClustering | Dashboarding | Data Preprocessing | Data Quality | Data WranglingCollaborative team environment | Cross-functional collaboration | Hybrid work modelSenior-level Full TimeBangalore, KA, IN15h ago
-
Senior Analyst, Data Science & Analytics INR 2755K-3380KAWS | Azure | Cloud Computing | Deep learning | Distributed ComputingConferences and seminars | Flexible time off | Tuition reimbursement | Workplace flexibilitySenior-level Full TimePune, India15h ago
-
Data Analytics and AI Solutions Lead INR 3150K-4500KAutomation platforms | Copilots | Dashboarding | Data Governance | Data ProcessingSenior-level Full TimeIndia - Hyderabad15h ago
-
Analytics | Clickstream Data | Cloud platform | Dashboard Development | Data LakesSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India15h ago
-
Finance Data Analyst INR 2800K-4000KData Integrity | Data Modeling | Data Visualization | ERP | Payroll accountingSenior-level Full TimeIndia - Hyderabad15h ago
-
Amazon Redshift | Apache Airflow | Application Programming | Application Programming Interfaces | AzureSenior-level Full Time110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India15h ago
-
Senior-level Full Time111443-IND-HYDERABAD-INTL HYD WF CENTRE BLK B8 …15h ago
-
AIML - Tech Lead INR 2500K-4500KApache Airflow | ETL | Entity recognition | Language Processing | Machine LearningSenior-level Full TimeIN-MH-Pune1d ago
-
Data Analyst INR 346K-346KData Analysis | Data Visualization | Data Warehouse | Database Development | ETLEntry-level Full TimeGurugram, HARYANA, India1d ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
Senior-level Full TimeGurugram, Haryana, India1d ago
-
Manager INR 1500K-2000KApache Airflow | Data Governance | Data Modeling | Data Quality | DatabricksMid-level Full TimeGurugram, Haryana, India1d ago
-
Senior Lead Software Engineer - Java, PySpark, and AWS INR 1800K-2400KAWS | AWS Glue | AWS Lake Formation | AWS Lambda | AWS Step FunctionsSenior-level Full TimeHyderabad, Telangana, India1d ago
-
Manager, Business Analytics INR 1000K-2000KAgile | Business Intelligence | Business Process | Business Process Mapping | ConfluenceMid-level Full TimeChennai, Tamil Nadu, India1d ago
-
3D mathematics | Agile | Artificial Intelligence | C++ | Cloud processingContinuous learning | Diversity and equal opportunity | Flexible work environment | Inclusive workplace | Professional growthSenior-level Full TimeIndia1d ago
-
Manager-Digital Marketing-Marketing Analytics INR 800K-1200KAPI | APIs | Adobe Analytics | Attribution Modeling | Behavior AnalysisMid-level Full TimeIndia1d ago
-
Automation | Azure | Data Analysis | Data Pipelines | Data integrationCareer growth | Collaborative team culture | Fully remote | Professional developmentMid-level Full TimeIndia R1d ago
-
Delivery Lead, Inference and Agentic AI INR 2000K-4800KAI Agents | API Integration | Automation | CRM | CRM IntegrationSenior-level Full TimeNoida, Uttar Pradesh1d ago