Senior Consultant - Consumer Analytics Data Engineering
IN: Lilly Bengaluru, India
INR 2400K-3380K (estimate) Senior-level Full Time
Tasks
- Architect manage Databricks lakehouse solutions
- Automate data ingestion processing delivery with SLA adherence
- Build AWS based consumer data flows with Databricks
- Build agentic workflows with Databricks AI Functions
- Collaborate with data scientists business analysts marketing to translate data needs
- Create semantic layers for BI and AI agents
- Design data models schemas for analytical queries
- Design develop implement ETL ELT pipelines
- Ensure data quality integrity and governance
- Implement platform governance schemas permissions data lineage
- Mentor data engineers code reviews documentation
- Optimize Delta Lake lakehouse architectures Bronze Silver Gold
- Optimize Spark compute and Auto Loader performance
- Perform troubleshooting root cause analysis and corrective actions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Amazon Redshift | Auto Loader | CI | CI/CD | DBT | Data Governance | Data Modeling | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | Git | IAM | Lakehouse | PySpark | Python | SQL | Semantic layer | Spark | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Consultant | Data Engineer | Engineer | Senior Consultant | Senior Data Engineer
Related jobs
-
Software Engineering Professional - GEN AI INR 2500K-4800KAI Search | AWS Bedrock | Analytics Cloud | Anaplan | Azure AISenior-level Full TimeBengaluru, IN, 5601038h ago
-
Mid-level Full TimeChennai, IN, 60003212h ago
-
Mid-level Full TimeChennai, IN, 60003212h ago
-
Cloud Platform & AI Engineer INR 2200K-3500KAWS Bedrock | AWS Security | Amazon SageMaker | Amazon Web Services | Artificial IntelligenceHybrid work transition | Remote work flexibilityMid-level Full TimeRemote- India- Gurugram R17h ago
-
IN_Senior Associate _Agentic + Gen AI__AI-50_ Advisory_ Mumbai INR 1500K-2500KAPI Management | Acceptance Test | Acceptance Test-Driven Development | Agentic AI | AutoGPTFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeMumbai Goregaon, India18h ago
-
IN_Senior Associate _Agentic + Gen AI__AI-50_ Advisory_ Mumbai INR 1500K-2500KAPI Management | Agentic AI | AutoGPT | CI/CD | DspyFlexible work programs | Inclusive benefits | Mentorship | Training and development | Wellbeing supportMid-level Full TimeMumbai Goregaon, India20h ago
-
Staff Software Engineer - Data engineer INR 2040K-3100KAWS Glue | Amazon Athena | Amazon EMR | Amazon Kinesis | Amazon S3Senior-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior Software Engineer - Data Engineer INR 2040K-3100KAWS EMR | AWS Glue | Airflow | Amazon Athena | Amazon KinesisSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Cloud Data Engineer INR 1500K-2000KAutomation | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksAgile delivery | Cross-functional collaboration | Professional developmentMid-level Full TimeGurugram, Haryana, India22h ago
-
Sr Cloud Data Engineer INR 1500K-2500KApache Spark | Auto Loader | Azure | Azure Data | Azure Data FactorySenior-level Full TimeGurugram, Haryana, India22h ago
-
Lead Cloud Data Engineer INR 2000K-3000KABAC | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeGurugram, Haryana, India22h ago
-
Senior-level Full TimeBengaluru, KA, India22h ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Redshift | Amazon Web Services | Apache Airflow | CI/CDContinuous learning opportunities | Generous leave policies | Health insurance | Hybrid work policies | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior AI Engineer INR 2000K-3465KAPI Development | Agentic Workflows | Amazon Web Services | Azure | CI/CDSenior-level Full TimeIndia1d ago
-
Senior-level Full TimeAnywhere in India R1d ago
-
Automation Engineer – Analytics and Automation INR 1075K-1250KAI | APIs | CMDB | Cloud Integration | Cloud platformMid-level Full TimeIndia1d ago
-
Cloud Devops Specialist INR 2200K-3200KAWS CloudWatch | AWS Config | AWS EC2 | AWS EKS | AWS GuardDuty24 7 on call hybrid support | Continuous supportSenior-level Full TimeIndia1d ago
-
AI-powered automation | Automated testing | CI/CD | Cloud Native | Continuous DeploymentLaptop provided | Long-term career growth | Medical insurance | Mentorship community and forums | No weekend workSenior-level Full TimeIndia R1d ago
-
Revenue Operations Data Engineer( Hybrid- Bangalore) INR 1000K-2000KAWS | Data Governance | Data Integrity | Data Modeling | Data QualityMid-level Full TimeBangalore, INDIA R1d ago
-
Senior-level Full TimeIndia1d ago
-
Senior-level Full TimePakistan1d ago
-
Staff Software Engineer -ML/AI INR 2500K-5000KAPI Development | API Services | AWS | CI/CD | Deep learningMentorship | On-call dutiesSenior-level Full TimeHyderabad, India1d ago
-
Staff Software Engineer -ML/AI INR 2500K-5000KAWS | Classification | Clustering | Docker | ECSCareer growth | Continuous learning | Mentorship opportunities | On-call dutiesSenior-level Full TimeHyderabad, India1d ago
-
Staff Software Engineer -ML/AI INR 2500K-5000KAPI Development | AWS | Artificial Intelligence | Classification | ClusteringSenior-level Full TimeBengaluru, India1d ago
-
Staff Software Engineer -ML/AI INR 2500K-5000KAPI Security | AWS | Artificial Intelligence | Behavioral Analysis | ClassificationMentorship | On-call dutiesSenior-level Full TimeBengaluru, India1d ago