Senior Consultant - Consumer Analytics Data Engineering
IN: Lilly Bengaluru, India
INR 2400K-3380K (estimate) Senior-level Full Time
Tasks
- Architect manage Databricks lakehouse solutions
- Automate data ingestion processing delivery with SLA adherence
- Build AWS based consumer data flows with Databricks
- Build agentic workflows with Databricks AI Functions
- Collaborate with data scientists business analysts marketing to translate data needs
- Create semantic layers for BI and AI agents
- Design data models schemas for analytical queries
- Design develop implement ETL ELT pipelines
- Ensure data quality integrity and governance
- Implement platform governance schemas permissions data lineage
- Mentor data engineers code reviews documentation
- Optimize Delta Lake lakehouse architectures Bronze Silver Gold
- Optimize Spark compute and Auto Loader performance
- Perform troubleshooting root cause analysis and corrective actions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Amazon Redshift | Auto Loader | CI | CI/CD | DBT | Data Governance | Data Modeling | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | Git | IAM | Lakehouse | PySpark | Python | SQL | Semantic layer | Spark | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Consultant | Data Engineer | Engineer | Senior Consultant | Senior Data Engineer
Related jobs
-
Senior-level Full TimeBengaluru, Karnataka, India5h ago
-
AI/ML Developer INR 1000K-1250KArtificial Intelligence | Batch Processing | Data Science | Distributed Computing | LLMMid-level Full TimeBangalore, KA, IN10h ago
-
Associate Software Engineer- (Python) INR 800K-1200KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Beautiful SoupInnovation | Integrity | Ownership | Remote work flexibility | Work-life balanceMid-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India16h ago
-
Software Engineer- (Python) INR 800K-1200KAlgorithms | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksLearning and teaching culture | Remote-friendly work | Work-life balance supportMid-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India16h ago
-
Senior-level Full TimeHyderabad, IND-TG, India17h ago
-
Applied AI ML Lead INR 2475K-3465KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Lead Backend Engineer (MongoDB / NoSQL) INR 1600K-4000KAWS | Agile | Azure | CI/CD | Distributed SystemsSenior-level Full TimeIN-TN-Chennai21h ago
-
Data Engineer - Analysis & Insights INR 2000K-2500KAgile | Alteryx | Ascend | AtScale | Cloud platformMid-level Full TimeHyderabad, India22h ago
-
AES - DE -JAVA - Generative AI Application Developers INR 2535K-4000KAWS | Agile | Azure | CI/CD | DockerSenior-level Full TimeBangalore, Karnataka, India23h ago
-
Mid-level Full TimePune, Maharashtra, India23h ago
-
Senior-level Full TimeBengaluru, KA, India23h ago
-
BIOS | Block layer | C# | C++ | Distributed SystemsSenior-level Full TimeBengaluru, KA, India23h ago
-
Software Developer Lead (AWS, Java/Python) INR 2695K-4000KAWS | AWS CloudFormation | Amazon S3 | Amazon SNS | Amazon SQSSenior-level Full TimeHyderabad, India23h ago
-
Mid-level Full TimeGurgaon, Haryana, India23h ago
-
Lead AI Engineer #3008 INR 2500K-4500KAgent Orchestration | Azure | Deepgram | Fine Tuning | LLM ObservabilityFlexible working hours | Global exposure | Professional development | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India1d ago
-
Analytics Solution- Associate INR 2040K-2755KAgile | Atlassian | Atoti | Change Data Capture | Continuous DeploymentSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Applied AI ML Associate Senior INR 1400K-2000KAgentic Frameworks | Amazon Web Services | Apache Airflow | Architectures | AzureMid-level Full TimeMumbai, Maharashtra, India1d ago
-
AI/ML Engineer (Associate) INR 900K-900KAWS SageMaker | Azure AI | C++ | Cloud platform | Computer VisionEntry-level Full Timecoimbatore, India1d ago
-
ROP - SE2/SSE - Azure Data INR 1500K-2400KApache Hadoop | Apache Kafka | Apache Spark | Azure | Azure ComputeOn-call rotationMid-level Full TimeBengaluru, KA, IN1d ago
-
Data Science & AI Specialist INR 2000K-3000KAI ethics | Algorithm Design | Artificial Intelligence | Business Analysis | Cloud ComputingMid-level Full TimeKolkata, IN, 7001561d ago
-
A/B | A/B Testing | AWS | Apache Spark | AzureCompany laptop | Fully remote | Home office stipend | Learning and development budget | Paid Maternity LeaveSenior-level Full TimeIndia R1d ago
-
Assoc. Manager, Platform Support Engineering INR 1000K-1500KAWS | Active Directory | Azure | Azure Active Directory | Azure DevOpsMid-level Full TimeGurgaon, Haryana, India1d ago
-
Lead Assistant Manager - Data Science INR 2500K-2800KBacktesting | Collections Performance | Collections performance analysis | Data Preprocessing | Delinquency predictionSenior-level Full TimeGurugram, Haryana, India1d ago
-
Staff Software Development Engineer - Data Platforms INR 2500K-3100KAWS | AWS Glue | Amazon DynamoDB | Amazon EMR | Amazon KinesisSenior-level Full TimeBengaluru1d ago
-
Embedded System Software Test Automation Engineer INR 1500K-3000KARM | Analog Input | Analog input/output | Bug tracking | C++Senior-level Full TimeHyderabad, TS, India1d ago