Senior Consultant - Consumer Analytics Data Engineering
INR 2400K-3380K (estimate) Senior-level Full Time
Tasks
- Architect manage Databricks lakehouse solutions
- Automate data ingestion processing delivery with SLA adherence
- Build AWS based consumer data flows with Databricks
- Build agentic workflows with Databricks AI Functions
- Collaborate with data scientists business analysts marketing to translate data needs
- Create semantic layers for BI and AI agents
- Design data models schemas for analytical queries
- Design develop implement ETL ELT pipelines
- Ensure data quality integrity and governance
- Implement platform governance schemas permissions data lineage
- Mentor data engineers code reviews documentation
- Optimize Delta Lake lakehouse architectures Bronze Silver Gold
- Optimize Spark compute and Auto Loader performance
- Perform troubleshooting root cause analysis and corrective actions
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Glue | AWS Lambda | AWS S3 | Amazon Redshift | Auto Loader | CI | CI/CD | DBT | Data Governance | Data Modeling | Databricks | Databricks SQL | Databricks Workflows | Delta Lake | Delta Live Tables | Delta Live) | Dimensional Modeling | ELT | ETL | Git | IAM | Lakehouse | PySpark | Python | SQL | Semantic layer | Spark | Unity Catalog
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Consultant | Data Engineer | Engineer | Senior Consultant | Senior Data Engineer
Related jobs
-
Senior-level Full TimeBengaluru, Karnataka, India4h ago
-
Senior-level Full TimeHyderabad, IND-TG, India16h ago
-
Applied AI ML Lead INR 2475K-3465KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Lead Backend Engineer (MongoDB / NoSQL) INR 1600K-4000KAWS | Agile | Azure | CI/CD | Distributed SystemsSenior-level Full TimeIN-TN-Chennai20h ago
-
Data Engineer - Analysis & Insights INR 2000K-2500KAgile | Alteryx | Ascend | AtScale | Cloud platformMid-level Full TimeHyderabad, India21h ago
-
AES - DE -JAVA - Generative AI Application Developers INR 2535K-4000KAWS | Agile | Azure | CI/CD | DockerSenior-level Full TimeBangalore, Karnataka, India21h ago
-
Mid-level Full TimePune, Maharashtra, India22h ago
-
Senior-level Full TimeBengaluru, KA, India22h ago
-
BIOS | Block layer | C# | C++ | Distributed SystemsSenior-level Full TimeBengaluru, KA, India22h ago
-
Software Developer Lead (AWS, Java/Python) INR 2695K-4000KAWS | AWS CloudFormation | Amazon S3 | Amazon SNS | Amazon SQSSenior-level Full TimeHyderabad, India22h ago
-
Mid-level Full TimeGurgaon, Haryana, India22h ago
-
Lead AI Engineer #3008 INR 2500K-4500KAgent Orchestration | Azure | Deepgram | Fine Tuning | LLM ObservabilityFlexible working hours | Global exposure | Professional development | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India23h ago
-
Analytics Solution- Associate INR 2040K-2755KAgile | Atlassian | Atoti | Change Data Capture | Continuous DeploymentSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Applied AI ML Associate Senior INR 1400K-2000KAgentic Frameworks | Amazon Web Services | Apache Airflow | Architectures | AzureMid-level Full TimeMumbai, Maharashtra, India1d ago
-
AI/ML Engineer (Associate) INR 900K-900KAWS SageMaker | Azure AI | C++ | Cloud platform | Computer VisionEntry-level Full Timecoimbatore, India1d ago
-
ROP - SE2/SSE - Azure Data INR 1500K-2400KApache Hadoop | Apache Kafka | Apache Spark | Azure | Azure ComputeOn-call rotationMid-level Full TimeBengaluru, KA, IN1d ago
-
Data Science & AI Specialist INR 2000K-3000KAI ethics | Algorithm Design | Artificial Intelligence | Business Analysis | Cloud ComputingMid-level Full TimeKolkata, IN, 7001561d ago
-
Assoc. Manager, Platform Support Engineering INR 1000K-1500KAWS | Active Directory | Azure | Azure Active Directory | Azure DevOpsMid-level Full TimeGurgaon, Haryana, India1d ago
-
Lead Assistant Manager - Data Science INR 2500K-2800KBacktesting | Collections Performance | Collections performance analysis | Data Preprocessing | Delinquency predictionSenior-level Full TimeGurugram, Haryana, India1d ago
-
Staff Software Development Engineer - Data Platforms INR 2500K-3100KAWS | AWS Glue | Amazon DynamoDB | Amazon EMR | Amazon KinesisSenior-level Full TimeBengaluru1d ago
-
Embedded System Software Test Automation Engineer INR 1500K-3000KARM | Analog Input | Analog input/output | Bug tracking | C++Senior-level Full TimeHyderabad, TS, India1d ago
-
Mid-level Full TimePune, Maharashtra, India1d ago
-
Senior Data Engineer - R01555143 INR 1000K-2000KControl-M | Data Modeling | Data Warehousing | Denodo | ETLSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Mid-level Full TimeBengaluru, Karnataka, India1d ago
-
Business case | Business case development | Case Development | Dashboarding | Data CleansingMid-level Full TimeHyderabad, TS, India1d ago