Enterprise Data & Analytics Lead Engineer
IN025 Embassy Manyata Business Park, India
INR 2800K-3880K (estimate) Senior-level Full Time
Tasks
- Automate etl elt workflows for supply chain use cases
- Build Delta Lake pipelines
- Deploy repeatable infrastructure as code
- Develop databricks curated data products
- Implement lakehouse medallion architecture bronze silver gold
- Implement spark structured streaming for real time monitoring
- Ingest unify harmonize curate disparate data sources
- Manage data governance lineage access control with unity catalog
- Monitor data pipelines and detect supply chain disruptions
- Orchestrate data pipelines with databricks workflows or azure data factory
Perks/Benefits
- Employee resource groups
- Learning and development
- Paid Company Holidays
- Paid vacation
- Volunteer time
Skills/Tech-stack
ADLS Gen2 | Agile | Azure ADLS | Azure ADLS Gen2 | Azure Data | Azure Data Factory | Azure DevOps | Azure Key Vault | CI/CD | DLT | Data Factory | Data Governance | Data Lineage | Databricks | Databricks Workflows | Delta Lake | ELT | ETL | Git | GitHub Actions | Infrastructure as Code | Key Vault | Lakehouse Architecture | Medallion Architecture | PySpark | Python | SQL | Spark Structured Streaming | Structured Streaming | Terraform | Unity Catalog | “as-code”
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
ESI Digi Tech ATLAS 2 168203 INR 2500K-4500KAWS Lambda | AWS Step Functions | Amazon Simple Notification Service | Amazon Simple Queue Service | Amazon Web ServicesSenior-level Full TimeHyderabad, IND-TG, India4h ago
-
Senior-level Full TimeHyderabad, IND-TG, India4h ago
-
Applied AI ML Lead INR 2475K-3465KApache Hive | Apache Spark | Keras | Language Processing | Machine LearningSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Lead Backend Engineer (MongoDB / NoSQL) INR 1600K-4000KAWS | Agile | Azure | CI/CD | Distributed SystemsSenior-level Full TimeIN-TN-Chennai9h ago
-
Senior-level Full TimeIN-TN-Chennai9h ago
-
Senior-level Full TimeIN-TN-Chennai9h ago
-
AES - DE -JAVA - Generative AI Application Developers INR 2535K-4000KAWS | Agile | Azure | CI/CD | DockerSenior-level Full TimeBangalore, Karnataka, India10h ago
-
Mid-level Full TimePune, Maharashtra, India10h ago
-
Senior-level Full TimeBengaluru, KA, India10h ago
-
BIOS | Block layer | C# | C++ | Distributed SystemsSenior-level Full TimeBengaluru, KA, India10h ago
-
Lead Data Scientist INR 2500K-2829KArtificial Intelligence | Classification | Cloud Computing | Clustering | ETLEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India10h ago
-
Software Developer Lead (AWS, Java/Python) INR 2695K-4000KAWS | AWS CloudFormation | Amazon S3 | Amazon SNS | Amazon SQSSenior-level Full TimeHyderabad, India10h ago
-
Mid-level Full TimeGurgaon, Haryana, India10h ago
-
Lead Data Scientist INR 2516K-3356KArtificial Intelligence | Big Data | Classification | Cloud Computing | ClusteringEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India10h ago
-
Lead AI Engineer #3008 INR 2500K-4500KAgent Orchestration | Azure | Deepgram | Fine Tuning | LLM ObservabilityFlexible working hours | Global exposure | Professional development | Rewards and recognition | Work-life balanceSenior-level Full TimeChennai, India11h ago
-
Analytics Solution- Associate INR 2040K-2755KAgile | Atlassian | Atoti | Change Data Capture | Continuous DeploymentSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
Applied AI ML Associate Senior INR 1400K-2000KAgentic Frameworks | Amazon Web Services | Apache Airflow | Architectures | AzureMid-level Full TimeMumbai, Maharashtra, India12h ago
-
AI/ML Engineer (Associate) INR 900K-900KAWS SageMaker | Azure AI | C++ | Cloud platform | Computer VisionEntry-level Full Timecoimbatore, India12h ago
-
ROP - SE2/SSE - Azure Data INR 1500K-2400KApache Hadoop | Apache Kafka | Apache Spark | Azure | Azure ComputeOn-call rotationMid-level Full TimeBengaluru, KA, IN13h ago
-
Assoc. Manager, Platform Support Engineering INR 1000K-1500KAWS | Active Directory | Azure | Azure Active Directory | Azure DevOpsMid-level Full TimeGurgaon, Haryana, India13h ago
-
Lead Assistant Manager - Data Science INR 2500K-2800KBacktesting | Collections Performance | Collections performance analysis | Data Preprocessing | Delinquency predictionSenior-level Full TimeGurugram, Haryana, India13h ago
-
Mid-level Full TimePune, Maharashtra, India13h ago
-
Mid-level Full TimeBengaluru, Karnataka, India14h ago
-
Data Science AI Engineer, Advisor INR 950K-1400KAs-a-Service | C# | Cloud technologies | Database methodologies | Development LifecycleHybrid work environment | Work-life balanceMid-level Full TimeBangalore, KA, IN, 56010014h ago
-
AWS | AWS Glue | Advanced SQL | Airflow | Amazon EMRMid-level Full TimeHyderabad, Telangana, India14h ago