Lead Data Engineer
Hybrid in Bangalore, India
R
INR 2520K-3880K (estimate) Senior-level Full Time
Tasks
- Build AI native data layer
- Create datasets for natural language querying
- Define engineering standards for data team
- Enable self service pipelines
- Enforce data security and access controls
- Identify and scope AI enabled data use cases
- Lead technical design reviews
- Own and evolve data platform
- Own in product data features
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Access Control | Agentic pipelines | Apache Hudi | Apache Ranger | Apache Spark | ClickHouse | Confidence scoring | Data Engineering | Delta Lake | Distributed query | Distributed query engines | Druid | Iceberg | LLM | OLAP | Presto | Query engines | RAG | RBAC | Starrocks | Trino | Vector Stores
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R12h ago
-
APIs | Agent systems | Architecture Design | Data Engineering | Data ModelingEquipment support | Flexible working hours | Gifts and rewards | Lunch allowance | Medical insuranceSenior-level Full TimeIndia R1d ago
-
Senior Machine Learning Engineer INR 3584K-4580KAWS | Azure | CI/CD | Data Science | DatabricksLearning and development programs | Mentorship culture | Remote workSenior-level Full TimeBangalore, India R1d ago
-
Senior Software Engineer - Data Platform INR 3500K-4580KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkCompany holidays | Daily meals | Dental insurance | Family planning assistance | Fitness coachingSenior-level Full TimeBengaluru, Karnataka, India R1d ago
-
AI Governance | Airflow | Alerting | Anomaly Detection | Artifact RegistryMid-level Full TimePune, Maharashtra, India R1d ago
-
AWS | Authentication | Autovacuum | Backup and Restore | Client LibrariesAnnual offsites | Coworking allowance | Employee equity | Flexible schedule | Fully remoteSenior-level Full TimeIndia R1d ago
-
Mid-level Full TimeIndia - Remote R1d ago
-
Apache Spark | Azure | Cost Optimization | Data Governance | Data ModelingFully remote work setup | Professional growth opportunities | Supportive work cultureSenior-level Full TimeIndia R1d ago
-
AI Engineer INR 3200K-5000KAPI Integration | AWS | Airflow | Azure | CI/CDMentorship | Remote workSenior-level Full TimeBangalore or Remote, KA, IN R1d ago
-
Mid-level Full TimeNoida, India R1d ago
-
Computer Scientist 2 INR 3470K-4580KAWS | Asynchronous Event Driven | Asynchronous Event Driven Systems | Automated testing | AzureSenior-level Full TimeBangalore, India R1d ago
-
AI Model Quality Engineer INR 3000K-5000KAPI Testing | Bias and fairness | Concept drift | Concept drift detection | Continuous MonitoringSenior-level Full TimeBangalore, Karnataka, India (Hybrid) R2d ago
-
Mid-level Full TimeIndia - Remote R2d ago
-
Apache Spark | Automation | Azure Data | Azure Data Services | Data GovernanceRemote workSenior-level Full TimeIndia - Remote R3d ago
-
CCaaS | CRM | CTI | Embeddings | EvaluationFully remote | Learning opportunities | Startup environmentSenior-level Full TimeHyderabad R3d ago
-
AWS | Airflow | Cloud platform | Data Pipelines | Deep learningAccess to Collaboration Platforms | Access to development tools | Continuous learning environment | Equity opportunities | Medical/Dental/Vision insuranceMid-level Full TimeIndia R4d ago
-
AWS | Apache Spark | Big Data | Hadoop | JavaRemote workSenior-level Full TimeBangalore, Karnataka, India R4d ago
-
Lead Software Engineer INR 2500K-5000KAWS | Asynchronous programming | Authentication | Authorization | AutogenSenior-level Full TimeRemote, India R4d ago
-
Sr. AI Engineer - 2.00 pm to 11.00 pm IST (Remote, IND) INR 3242K-4580KAWS Bedrock | Alerting | Autogen | CI/CD | Configuration ManagementCompetitive vacation and holidays | Employee networks | Paid adoption leave | Paid parental leave | Paid time offSenior-level Full TimeIND MH Remote, India R4d ago
-
Machine Learning Engineer - 5 INR 3600K-5500KAWS | Airflow | Amazon SageMaker | Argo Workflows | Azure Machine LearningSenior-level Full TimeBangalore, India R4d ago
-
Databricks Data Engineer - Bengaluru INR 1500K-2500KAWS Glue | Amazon Athena | Amazon EMR | Amazon S3 | Apache AirflowWork from anywhereMid-level Full TimeIndia-Bangalore-Office-Kalyani Vista R4d ago
-
Spark, Scala, Hadoop & Quantexa/Senior Consultant Specialist INR 2000K-2800KApache Airflow | Apache Spark | CI/CD | DevOps | ElasticsearchFlexible working hours | On-call support | Shift workSenior-level Full TimeBangalore, Karnataka, India R5d ago
-
Data Science Lead INR 2817K-5000KAWS | Apache Airflow | Experiment design | Lookalike modeling | MLOpsCommunity volunteering | Financial advisory services | Group health coverage | Holidays | Hybrid work modelSenior-level Full TimeBengaluru R5d ago
-
Apache Hadoop | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataImmediate joinerMid-level Full TimeHyderabad, Telangana, India - Remote R5d ago
-
AVP, Data Engineer (L10) INR 4000K-5000KAPI | AWS | AWS Glue | Agile | Amazon EMRCareer advancement | Employee wellness programs | Flexible work hours | Upskilling opportunities | Work from homeExecutive-level Full TimeHyderabad IN, India R5d ago