Lead Engineer Software
KA Bangalore, India
INR 1500K-2400K (estimate) Senior-level Full Time
Tasks
- Build AWS cloud native data solutions
- Build ETL ELT transformations
- Conduct code reviews and engineering standards
- Deliver data to enterprise platforms
- Design data models
- Design semantic and vector based data architectures
- Develop dbt transformation models
- Develop event-driven integrations
- Drive CI/CD practices
- Enable AI ML initiatives with datasets
- Ensure data quality
- Gather business requirements
- Implement CDC based streaming
- Implement observability and monitoring
- Implement real-time data pipelines
- Implement scalable batch data pipelines
- Mentor engineering teams
- Support secure compliant high availability data solutions
- Troubleshoot production data pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | AWS Glue | AWS Lambda | Amazon ECS | Amazon EMR | Amazon Redshift | Amazon S3 | Apache Airflow | CDC | CI/CD | CloudFormation | CloudWatch | DBT | Datadog | GenAI | GitHub Actions | IAM | Jenkins | Kafka | LLM | Python | Retrieval-Augmented Generation | SQL | Snowflake | Terraform | Vector Databases
Roles
Data Engineer | Data Engineering | Data Engineering Lead | Engineer | Engineering Lead | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Agentic AI | Amazon Web Services | Azure | Cloud Computing | Cloud platformAccess to modern cloud and AI tooling ecosystems | Exposure to cutting-edge AI technologies | Long-term contract | Opportunity to shape technical strategy | Remote work flexibilitySenior-level Full TimeIndia20h ago
-
Airflow | Apache Spark | CI/CD | Contextual Bandits | DatabricksCollaborative environment | Continuous learning | Inclusive culture | Professional growth | Remote-friendlySenior-level Full TimeIndia20h ago
-
Data Engineer ID56374 INR 2000K-2500KAgentic AI | Airflow | Apache Spark | BigQuery | Bitemporal DataEducation budget | Growth budget | Innovative projects | Legal presence in India | Local team connectionSenior-level Full TimeTrivandrum, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerEducation budget | Innovative projects | Local connection | Remote work | Wellness budgetSenior-level Full TimeIndore, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | Bitemporal Data | Bitemporal data modeling | CI/CDDedicated budgets for growth | Education budget | Innovative projects | Local connection | Periodic meet upsSenior-level Full TimeKolkata, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KAirflow | Apache Spark | BigQuery | Bitemporal Data | Bitemporal data modelingEducation budget | Growth budget | Innovative projects | Legal presence in India | Local connectionSenior-level Full TimeJalalabad, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | Bitemporal Data | Bitemporal data modelingBudgets for education | Budgets for growth | Innovative projects | Legal presence in India | Local connectionSenior-level Full TimeKochi, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Delta | Apache Delta Lake | Apache Spark | BigQuery cost managementEducation budget | Growth budget | Innovative projects | Legal presence in India | Local connection meetupsSenior-level Full TimePune City, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KAgentic AI | Apache Airflow | Apache Spark | BigQuery | CI/CDDedicated budget for education | Dedicated budget for growth | Dedicated budget for wellness | Local connection | Periodic meetupsSenior-level Full TimeBangalore North, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Growth budget | Innovative projects | Legal compliance in India | Local connectionSenior-level Full TimeMumbai, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KAgentic AI | Apache Airflow | Apache Spark | BigQuery | Bitemporal DataBudgets for growth and education | Innovative projects | Legal presence in India | Local connection meetups | Remote workSenior-level Full TimeAhmedabad, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Growth budget | Innovative projects | Local connection | Periodic meet upsSenior-level Full TimeChennai, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureDedicated budgets for growth | Education budget | Innovative projects | Local connection | Periodic meet upsSenior-level Full TimeGurgaon Kty., India23h ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | Cloud Composer | Cloud Monitoring | Cloud PubSubEducation budget | Growth budget | Innovative projects | Local connection | Periodic meetupsSenior-level Full TimeNew Delhi, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KAirflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureEducation budget | Growth budget | Innovative projects | Legal presence in India | Local team meetupsSenior-level Full TimeNoida, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | CI/CD | Change Data CaptureDedicated budget for education | Dedicated budget for growth | Innovative projects | Local connection | Periodic meetupsSenior-level Full TimeHyderabad, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KAirflow | Apache Spark | BigQuery | Bitemporal Data | Bitemporal data modelingEducation budget | Legal presence in India | Periodic meetups | Remote work | Wellness budgetSenior-level Full TimeCoimbatore South, India23h ago
-
Data Engineer ID56374 INR 2000K-2500KApache Airflow | Apache Spark | BigQuery | Bitemporal Data | Bitemporal data modelingEducation budget | Growth budget | Innovative projects | Local connection | Periodic meet upsSenior-level Full TimeJaipur, India23h ago
-
Generative AI / Sr. Associate Director, Tech SME INR 1400K-2200KAWS | Active Directory | Ansible | Azure | CI/CDMid-level Full TimePune, Maharashtra, India R1d ago
-
Lead Data Scientist INR 2800K-4000KAWS | Airflow | Azure | BERT | CI/CDHealth insurance | Paid parental leave | Paid sick leave | Work from OfficeSenior-level Full TimeBengaluru1d ago
-
Senior-level Full TimeIN-KA-Bangalore1d ago
-
Mid-level Full TimeIN-KA-Bangalore1d ago
-
Software Engineer - Data Engineer INR 2617K-3465KAWS | Amazon Redshift | Apache Kafka | Apache Spark | AzureAccess to cutting-edge technologies | BeBrilliant recognition | Collaborative work environment | Professional development | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
Associate Engineer - Embedded AI & Data Analytics INR 1000K-1141KC++ | Classification | Data Modeling | Data Preprocessing | Data ValidationMid-level Full TimeBangalore - Karnataka, India - Kalyani …1d ago
-
DevOps Engineer INR 2500K-3500KAWS CloudWatch | AWS ECR | Amazon Web Services | Argo CD | BashHybrid work modelMid-level Full TimeMaharashtra, Pune, India1d ago