Lead Data Engineer - R01553055
Bangalore, Karnataka, India
INR 1500K-2000K (estimate) Senior-level Full Time
Tasks
- Build real-time streaming pipelines
- Design data migration strategies
- Develop BigQuery scheduled jobs and stored procedures
- Develop scalable Airflow workflows
- Implement data transformations and load to BigQuery
- Integrate data from APIs databases and IoT
- Lead data migration to Google BigQuery
- Modernize legacy data warehouse systems
- Monitor and optimize query performance and cost
- Refactor SSIS packages into cloud ETL pipelines
- Use Git for pipeline management with CICD
- Write and optimize SQL queries
Perks/Benefits
Skills/Tech-stack
Apache Airflow | Apache Kafka | Apache Spark | BigQuery | CI/CD | Cloud platform | DBT | Data Modeling | Data Streaming | ETL | Git | Google Cloud | Google Cloud Platform | Python | SQL | SSIS | Terraform
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Data Science Engineer INR 2400K-3500KCloud Database | Data Modeling | Database Design | ELT | ETLCommercial awareness | Onshore Offshore model experience | UK client experienceSenior-level Full TimeMumbai, MH, India4h ago
-
Engineering Manager- DevOps(Vendor) INR 2200K-4000KAWS Lambda | Agile | Amazon S3 | Amazon Web Services | AnsibleSenior-level Full TimeNoida, Uttar Pradesh4h ago
-
Engineering Manager- Data Devops(Vendor) INR 1500K-2000KAWS CloudFormation | AWS IAM | AWS Lambda | Amazon CloudFront | Amazon CloudWatchMid-level Full TimeNoida, Uttar Pradesh5h ago
-
Senior-level Full Timebangalore, India5h ago
-
Lead Data Scientist INR 2516K-2829KAWS | Deep learning | Docker | Google Cloud | Language ProcessingEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India5h ago
-
Senior Data Engineer INR 2516K-3356KAWS | Airflow | Apache Iceberg | Azure | CI/CDEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India5h ago
-
Lead Machine Learning Engineer INR 3100K-4500KApache Airflow | Argo Workflows | Deep learning | GenAI | JavaSenior-level Full TimeBangalore, India R6h ago
-
Senior-level Contract Full TimeBengaluru, Karnataka, India6h ago
-
Senior-level Full TimeIND - Bengaluru - Esko-Graphics India …11h ago
-
Data Engineer (5+ Years of Exp in Data Warehouse Modeling + Big Data + SSIS + BI + Agile + PowerApps + Shell + SQL) INR 1500K-2000KAI | AWS | Agile | Azure | Azure DevOpsMid-level Full TimeBengaluru, India11h ago
-
IN_Associate_Chatbots/Voicebots_GCC_Advisory_Bangalore INR 1000K-1400KAPI | AWS | AWS Lex | Agent Assist | Auto-QAMid-level Full TimeBengaluru Millenia, India11h ago
-
Mid-level Full TimeIndia Offsite (ZIN99) R11h ago
-
Technical Lead-Data Engg INR 300K-1200KComplex SQL | Data Management Cloud | Data Marts | Data Modeling | Data QualitySenior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN11h ago
-
Cloud Engineer AIOps INR 2000K-2700KApache Spark | Auto Scaling | CI/CD | Compliance | Data LineageAccident insurance | Childcare assistance reimbursement | Coaching | Continuous learning culture | Employee assistance programEntry-level Full TimePune - Business Bay, India11h ago
-
Mid-level Full TimeNew Delhi14h ago
-
Mid-level Full TimeNew Delhi15h ago
-
Analytics Engineer INR 1800K-2500KApache Airflow | Cloud Composer | DBT | Data Modeling | Data WarehousingInsurance package | Learning and development resourcesMid-level Full TimeNoida, Uttar Pradesh1d ago
-
Principal Engineer INR 2500K-4500KAPI Integration | AWS Glue | Amazon Redshift | Apache Airflow | Apache KafkaSenior-level Full TimeNoida1d ago
-
C Engineer - Bangalore/Pune INR 2000K-2500KBash | C# | Character sets | Code generation | Compiler WritingMid-level Full TimeBangalore, India1d ago
-
Staff Software Developer, AI/ML INR 2500K-3100KAWS | Argo CD | Automation Testing | Azure | Big DataFlexible vacation | Flexible work options | Hackathons | Mentorship programs | Recognition programsSenior-level Full TimeBangalore, KA, India1d ago
-
IN_Associate_AI Engineer_GCC_Advisory_Bangalore INR 3000K-4800KAPI Development | Agent evaluation | Anthropic API | Async Programming | AutogenFlexibility programmes | Inclusive benefits | Mentorship | Work-life balance supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
ADO | Agile | Amazon Web Services | Angular | Asynchronous programmingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimePune, India1d ago
-
Artificial Intelligence | Audit | Compliance | Data Analysis | Data ModelingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 8 B, India1d ago
-
Python Developer INR 300K-420KAgile | CSS | Git | HTML | JavaScriptCareer growth | Health insurance | Performance bonuses | Professional developmentEntry-level Full TimeAhmedabad, India1d ago
-
Mid-level Full TimeHyderabad, Telangana, India1d ago