Staff Engineer, Data Engineering
Bengaluru, KA, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build data workflows
- Collaborate with analysts data scientists business users
- Design ETL/ELT pipelines
- Develop data ingestion pipelines
- Develop data transformation pipelines
- Enforce data quality governance documentation
- Implement CI/CD and automation
- Implement hybrid data integration
- Optimize Spark jobs performance scalability cost
- Orchestrate data pipelines
- Perform root cause analysis
- Troubleshoot pipeline issues
- Use version control with git
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SQL | CI/CD | Data Factory | Data Governance | Data Lake Storage | Data Modeling | Data Quality | Databricks | Delta Lake | Distributed Processing | Git | Performance Tuning | PySpark | SQL | Spark SQL | Unity Catalog
Roles
Related jobs
-
AI Data Engineer III INR 3000K-4000KAWS | Agile methodologies | Amazon Redshift | Apache Airflow | CI/CDEducation assistance program | Fitness benefits | Flexible working hours | Health checkups | Hybrid work environmentSenior-level Full TimeBengaluru, Karnataka, India R6h ago
-
Mid-level Full TimeIndia - Ahmedabad,Bangalore7h ago
-
API Development | AWS | Agents | Angular | AzureHome office setup budget | International multicultural environment | Learning and development budget | Visa and relocation support | Work from homeSenior-level Full TimeIndia R7h ago
-
Mid-level Full TimeIndia (Remote) R7h ago
-
Lead Data Engineer INR 2500K-4500KAWS | AWS Glue | Access Control | Airflow | AzureCareer mobility | Cross portfolio opportunities | Leadership development | Learning opportunitiesSenior-level Full TimeIndia R8h ago
-
Data Science AI Engineer, Advisor INR 2000K-5000KAPI Development | AWS | Angular | Azure | Cloud platformRemote workSenior-level Full TimeBangalore, KA, IN, 560100 R12h ago
-
Senior-level Full TimePune, India12h ago
-
Azure Senior AI Engineer INR 2400K-4200KAI Search | API Development | Agentic AI | Azure AI | Azure AI SearchSenior-level Full TimeBangalore, KA, IN R12h ago
-
Cloud ERP | Data Architecture | Data Catalog | Data Intelligence | Data QualityCollaborative & Inclusive Culture | Family support | Flexible working hours | Health and wellness benefits | Professional development opportunitiesSenior-level Full TimeIndia R14h ago
-
Data and Application Integration Engineer INR 1200K-3000KApplication Integration | Azure | Azure Data | Azure Data Factory | CI/CDSenior-level Full TimeGurgaon, India1d ago
-
Senior Software Engineer (Web Scraping Gen AI Developer) INR 2829K-4500KAPIs | AWS | Azure | CI/CD | DockerEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India1d ago
-
Lead Software Engineer - Platform Data Team INR 2500K-4200KAWS | Ansible | Azure | Benchmarking | CAP TheoremCareer growth mentoring | Global team collaboration | Remote workSenior-level Full TimeIndia1d ago
-
Senior Backend Engineer - Customer Engineering INR 3500K-6000KCI/CD | Celery | Django | Docker | ETLSenior-level Full TimeNoida1d ago
-
Senior-level Full TimeHyderabad, Andhra Pradesh, India1d ago
-
Senior-level Full TimeBangalore, India1d ago
-
Senior Solutions Engineer INR 2000K-4131KApache Spark | Big Data | Big data analytics | Cloud Computing | Data EngineeringSenior-level Full TimeIndia2d ago
-
Machine Learning Engineer - APAC INR 3000K-4408KA/B | A/B Testing | B testing | CI/CD | ClassificationBenefits for family | Flexible working arrangements | Learning and development resources | Sabbaticals | Study assistanceMid-level Full TimeIndia-Bengaluru (Helios Business Park)2d ago
-
26-2292: Databricks Engineer- India, Hyderabad INR 1000K-2000KAIOps | Access Control | Amazon S3 | Anonymization | Apache KafkaMid-level Full TimeHyderabad/Vijayawada2d ago
-
Lead Software Engineer - Workday INR 1800K-2600KAPI Gateway | AWS CloudWatch | AWS Elastic Load Balancing | AWS Lambda | AWS VPCSenior-level Full TimeOff Embassy Golf Links Business Park, …2d ago
-
Value Data Engineer INR 1800K-2400KAPI | AWS | Agile | Azure | Data EnrichmentCab drop | Cab pickup | Flexible working hours | Subsidized mealsMid-level Full TimeBHUBANESWAR, India2d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeHyderabad2d ago
-
Software Site Reliability Engineer - AI & Data Platforms INR 2500K-4300KAWS | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkMid-level Full TimeBengaluru2d ago
-
Senior AI Engineer (m/f/d) INR 3242K-5000KAPIs | AWS | Agents | Angular | AzureHome office setup budget | Learning and development budget | Relocation support | Visa support | Work from homeSenior-level Full TimeRemote EMEA, Remote India R2d ago
-
Senior Data Engineer INR 1500K-2500KAirflow | Apache Spark | Confluence | Data Warehousing | DatabricksSenior-level Full TimeBengaluru, KA, IN2d ago
-
Senior II Data Engineer INR 3600K-4995KData Intelligence | Data Modeling | Fusion Data Intelligence | Oracle Cloud | Oracle DatabaseFlexible workingSenior-level Full TimeIndia2d ago