Senior Data Engineer- Spark, Abinitio, Python, SQL, Data warehouse
110380-IND-BENGALURU-INTL BLR Twr-1&2 CARNATION, India
INR 2000K-2400K (estimate) Senior-level Full Time
Tasks
- Achieve data engineering strategic goals
- Build data pipelines
- Collaborate with colleagues and managers
- Conduct data engineering code reviews
- Develop data models
- Lead data engineering initiatives
- Lead teams to meet data engineering deliverables
- Maintain data warehouse and analytics environment
- Maintain optimized data pipelines
- Oversee data integration
- Resolve data engineering issues
- Review data engineering challenges
- Write data analysis scripts
- Write data integration scripts
Perks/Benefits
- N/A
Skills/Tech-stack
Ab Initio | Agile | Apache Kafka | Apache Spark | Autosys | Cloud BigQuery | Cloud platform | Code review | Data Modeling | Data Warehousing | Data integration | Docker | Google BigQuery | Google Cloud | Google Cloud BigQuery | Google Cloud Platform | Hadoop | Hive | Kanban | Kubernetes | MongoDB | Neo4j | Python | SQL | Scrum | Test Coverage
Education
N/A
Roles
Related jobs
-
Embedded Software and System Integration Lead, Cloud TPU INR 3400K-5000KARM | AXI | Agile | Bare Metal | C#Senior-level Full TimeBengaluru, Karnataka, India3h ago
-
Data Science – (Gen AI Developer) - Analyst INR 2000K-2600KAutogen | CI/CD | Data Analysis | Data Visualization | ETLEntry-level Full TimeBengaluru, Karnataka, India4h ago
-
Software Engineering Professional INR 1500K-2500KAI orchestration | AIOps | APIs | AWS | Agent FrameworksMid-level Full TimeBengaluru, IN, 5601035h ago
-
Software Engineering Professional INR 1500K-2500KAI orchestration | AIOps | API Integration | AWS | Agent FrameworksMid-level Full TimeBengaluru, IN, 5601035h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-3000KAPIs | Agentic AI | Agile | Azure | BERTMid-level Full TimeBangalore, Karnataka, India6h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-3000KAPI Design | Agent Frameworks | Agile | Azure | BERTMid-level Full TimeBangalore, Karnataka, India6h ago
-
Manager - Forward Deployed Engineer / AI Engineer INR 1800K-3000KAPI Development | Azure | BERT | Bias Mitigation | Data PreprocessingMid-level Full TimeBangalore, Karnataka, India6h ago
-
Assistant Manager-GDC INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeHyderabad, Telangana, India6h ago
-
Mid-level Full TimeHyderabad, Telangana, India6h ago
-
Software Engineer INR 2156K-2894KAWS ECS | AWS Lambda | Amazon ECR | Amazon S3 | Amazon SNSDevelopment opportunities | Reward and recognition | Volunteering | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India8h ago
-
Software Engineer - Associate INR 1500K-3000KAWS | AWS Lambda | Amazon ECR | Amazon ECS | Amazon S3Development opportunities | Reward & recognition | Volunteering opportunities | Wellness programs | Work-life balanceMid-level Full TimeHyderabad, India8h ago
-
Staff Engineer (Python/AWS) INR 2500K-3465KAPI Gateway | AWS | AWS CDK | Aurora MySQL | Aurora PostgresDEI focus | Development opportunities | Reward and recognition | Volunteering | WellnessSenior-level Full TimeHyderabad, India8h ago
-
Consultant - AI Engineer with Claude INR 2000K-4800KAWS | Autogen | Azure | Claude | ContainerizationSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Executive-level Full TimeBangalore, Karnataka, India9h ago
-
Assistant Manager- AI Engineer INR 1800K-3000KAmazon Web Services | Autogen | Azure | Claude | Cloud platformMid-level Full TimeBangalore, Karnataka, India9h ago
-
Assistant Manager- AI Engineer INR 1800K-3000KAmazon Web Services | Autogen | Azure | Cloud platform | CrewAIMid-level Full TimeBangalore, Karnataka, India9h ago
-
Senior-level Full TimeBengaluru, KA, India10h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Apache Spark | CI/CD | Data Modeling | Data QualityBike to work | Educational assistance | Employee assistance program | Employee discount | Fitness classesSenior-level Full TimePune, MH, India10h ago
-
Staff Software Engineer (Python) INR 2000K-4000KAPIs | AWS | Authentication | Batch Processing | Cause analysisCollaborative team environment | Leadership development | Training programsSenior-level Full TimeMumbai, MH, India10h ago
-
Senior-GDC / Senior Engineer INR 2000K-3300KAngular | Cloud Computing | Containerization | Data Classification | Data GovernanceSenior-level Full TimeHyderabad, Telangana, India10h ago
-
Senior-GDC / Senior Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksSenior-level Full TimeKochi, Kerala, India10h ago
-
Software Engineer II INR 2000K-2525KAWS | CI/CD | Data Structures | Docker | EC2Professional development | Training coursesMid-level Full TimeMumbai, India10h ago
-
Assistant Manager-GDC INR 1200K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DatabricksMid-level Full TimeKochi, Kerala, India11h ago
-
Generative AI Developer INR 1400K-1700KCloud Functions | Cloud Storage | Cloud platform | Compute Engine | GeminiDigital learning platform access | Elder care | Flexible work | Health checks | Insurance with top-upsMid-level Full TimeBangalore, IN12h ago
-
AI Engineer INR 2000K-4000KAWS Bedrock | AWS Bedrock Agents | AWS Bedrock Guardrails | AWS VPC | Agile methodologiesSenior-level Full TimeIndia Office14h ago