Senior Software Engineer - Data Engineer
Bengaluru, Karnataka, India
INR 2040K-3100K (estimate) Senior-level Full Time
Tasks
- Apply data quality governance and monitoring
- Build distributed data processing jobs with Apache Spark
- Build scalable data warehouses and lakehouse architectures
- Design and evolve multi tenant cloud data platform
- Develop batch streaming and CDC ingestion pipelines
- Implement near real time and real time data ingestion pipelines
- Implement workflow orchestration pipelines
- Optimize SQL queries for performance
- Perform data modeling for dimensional modeling and data vault
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | Airflow | Amazon Athena | Amazon Kinesis | Amazon S3 | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | CI/CD | Change Data Capture | Data Capture | Data Quality | Data Vault | Data Warehousing | Delta Lake | Dimensional Modeling | ELT | ETL | Git | Infrastructure as Code | Python | SQL | Scala | “as-code”
Education
N/A
Related jobs
-
Mid-level Full TimeChennai, IN, 6000323h ago
-
Mid-level Full TimeChennai, IN, 6000323h ago
-
IN_Senior Associate _Agentic + Gen AI__AI-50_ Advisory_ Mumbai INR 1500K-2500KAPI Management | Acceptance Test | Acceptance Test-Driven Development | Agentic AI | AutoGPTFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeMumbai Goregaon, India9h ago
-
IN_Senior Associate _Agentic + Gen AI__AI-50_ Advisory_ Mumbai INR 1500K-2500KAPI Management | Agentic AI | AutoGPT | CI/CD | DspyFlexible work programs | Inclusive benefits | Mentorship | Training and development | Wellbeing supportMid-level Full TimeMumbai Goregaon, India11h ago
-
Staff Software Engineer - Data engineer INR 2040K-3100KAWS Glue | Amazon Athena | Amazon EMR | Amazon Kinesis | Amazon S3Senior-level Full TimeBengaluru, Karnataka, India12h ago
-
AI Data Engineer III INR 3000K-4000KAgile | Amazon Redshift | Amazon Web Services | Apache Airflow | CI/CDContinuous learning opportunities | Generous leave policies | Health insurance | Hybrid work policies | Wellness programsSenior-level Full TimeBengaluru, Karnataka, India15h ago
-
Revenue Operations Data Engineer( Hybrid- Bangalore) INR 1000K-2000KAWS | Data Governance | Data Integrity | Data Modeling | Data QualityMid-level Full TimeBangalore, INDIA R16h ago
-
Staff Software Engineer -ML/AI INR 2500K-5000KAWS | Classification | Clustering | Docker | ECSCareer growth | Continuous learning | Mentorship opportunities | On-call dutiesSenior-level Full TimeHyderabad, India18h ago
-
Staff Software Engineer -ML/AI INR 2500K-5000KAPI Security | AWS | Artificial Intelligence | Behavioral Analysis | ClassificationMentorship | On-call dutiesSenior-level Full TimeBengaluru, India18h ago
-
Platform Engineer (AI) INR 1500K-2000KEmbeddings | Generative AI | Language Models | Large Language Models | Machine LearningMid-level Full TimeIN-TN-Chennai19h ago
-
MLOps Engineer INR 2500K-4000KArtificial Intelligence | Embeddings | Language Models | Large Language Models | Machine LearningEntry-level Full TimeIN-AP-Hyderabad19h ago
-
Senior Software Engineer (AI) INR 2000K-4500KAPI Design | AWS | Agent Frameworks | Aurora | CI/CDFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India19h ago
-
Lead- Data Analysis INR 2800K-4000KAlteryx | Automation | Correlation Analysis | Dashboards | Data ModelingEmployee discounts | Financial coaching | Health insurance | Hybrid work | Mental health supportSenior-level Full TimeBengaluru, Karnataka, India, India R19h ago
-
Senior-level Full TimeIndia20h ago
-
Senior-level Full TimeIndia20h ago
-
Senior-level Full TimeBengaluru, KA, India20h ago
-
Data Engineer INR 1800K-3000KAWS AppSync | Agentic Workflows | Amazon DynamoDB | Amazon S3 | FastAPIMid-level Full TimePune, Maharashtra, India21h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Language Processing | Linear Algebra | Machine LearningEntry-level Full TimeIndia21h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Language Processing | Linear Algebra | Machine LearningEntry-level Full TimeIndia21h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia21h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia21h ago
-
Gen AI Developer Associate INR 300K-420KData Preprocessing | Feature Engineering | Generative AI | Language Processing | Linear AlgebraEntry-level Full TimeIndia21h ago
-
Amaze - Cloud Data Engineer INR 2500K-4800KAWS AI | Azure AI | Azure Data | Azure Data Factory | Data FactorySenior-level Full TimeIndia21h ago
-
Amaze - Cloud Data Lead INR 2000K-4800KAWS | Azure | Data Quality | Data pipeline | Data pipeline orchestrationSenior-level Full TimeIndia21h ago
-
Senior-level Full TimeIndia21h ago