Senior Software Engineer - Data Engineering
Bengaluru, Karnataka, India
INR 2475K-3100K (estimate) Senior-level Full Time
Tasks
- Build near real time and real time data processing
- Build scalable data warehouses and lakehouse architectures
- Design and evolve multi tenant cloud data platform
- Develop batch streaming and CDC ingestion pipelines
- Implement data modeling using dimensional modeling and Data Vault
- Implement data quality frameworks and monitoring
- Implement lakehouse technologies like Delta Lake Iceberg or Hudi
- Optimize SQL queries for performance
- Orchestrate workflows using Airflow
- Use Apache Spark for distributed data processing
Perks/Benefits
Skills/Tech-stack
AWS EMR | AWS Glue | Amazon Athena | Amazon Kinesis | Amazon S3 | Apache Airflow | Apache Flink | Apache Hudi | Apache Iceberg | Apache Kafka | Apache Spark | CDC | CI/CD | Data Modeling | Data Quality | Data Vault | Data Warehousing | Delta Lake | Dimensional Modeling | ELT | ETL | Git | Infrastructure as Code | Lakehouse | Partitioning | Performance Tuning | Python | Query Optimization | SQL | Scala | Schema evolution | Workflow Orchestration | “as-code”
Education
N/A
Related jobs
-
AWS Aurora | AWS Networking | AWS Performance Insights | Amazon RDS | AutomationAutomation focus | High-growth environment | On-call support opportunities | Ownership | Remote-firstSenior-level Full TimeIndia13h ago
-
AI code assistants | Alerting | BigQuery | CI/CD | Cloud RunAccess to knowledge sharing opportunities | Continuous learning | Flexible working arrangements | Fully remote | High autonomy and ownershipSenior-level Full TimeIndia R15h ago
-
Sr. Staff Software Development Engineer - AI Engineer INR 2500K-3500KAgentic AI | Embeddings | Evaluation Frameworks | FastAPI | LLMEducation reimbursement | Health plans | In-office perks | Paid time off | Parental leaveSenior-level Full TimeBangalore, IND; Mohali, IND1d ago
-
Principal Data Engineer - R01558819 INR 1500K-2500KAKS | Apache Airflow | Apache Spark | Azure Cosmos | Azure Cosmos DBSenior-level Full TimePune, Maharashtra, India1d ago
-
Data Engineer - EMEA/US Shift INR 500K-1500KAWS RDS | Amazon Aurora | Amazon DynamoDB | Amazon OpenSearch | CassandraMid-level Full TimeHyderabad1d ago
-
Senior-level Full TimePune City, India1d ago
-
Data Engineer INR 1500K-2500KApache Airflow | Apache Spark | Auto Loader | Azure Event | Azure Event HubSenior-level Full TimeIN-KA-Bangalore1d ago
-
Principal Architect AI Data Engineer INR 2000K-5000KAWS | Agent Orchestration | Azure | CI/CD | ContainersSenior-level Full TimeGurugram, Haryana, India1d ago
-
Architect AI Data Engineer INR 3000K-5000KAPI Integration | AWS | Agent Orchestration | Azure | Azure DatabricksSenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Senior-level Full TimeGurugram, Haryana, India1d ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Agent-based | Agent-based systems | Agentic AI | Cloud Computing | DB2Collaborative innovation driven culture | Flexible work environment | Hands on experience with leading LLM providers | Opportunity to work on cutting-edge AI | Professional growth opportunitiesSenior-level Full TimeIndia1d ago
-
Software Engineer III, AI/ML, Google Cloud INR 2500K-5000KAudio generation | Debugging | Distributed Computing | Documentation | GenAISenior-level Full TimeHyderabad, Telangana, India1d ago
-
Mid-level Full TimeBengaluru, Karnataka, India1d ago
-
BIOS | Bootloader | Buildroot | C# | C++Employee assistance programs | Generous annual leave | International travel | Learning and development budget | Parental leaveSenior-level Full TimeIndia2d ago
-
AWS | CI/CD | CUDA | Data Pipelines | DockerAccidental insurance | Education reimbursement | Employee referral program | Flexible time off | Flexible working hoursMid-level Full TimeIndia2d ago
-
Senior AWS Data Engineer INR 1500K-2500KAPI Gateway | AWS API | AWS API Gateway | AWS CloudFormation | AWS EMRSenior-level Full TimeIndia2d ago
-
Senior Analytics Engineer – Data Applications INR 2771K-4000KAirflow | Anomaly Detection | CI/CD | DBT | DashHybrid work modelSenior-level Full TimeBengaluru, INDIA, India2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Entrepreneurial-minded team | Friendly team atmosphere | Hands-off management | Opportunity to impact millionsMid-level Full TimeHyderabad, India2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Opportunity for impact | Remote-friendly, distributed teamMid-level Full TimePune, India2d ago
-
Senior Software Engineer - Machine Learning (ML, GenAI, SQL) INR 2500K-4800KAWS | Apache Spark | Bedrock | CI/CD | CNNHybrid work flexibilitySenior-level Full TimeGurgaon - Cyber Park, India2d ago
-
Mid-level Full TimeHyderabad, HDC3C, India2d ago
-
Mid-level Full TimePune, PDC3C, India2d ago
-
Data Engineer INR 1500K-2000KAWS CloudWatch | AWS Glue | AWS Lambda | AWS Step Functions | Amazon AthenaMid-level Full TimePune, PDC3C, India2d ago
-
Data Engineer INR 1000K-2000KCloud Platforms | Data Modeling | Data Storage | Database Design | DatabricksMid-level Full TimeBengaluru, BDC7A, India2d ago