Senior Data engineer
IND - Bengaluru, India
INR 3000K-4000K (estimate) Senior-level Full Time
Tasks
- Build high-quality data pipelines
- Collaborate with stakeholders for requirements and acceptance criteria
- Define SLOs and SLAs for reliability
- Design scalable data architectures
- Embed data quality reconciliation lineage and secure access
- Enforce data engineering standards and governance controls
- Ensure production data accuracy timeliness and reliability
- Implement Spark and Databricks Lakehouse solutions
- Implement observability error handling and retry mechanisms
- Lead code reviews and engineering walkthroughs
- Mentor engineers in distributed data processing and ETL
- Monitor and troubleshoot data pipelines
- Optimize batch micro batch and streaming platforms
- Optimize cloud costs for storage and compute
- Redesign pipelines for storage optimization
- Tune performance for cost and efficiency
Perks/Benefits
- N/A
Skills/Tech-stack
AWS DMS | AWS EventBridge | AWS Lambda | AWS Step Functions | Amazon Aurora | Amazon Aurora RDS | Amazon CloudWatch | Apache Spark | Aurora RDS | CI/CD | Data Governance | Data Lineage | Data Modeling | Data Quality | Data Reconciliation | Databricks | Databricks Lakehouse | Databricks Unity | Databricks Unity Catalog | Delta | Delta Lake | Dimensional Modeling | ETL | Git | GitHub Actions | Metadata Management | Parquet | PySpark | Python | S3 | SQL | Step Functions | Structured Streaming | Unity Catalog | Version control | ZORDER
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Mid-level Full TimeHyderabad, India2h ago
-
Data Scientist (GenAI/Core DS) INR 2000K-3000KAWS | Data Analysis | Data Modeling | Data Visualization | LangchainSenior-level Full TimeGurugram, Haryana, India3h ago
-
Senior-level Full TimeIN-AP-Hyderabad4h ago
-
Senior-level Full TimeIN-AP-Hyderabad4h ago
-
Senior-level Full TimeIN-AP-Hyderabad4h ago
-
Senior-level Full Timebangalore, India4h ago
-
Full Stack Engineer – MERN Stack INR 1300K-2500KAPIs | AWS | Azure | Bootstrap | CI/CDCollaborative culture | Growth opportunities | MentorshipMid-level Full TimeMaharashtra, Pune, India4h ago
-
Python AI Engineer INR 1800K-3500KAPI Development | AWS | AWS Lambda | Amazon Bedrock | Amazon SageMakerHybrid workSenior-level Full TimeIndia5h ago
-
Gen AI Engineer INR 2500K-4500KAWS Extract | Document processing | Langchain | Language Models | Large Language ModelsSenior-level Full TimeHyderabad, Telangana, India5h ago
-
Apache Kafka | Codebeamer | Data Validation | Event Driven | Event-driven architectureSenior-level Full Timebangalore, India5h ago
-
Mid-level Full Timebangalore, India5h ago
-
Senior Data Engineer (Python, PySpark, Kafka) INR 1500K-2040KApache Kafka | Data Warehousing | Dimensional Modeling | Flink | GitSenior-level Full Timebangalore, India5h ago
-
Software Engineer (SDE 2) - Full Stack (Frontend), Lakeflow INR 1800K-3000KAPI Integration | AWS | Accessibility | Azure | CSSMid-level Full TimeBengaluru, India5h ago
-
.NET | API Integration | Agents | Automation Anywhere | Azure FunctionsEntry-level Full TimeNashik, MH, India5h ago
-
Software Engineer III - Python, AI ML INR 2000K-3500KAgentic Frameworks | Amazon Web Services | Apache Airflow | Azure | Cloud NativeSenior-level Full TimeMumbai, Maharashtra, India6h ago
-
Sr. AI Engineer, Backend (Altium) INR 2000K-4500KAPI Development | Agentic Systems | Algorithms | CI/CD | Data StructuresEmployee resource groups | Remote work optionSenior-level Full TimeBangalore, India7h ago
-
Software Engineering INR 1400K-1820KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure EventMid-level Full TimeHyderabad, TS, IN7h ago
-
AWS | AWS CloudWatch | Alerting | Backups | BashSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Applied Computer Vision Engineer - Data Driven Development INR 2000K-3630KAWS | Apache Spark | Azure | C++ | Convolutional Neural NetworksSenior-level Full Timebengaluru, India8h ago
-
Senior-level Full TimePune, Maharashtra, India9h ago
-
AWS | Amazon Bedrock | Anthropic | Azure | Azure AIFlexible work arrangements | Health insurance | Learning and development | Paid time off | Retirement benefitsSenior-level Full TimeIndia9h ago
-
AI Engineer - Acon - BLR INR 2000K-4500KAI Search | AI Studio | Application Security | Arize Phoenix | AzureSenior-level Full TimeIndia9h ago
-
Software Engineer - Spark, scala, Python, SQL, Databricks INR 1500K-2500KAirflow | Apache Spark | Automated testing | Azure Data | Azure Data LakeEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India9h ago
-
Senior-level Full TimeMumbai, Maharashtra, India10h ago
-
Senior Staff Machine Learning Engineer (Java + LLM) INR 2500K-3500KAlgorithms | Design Patterns | Java | Machine Learning | Object-OrientedSenior-level Full TimeBangalore, Karnataka, India10h ago