Senior Data Engineer
Tasks
- Build lakehouse solutions
- Collaborate with Cloud DevOps and Application teams
- Design scalable batch and real time data pipelines
- Evaluate and adopt new data technologies
- Explore technologies to scale data ecosystem
- Own end-to-end data flows
- Productionize ML and AI workloads
Perks/Benefits
Skills/Tech-stack
AWS | Apache Airflow | Apache Iceberg | Apache Spark | Azure | Batch Processing | CI/CD | Cloud platform | CloudFormation | Containers | Cost Optimization | Data Lakehouse | Data orchestration | Databricks | Delta Lake | Encryption | Event Streaming | FastAPI | Google Cloud | Google Cloud Platform | IAM | Infrastructure as Code | Kafka | Kubernetes | Langchain | Langgraph | Logging | MLflow | Metrics | NoSQL | Node.js | Observability | Pandas | Performance optimization | Polars | PostgreSQL | Pulumi | Python | RAG | React | Real Time | Real-time Processing | SQL | Scala | Secrets management | Terraform | Time processing | Tracing | “as-code”
Education
Roles
Related jobs
-
CI/CD | Cloud Platforms | Data Architectures | Data Engineering | Data ModelingHybrid work | Immediate join | VIRTUAL interviewMid-level ContractBangalore North, India3h ago
-
NLP Engineer (Remote) INR 2000K-3000KAsynchronous programming | BERT | Batch Processing | Data Preprocessing | ETLMid-level Full TimeGurgaon, India R3h ago
-
Software Engineer (2024 / 25, GenAI must) INR 1100K-1500KAgile | CI/CD | Deep learning | Full SDLC | Generative AIHybrid work | MentorshipMid-level Full TimeBengaluru, INDIA, India5h ago
-
Senior-level Full TimeHybrid, Hyderabad, Telangana, India R5h ago
-
Lead BI Engineer (GenAI) INR 2500K-3380KAI Agents | Azure SQL | DAX | Data Modeling | Data WarehousingCareer growth | Certification support | Growth chats | Idea tanks | MentorshipSenior-level Full TimeHyderabad, TS, India5h ago
-
Lead - Data Platform Engineering INR 2040K-2400KAlerting | Automation | Bash | CPU | Concurrency ControlSenior-level Full TimeChennai, India6h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India6h ago
-
Access Control | Ansible | Backup Management | Cisco UCS | ContainerizationSenior-level Full TimeBengaluru, KA, India7h ago
-
Senior AI & Automation Engineer (6+ years Generative AI, Agentic AI, LLMs, Python, APIs, MCP) INR 2500K-5000KAgentic AI | Agile | Conversational AI | LLM | LLMOpsSenior-level Full TimeBengaluru, KA, India7h ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India7h ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India7h ago
-
Gen AI - Consultant INR 2500K-4500KAWS SageMaker | Apache Airflow | Azure Machine Learning | CI/CD | Cloud ComputingSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Gen AI - Consultant INR 2500K-4500KAPI Design | AWS SageMaker | Apache Airflow | Apache Spark | Azure MLAccess to AI research labs and cloud platforms | Certification access | Mentoring opportunities | Work on global clientsSenior-level Full TimeBangalore, Karnataka, India7h ago
-
Software Engineer III-( Java, AWS & Pyspark ) INR 2000K-2200KAWS | AWS Athena | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeMumbai, Maharashtra, India8h ago
-
Software Engineer I - Data Infrastructure INR 1200K-1500KAlgorithms | C++ | Data Structures | Database Proxy | Database replicationInclusive culture | Professional developmentMid-level Full TimeBangalore, India8h ago
-
Senior-level Full TimeBengaluru, Karnataka, India9h ago
-
Assistant Vice President INR 240K-420KData Analysis | Data Science | Machine Learning | Model Deployment | PythonExecutive-level Full TimeIndia9h ago
-
Data & AI DevSecOps Specialist INR 2298K-2675KAccess Control | CI/CD | Cloud platform | Data Classification | Data PrivacySenior-level Full TimeBengaluru, IN, 56010310h ago
-
Data Engineering INR 2520K-3356KAWS | AWS CloudFormation | Amazon Redshift | Amazon S3 | Backup and RecoveryCode reviews | Continuous improvement | Mentoring and coaching | Onboarding support | Technical assessments participationSenior-level Full TimeIndia10h ago
-
CNN | Data Preprocessing | Decision Tree | Deep learning | Feature EngineeringHands-on training | Mentoring | Work reviewExecutive-level Full TimeHyderabad, Telangana, India10h ago
-
Java Cloud Native Lead INR 1800K-2300KAWS Glue | Amazon ECS | Amazon Web Services | FastAPI | GitHub ActionsSenior-level Full TimeIndia10h ago
-
Apache Airflow & AWS (S3/EMR/Bedrock) Data Platform Administrator / Operations Engineer INR 2535K-4200KAWS | AWS IAM | AWS KMS | Access Logging | Amazon Bedrock24x7 production supportSenior-level Full TimePune, Maharashtra, India10h ago
-
Lead Software Engineer - Python AWS Developer INR 2200K-3500KAPI Versioning | AWS SDK | AWS SDK for Python | AWS Secrets | AWS Secrets ManagerCareer growth | Collaborative team environment | Community of practice involvement | Mentorship | Technology adoption opportunitiesSenior-level Full TimeMumbai, Maharashtra, India11h ago
-
Azure Lead Data Engineer INR 2000K-2000KAzure Cloud | Azure Data | Azure Data Factory | Azure Data Lake | Azure FunctionsSenior-level Full TimeChennai, Tamil Nadu, India11h ago
-
Senior-level Full TimeHyderabad, Telangana, India11h ago