Senior Data Engineer
Bengaluru, Karnataka, India
INR 2520K-3380K (estimate) Senior-level Full Time
Tasks
- Automate CI/CD
- Build batch data pipelines
- Build data observability monitoring
- Design analytics ready datasets
- Design real-time data pipelines
- Implement data pipeline testing
- Implement data quality validation
- Improve platform scalability performance and cost efficiency
- Partner with data scientists analysts ML engineers to define use cases
- Perform code reviews
- Translate datasets into actionable insights
- Troubleshoot data infrastructure issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Apache Spark | Artifact Repository | Azure | CI/CD | Cassandra | Cloud platform | Code review | Data Quality | Databricks | Delta Lake | Distributed Systems | Docker | Google Cloud | Google Cloud Platform | Integration Testing | JFrog | Kafka | Kubernetes | Observability | Octopus | ProGet | Python | Snowflake | Streaming | TeamCity | Terraform | Unit Testing | Unity Catalog
Education
N/A
Roles
Related jobs
-
Data Engineer (Position located in Bengaluru, India) INR 2000K-2040KAnalytics | Data Lake | Data Modeling | Data Pipelines | Data WarehousingAdoption Assistance | Certification completion bonuses | Certification reimbursement | Tuition reimbursementMid-level Full TimeBengaluru, India13h ago
-
Senior Principal Consultant, Gen_AI Engineer INR 2500K-4000KAWS | Agentic AI | Azure OpenAI | Cloud Native | Cloud platformSenior-level Full TimeIndia-Bangalore19h ago
-
Consultant_ GCP Data Engineer INR 1200K-2000KAirflow | BigQuery | Cloud Composer | Cloud Functions | Cloud StorageAI certifications | Training and mentorshipEntry-level Full TimeIndia-Gurugram19h ago
-
Lead Consultant, Gen_AI Engineer with MCP server expertise! INR 2500K-4000KAWS | Agentic AI | Amazon SageMaker | Azure | Azure OpenAISenior-level Full TimeIndia-Bangalore19h ago
-
A/B | A/B Testing | B testing | Constrained optimization | DockerFlexible working hours | Remote work | Short term contractSenior-level ContractNoida, India19h ago
-
AI/ML Engineer INR 2500K-4000KAzure Cognitive | Azure Cognitive Search | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeIN-HR-Gurgaon19h ago
-
AIML Engineer INR 2500K-4000KAzure Data | Azure Data Factory | Azure Data Lake | Cognitive Search | Data FactorySenior-level Full TimeIN-HR-Gurgaon19h ago
-
Pyspark Databricks AWS INR 500K-2000KAWS Glue | Agile | Airflow | Amazon Web Services | Apache KafkaSenior-level Full TimeIN-TN-Chennai19h ago
-
Senior-level Full TimeIN-TN-Chennai19h ago
-
AI/ML-Data Scientist INR 2500K-3500KAzure Data | Azure Data Factory | Azure Data Lake | Azure OpenAI | Cognitive SearchSenior-level Full TimeIN-HR-Gurgaon19h ago
-
Senior Software Engineer, Next Gen Data Warehouse Napa INR 2040K-2156KArtificial Intelligence | Data Modeling | Data Storage | Distributed Systems | GoogleSQLSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Software Engineer, AI Agents, Tools and Productivity INR 1300K-2000KAccessibility | Algorithms | Data Modeling | Data Structures | Distributed SystemsMid-level Full TimeBengaluru, Karnataka, India; Hyderabad, Telangana, India21h ago
-
Mid-level Full TimePune, Maharashtra, India21h ago
-
AWS Lead Data Engineer INR 2000K-2040KAWS | AWS Glue | AWS architecture | Agile methodology | Amazon AuroraSenior-level Full TimeGurugram, Haryana, India21h ago
-
Senior-level Full TimeNew Delhi, DL, India21h ago
-
Senior Data Engineer INR 1800K-2146KApache Airflow | BigQuery | Cloud Functions | Cloud SQL | Cloud platformSenior-level Full TimeHyderabad; Pune, Maharashtra, India21h ago
-
Senior-level Full TimeGurugram, Haryana, India; Noida, Uttar Pradesh, …21h ago
-
DE&A - Core - Cloud Data Engineering - Azure Data Engineering INR 1500K-2000KAggregation pipelines | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DBMid-level Full TimePune, Maharashtra, India22h ago
-
Lead Software Engineer - AWS, PySpark, BigData INR 2000K-2450KAWS | AWS CDK | AWS Lambda | Agile | AirflowSenior-level Full TimeHyderabad, Telangana, India23h ago
-
API Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Amazon APIEntry-level Full TimeMumbai, MH, India23h ago
-
Software Engineer III - AWS, PySpark, ETL INR 2000K-2450KAWS EMR | Agile | Apache Spark | CI/CD | Data ModelingSenior-level Full TimeHyderabad, Telangana, India23h ago
-
Software Engineer III - PySpark, BigData, AWS INR 2050K-2600KAWS | Agile | Amazon Web Services | Application Resiliency | Application SecuritySenior-level Full TimeHyderabad, Telangana, India23h ago
-
Senior AI/ML Engineer I INR 2500K-4000KAgentic AI | Azure | BERT | Continuous integration | Distributed SystemsCertification programs | Education reimbursement | Employee Assistance Program (EAP) | Flexible work options | Health coverageSenior-level Full TimeHyderabad, Telangana, India23h ago
-
Senior Embedded DevOps Engineer INR 2229K-2500KAutomotive Software | Build Tools | CI/CD | Change Management | Cloud ComputingSenior-level Full TimeBangalore, IN, 56010023h ago
-
Consultant - Python Developer with Gen AI INR 1500K-2000KAI Search | Agile | Azure | Azure OpenAI | CSSMid-level Full TimeBangalore, Karnataka, India23h ago