Senior Data Engineer
Tasks
- Build scalable data pipelines for real time and batch processing
- Collaborate with data science and ML teams to productionize AI solutions
- Deploy monitor and troubleshoot production data systems
- Develop backend components for data processing
- Develop data platforms for ML workflows
- Follow engineering best practices code quality testing and CI CD pipelines
- Optimize pipeline performance, reliability, and scalability
- Solve data engineering problems for AI agents
- Work with distributed systems in containerized environments
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Kinesis | AWS Lambda | Amazon EKS | Amazon S3 | Amazon SQS | Apache Airflow | Cassandra | Data Modeling | Databases | Docker | Git | GitHub | Jenkins | Kubernetes | Linux | MongoDB | NoSQL | Prompt engineering | Python | RAG | SQL
Education
Roles
Related jobs
-
Senior Software Engineer INR 3264K-5000KAPI Testing | AWS | Amazon Web Services | Ansible | Artificial IntelligenceFamily wellbeing benefits | Health and wellbeing benefits | Paid time offSenior-level Full TimeHyderabad, India3h ago
-
Staff Software Engineer - Database Engineering INR 2771K-4064KAmazon Aurora | Ansible | Cassandra | Citus | Configuration ManagementSenior-level Full TimeBangalore, India R4h ago
-
Snowflake & DBT Expert INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | CI/CDSenior-level Full TimeNoida, UTTAR PRADESH, India4h ago
-
APIs | Agent workflows | C++ | Caching | CancellationSenior-level Full TimeBengaluru, India5h ago
-
GCP Data Engineer Lead INR 2000K-2500KApache Airflow | BigQuery | CI/CD | Cloud Composer | Cloud FunctionsSenior-level Full TimeHyderabad, //TS, India5h ago
-
Access Control | Apache Airflow | Auditability | Azure | Change Data CaptureCollaborative environment | Documentation and architecture diagram creation support | Flexible contract engagement | Fully remote | Knowledge sharing cultureSenior-level Contract Full TimeIndia R6h ago
-
Alerting | Batch Processing | Big Table | Data Modeling | Data ObservabilityFully remote | Inclusion and collaboration culture | Professional growth opportunities | Well-being support | Work-life balance initiativesMid-level Full TimeIndia R7h ago
-
AI Engineer/Scientist INR 1800K-3000KAWS | Agentic Workflows | C++ | Data Structures | Data Structures and AlgorithmsHybrid work schedule | Mentorship | Onsite days 3 days per weekMid-level Full TimeBengaluru R8h ago
-
Senior Engineer - Platform & Data Infrastructure INR 3000K-5000KAWS IoT | AWS IoT Core | ClickHouse | ECS | GoSenior-level Full TimeHyderbad10h ago
-
Sr Technical Lead-Data Engg INR 1500K-2500KAzure | Crystal Reports | DAX | Data Governance | Microsoft FabricSenior-level Full TimeINDIA - BENGALURU - BIRLASOFT OFFICE, …11h ago
-
Entry-level Full TimeBangalore, India; Sunnyvale, CA; San Bruno, …15h ago
-
Apache Spark | Avro | Azure Data | Azure Data Factory | Azure Data LakeRemote work optionMid-level Full TimeDallas / Philadelphia, USA; Bangalore, India; …15h ago
-
AWS | Amazon Aurora | Amazon RDS | Amazon S3 | CI/CDMid-level Full TimeDahisar West, Maharashtra18h ago
-
Data Platform Operations Engineer (Databricks, DBT, Snowflake, AWS, Aurora) - Mumbai, MH - AS A INR 1300K-2000KAmazon Aurora | Amazon S3 | Amazon Web Services | Backup and Recovery | CDCMid-level Full TimeMumbai, MH18h ago
-
Apache Spark | Data Pipelines | Data Validation | Databricks | Feature EngineeringMid-level Full TimeMumbai, MH18h ago
-
Data Platform Engineer GBP 76K-100KAWS EC2 | AWS Glue | AWS IAM | AWS Secrets | AWS Secrets ManagerCertification study budget | Course and conference budget | Funded certification paths | Hybrid/Remote flexibility | On-call rotationSenior-level Full TimeAshford, England, United Kingdom; Bengaluru, Karnataka, …18h ago
-
Lead MySQL Database Engineer INR 2500K-3100KAWS Aurora | AWS RDS | Amazon Web Services | Ansible | Backup and RecoveryCareer development | In-office work culture | Non-salary benefitsSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Kafka Administrator INR 3000K-4200KAWS | AWS Glue | AWS IAM | AWS Secrets | AWS Secrets ManagerBudget for courses and technical conferences | Funded certification paths | Hybrid/Remote flexibility | In-office work culture | Mentorship and career progressionSenior-level Full TimeBengaluru, Karnataka, India18h ago
-
Lead Software Engineer - Machine Learning INR 5000K-6612KCross-validation | Data Pipelines | Distributed Systems | Low Latency | Low-Latency SystemsSenior-level Full TimeHyderabad, India21h ago
-
Software Engineer III - Python INR 3000K-5000KAlerting | CI/CD | Docker | Infrastructure as Code | KubernetesSenior-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior-level Full TimeBANGALORE, Karnataka, Inde21h ago
-
Agentic AI | Agile | Artificial Intelligence | Docker | Generative AISenior-level ContractShaikpet, India21h ago
-
Senior AI Engineer / Data Scientist (Agentic AI) INR 2000K-5000KAI Search | AI Services | Agentic AI | Azure | Azure AISenior-level Full TimeChennai, India22h ago
-
Senior Software Engineer - Enterprise Platforms INR 2200K-3465KApache Beam | Apache Flink | Apache Kafka | Code review | Continuous integrationHybrid workSenior-level Full TimeBengaluru, KA, India22h ago
-
Senior-level Full TimeIN-KA-Bangalore22h ago