Senior Data Engineer - Real-time Resource Allocation
Tasks
- Build Data Integration solutions
- Build scalable cloud data solutions
- Collaborate with product teams on data requirements
- Deliver pipelines from development to deployment
- Develop data pipelines
- Develop in Agile product environment
- Ensure data quality and integrity
- Follow data engineering industry standards
- Implement ETL and ELT processes
- Migrate code using code migration tools
- Stay current with data technologies
- Test and monitor data systems
- Use Git for version control
- Use Jira to track work
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Azure | CI/CD | Data Modeling | Data Quality | Data integration | Data pipeline | Data pipeline orchestration | Databricks | DevOps | ELT | ETL | GCP | Git | Jenkins | Jira | Maven | NoSQL | Pipeline Orchestration | Plotly | PySpark | Python | SQL | Subversion | Test-Driven | Test-Driven Development | Unit Testing
Education
Roles
Related jobs
-
AWS | Agent systems | Agentic AI | Amazon SageMaker | Autonomous AgentsSenior-level Full TimeBengaluru Millenia, India6h ago
-
AWS SageMaker | Agent systems | Agentic AI | Autonomous Agents | Azure Machine LearningSenior-level Full TimeBengaluru Millenia, India6h ago
-
Agent systems | Amazon SageMaker | Autonomous Agents | Azure ML | Computer VisionFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India6h ago
-
Agent systems | Agentic AI | Amazon SageMaker | Autonomous Agents | Azure Machine LearningFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India6h ago
-
Azure Databricks | CI/CD | Data Pipelines | Data integration | ETLSenior-level Full TimeGurugram 10 C, India6h ago
-
Azure Databricks | Data integration | ETL | Filtering | JoiningSenior-level Full TimeGurugram 10 C, India6h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Azure | CI/CD | Data Augmentation | Data PreprocessingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India6h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | CI/CD | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India6h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | Azure | CI/CDFlexibility program | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India6h ago
-
Applied AI Engineer, Agentic Systems INR 2755K-5500K.NET | API Development | Agent Orchestration | Anthropic API | C SharpSenior-level Full TimeRemote - India R11h ago
-
Data Engineer INR 1200K-1496KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud BuildEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India12h ago
-
Data Governance Engineer INR 3000K-4200KAI Governance | Access Control | Data Classification | Data Governance | Data Lifecycle ManagementCompetitive leave | Equity | Growth opportunities | Health coverageSenior-level Full TimePune, India15h ago
-
Sr. DevOps Engineer INR 2500K-3500KAIOps | AKS | ARM | Azure Container | Azure Container RegistryRotational on-call supportSenior-level Full TimeHyderabad, India16h ago
-
Staff Engineer - Java,Scala,AWS INR 3000K-4000KAWS S3 | Agile | Amazon ECS | Amazon EFS | Amazon EMRFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India17h ago
-
Senior AI & Automation Engineer (6+ years Generative AI, Agentic AI, LLMs, Python, APIs, MCP) INR 2000K-6000KAgentic AI | Analytics | LLMOps | Language Models | Language ProcessingSenior-level Full TimeBengaluru, KA, India17h ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai17h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai17h ago
-
Gen AI Developer INR 2000K-3000KAPI Integration | Claude API | Context Management | CrewAI | FastAPIMid-level Full TimeIN-MH-Pune17h ago
-
Senior-level Full TimeIN-TN-Chennai17h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad17h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad17h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad17h ago
-
Senior-level Full TimeIndia18h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India19h ago
-
Staff Software Engineer, Android Embedded Software INR 2000K-3200KAndroid | C++ | Distributed Systems | Java | Performance optimizationSenior-level Full TimeBengaluru, Karnataka, India19h ago