Data Engineer
Tasks
- Add error handling logging monitoring and alerting
- Automate repetitive tasks and create reusable frameworks
- Build metadata driven data ingestion and extraction framework
- Configure framework for extensibility
- Design data processing framework
- Develop data pipelines for ingestion transformation and extraction
- Implement data quality checks and validation
- Integrate AWS services for ingestion and extraction
- Lead data ingestion pipeline architecture
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Cloud | AWS Cloud Development Kit | AWS Glue | AWS IAM | AWS Lambda | AWS Step Functions | AWS cloud development | Amazon Athena | Amazon CloudWatch | Amazon Cognito | Amazon DynamoDB | Amazon EC2 | Amazon RDS | Amazon Redshift | Amazon S3 | Amazon SNS | Amazon SQS | Apache Kafka | Cloud Development Kit | MySQL | Oracle | PostgreSQL | PySpark | Python | SQL | Step Functions
Education
N/A
Roles
Related jobs
-
Software Engineer INR 1300K-2200KAcceptance Testing | Angular | Apache Solr | ArizeAI | Behavior-Driven DevelopmentMid-level Full TimeBangalore, Karnataka, India5h ago
-
Junior Data Scientist- Computer Vision INR 350K-360KComputer Vision | Convolutional Neural Networks | Deep learning | Machine Learning | MatplotlibEntry-level Full TimeBengaluru, India5h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India6h ago
-
Gen Ai INR 2000K-3000KAI Agents | AI Governance | AWS CodePipeline | Agent architecture | AuthenticationMid-level Full TimeIN-KA-Bangalore6h ago
-
Senior-level Full TimeIN-KA-Bangalore6h ago
-
Mid-level Full TimeIN-TN-Chennai6h ago
-
Agentic AI Engineer INR 1800K-2500KAI orchestration | API Integration | Automated testing | Automation | Azure DevOpsMid-level Full TimeIndia, West Bengal, Kolkata6h ago
-
Senior-level Full TimeGurugram, India8h ago
-
Data & Analytics Engineer - AM INR 1500K-2500KApache Spark | Data Modeling | Data Warehousing | Databricks | Delta LakeSenior-level Full TimeBangalore, Karnataka, India8h ago
-
Senior QA Engineer(Data Platform Testing) INR 2515K-2829KAPI Gateway | API Testing | AWS Lambda | Alerting | CI/CDReward and recognition | Volunteering opportunities | Wellness | Work-life balanceSenior-level Full TimeHyderabad, India9h ago
-
AI Engineer- Associate Consultant INR 2000K-3000KAgent Orchestration | Amazon Web Services | Autonomous Agents | Azure | ClassificationCollaborative work environment | Continuous learning | Inclusive cultureMid-level Full TimeBangalore, Karnataka, India9h ago
-
ROP - SE2/SSE - Azure Data INR 1500K-2500KAzure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure DevOpsMid-level Full TimeBengaluru, KA, IN9h ago
-
Applied AI ML Associate INR 3799K-5000KAWS | Artificial Intelligence | Cloud platform | Data Analysis | Data PipelinesEntry-level Full TimeBengaluru, Karnataka, India9h ago
-
Lead Software Engineer INR 4000K-5000KAWS | Agent Development | Agent systems | Amazon ECS | Amazon EKSSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Data Scientist and AI Engineer INR 2500K-5000KAlteryx | CI/CD | Classification | Cloud Build | Cloud FunctionsSenior-level Full TimeChennai, Tamil Nadu, India9h ago
-
GCP Data Engineer INR 1500K-2500KAPI Integration | BigQuery | Cloud platform | Data Governance | Data ModelingSenior-level Full TimeGurugram, Haryana, India11h ago
-
Senior Consultant_AWS Developer INR 1500K-3500KAWS Glue | AWS Lambda | AWS Step Functions | AWS Storage Gateway | AWS storageSenior-level Full TimeThane, IN, 40060413h ago
-
Applied AI ML Lead INR 3264K-5000KAI Libraries | API Development | AWS | Agentic AI | Agentic AI librariesSenior-level Full TimeBengaluru, Karnataka, India14h ago
-
Mid-level Full TimePune, Maharashtra, India14h ago
-
Senior Data Systems Software Engineer INR 1500K-3000KA/B | A/B Testing | API Versioning | API interoperability | AutomationLife insurance | Medical insurance | Retirement options | Volunteer programsSenior-level Full TimeBENGALURU, KARNATAKA, India16h ago
-
Mid-level Full TimePune, MH, IN, 41101417h ago
-
Senior AI Engineer - LLM Evaluation INR 3740K-5876KAI Governance | AI Observability | AWS | Azure | BenchmarkingSenior-level Full TimeAPAC - India - Bengaluru - …19h ago
-
Lead Data Engineer/ Data Architect INR 2000K-2800KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India - Remote R19h ago
-
Mid-level Full TimeBangalore, KA, IN19h ago
-
Data Engineer INR 1500K-2500KData Analysis | Data Engineering | Data Management | Data Modeling | Data pipelineHybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India19h ago