Data Engineer (AWS+Pyspark)
Hyderabad, Telangana, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Build data ingestion pipelines
- Design data pipelines
- Develop data transformation pipelines
- Implement monitoring and logging
- Manage IAM permissions
- Optimize SQL queries
- Support data processing pipelines
- Troubleshoot data pipeline issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS CloudTrail | AWS Glue | AWS Identity | AWS Identity and Access Management | AWS Lambda | Access Management | Amazon CloudWatch | Amazon DynamoDB | Amazon EMR | Amazon RDS | Amazon Simple Notification Service | Amazon Simple Queue Service | Amazon Web Services | Identity and Access Management | Lake Formation | Notification Service | PySpark | Python | SQL | Simple Notification Service | Simple Queue Service | Web Services
Education
N/A
Roles
Related jobs
-
AI/ML Test Engineer - Immediate Joiners Only INR 400K-480KData Preprocessing | Data pipeline | End to End | End-to-End Testing | F1-scoreEntry-level Full TimeBengaluru, KA, India1d ago
-
Senior Machine Learning Engineer INR 4000K-6000KA/B | A/B Testing | Apache Airflow | Apache Flink | Apache SparkSenior-level Full TimeBengaluru1d ago
-
Senior-level Full TimeIndia - Remote R1d ago
-
AI Solutions Engineer INR 2000K-4500KAgile methodology | Algorithms | Amazon Web Services | Apache Spark | Artificial IntelligenceMid-level Full TimePSR01 - Bengaluru, Pritech Park- SEZ …1d ago
-
AI Solutions Engineer INR 2000K-4500KAgile methodology | Algorithms | Amazon Web Services | Apache Spark | Big DataMid-level Full TimePSR01 - Bengaluru, Pritech Park- SEZ …1d ago
-
GDT Assistant Media Manager(MLOps/DevOps Engineer) INR 1500K-3158KAWS | Agent Orchestration | Argo CD | ArgoCD | AutogenMid-level Full TimeMumbai, Maharashtra1d ago
-
Sr Developer Software INR 2000K-4000KAWS | AWS Glue | AWS Lambda | Amazon ECS | Amazon EMRFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India1d ago
-
Mid-level Full TimeIndia2d ago
-
Mid-level Full TimePune, India2d ago
-
Data Architect INR 1500K-2600KApache Kafka | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore North, India2d ago
-
Senior AI/ML Engineer INR 3799K-5572KAI Security | AI Services | AWS | Agentic AI | AirflowAccident Coverage | Career growth | Group term life insurance | Health insurance | Hybrid work supportSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R2d ago
-
AI Engineer INR 1800K-5000KAPI Integration | Asynchronous programming | Autogen | Azure | CrewAICollaborative work culture | Flexible work environment | Generous PTO | Inclusive work culture | Medical insuranceMid-level Full TimeBangalore, Karnataka, India (Hybrid) R2d ago
-
Mid-level Full TimeIndia2d ago
-
AIML Engineer Digital & AI INR 3242K-5000KAWS | Azure | CI/CD | Deep learning | DockerAccident Coverage | Career growth | Group term life insurance | Internet allowance | Medical insuranceSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R2d ago
-
Lead Database Engineer INR 1500K-3000KAudit Logging | Azure Data | Azure Data Factory | Azure Database | Azure Database MigrationSenior-level Full TimePune City, India2d ago
-
Data Scientist INR 2500K-4500KAdvanced Statistics | Apache Spark | Azure Data | Azure Data Factory | Azure KubernetesEquity and inclusion focus | Mentorship opportunities | Travel to other locations in India and globally | Work on global projectsSenior-level Full TimeBangalore - Karnataka - India2d ago
-
Lead AI Engineer - Agentic Engineering INR 2500K-5000KAPI Design | Agent Orchestration | Agent systems | Autogen | Automated RegressionSenior-level Full TimeHyderabad, TS, India2d ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1200K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | Data ModelingContinuous professional development | Flexible working | Inclusive workplace cultureSenior-level Full TimeHyderabad, Telangana, India R2d ago
-
Senior-level Full Timebengaluru, India2d ago
-
Senior-level Full Timebengaluru, India2d ago
-
Senior-level Full Timebengaluru, India2d ago
-
Senior-level Full Timebengaluru, India2d ago
-
Sr.Data Engineering INR 1500K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event HubsSenior-level Full Timebengaluru, India2d ago
-
Senior-level Full TimePune, Maharashtra, India2d ago
-
Data Ingestion Engineer (ADF+Dbt+Snowflake) INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | DBT | Data FactoryMid-level Full TimePune, MH, India2d ago