Software Engineer II - Data Engineer - Data & ML Engineering
Tasks
- Assemble large complex datasets
- Collaborate with data architects data analysts and data scientists
- Create and maintain data pipeline architecture
- Design real-time data ingestion pipelines
- Develop and maintain ETL/ELT pipelines
- Ensure data quality and integrity
- Implement and maintain data security protocols
- Ingest data into data warehouse
- Optimize data storage and retrieval
- Perform data validation and testing
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | AWS CloudFormation | AWS DataZone | AWS Glue | AWS Lambda | AWS Redshift | Amazon Athena | Amazon S3 | Amazon Web Services | Boto3 | Data Ingestion | Data Validation | Databricks | ELT | ETL | GitHub Actions | Lake Formation | Real Time | Real-time Data | Real-time data ingestion | Web Services
Education
N/A
Roles
Related jobs
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India2h ago
-
Sr. Data Engineer INR 2800K-4000KCloud warehousing | DAX | Dashboard Design | Data Quality | Data StorytellingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600377h ago
-
Analytics Solutions Associate - Data Strategy INR 800K-1250KAWS Databricks | AWS Redshift | Data Governance | Data Privacy | Data QualityMid-level Full TimeBengaluru, Karnataka, India8h ago
-
GIS Data Engineer II INR 2000K-2400KAWS | Amazon Athena | Amazon EC2 | Amazon RDS | Amazon S3MentorshipSenior-level Full TimeMumbai, MH, India9h ago
-
Amazon S3 | C# | C++ | Data Migration | Data replicationSenior-level Full TimeBengaluru, Karnataka, IND13h ago
-
Software Engineer - Embedded & Functional Safety Software INR 1753K-3440KAgile | Automated testing | C# | C++ | CAN busSenior-level Full TimeBangalore, IN13h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India13h ago
-
IN_Manager_SSIS_Data & Analytics_Advisory_Noida INR 1500K-2000KAWS | Azure | CI/CD | Cloud Data | Cloud Data PlatformsFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeNoida, India13h ago
-
EY - GDS Consulting - AI And DATA -Snowflake Architect -Manager INR 3000K-4000KAgile | Batch Processing | Cloud Data | Cloud Data Warehouse | DBTCareer development | Coaching and feedback | Flexible work arrangementSenior-level Full TimeHyderabad, TG, IN, 50008113h ago
-
Software Engineer INR 1400K-2000KAgile | Cloud services | Code review | Data Modeling | Database DesignMid-level Full TimePune, India21h ago
-
Mid-level Full TimeGurugram, Haryana, India22h ago
-
Amazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | Cloud platformContract employment | Hybrid work | VIRTUAL interviewSenior-level ContractBangalore North, India23h ago
-
Data Engineer INR 1500K-2040KAgentic AI | Cost Optimization | Data Architecture | Data Modeling | Data platformSenior-level Full TimeIN-MH-Pune1d ago
-
Data Engineer Architect. INR 1500K-2400KAPI Development | AWS | Agentic Engineering | Database optimization | FastAPISenior-level Full TimeIN-MH-Pune1d ago
-
AIML - Tech Lead INR 2500K-4500KApache Airflow | ETL | Entity recognition | Language Processing | Machine LearningSenior-level Full TimeIN-MH-Pune1d ago
-
Senior GenAI Developer INR 2500K-4800KAPI Gateway | AWS Bedrock | Agent systems | Agentic RAG | Amazon LambdaCertification programs | Global client projects | Health insurance | Internship opportunities | Language coursesSenior-level Full TimeAll Cities, India R1d ago
-
Senior-level Full TimeGurugram, Haryana, India1d ago
-
Senior-level Full TimeGurugram, Haryana, India1d ago
-
Software Engineer II - Gen AI/ Agentic AI INR 1500K-2500KAWS | Amazon Elastic Kubernetes Service | Amazon SageMaker | Data Processing | Data integrationMid-level Full TimeHyderabad, Telangana, India1d ago
-
Senior Software Engineer INR 2040K-3380KAmazon Web Services | Apache Kafka | Apache Spark | Azure | BFSSenior-level Full TimeBengaluru, KA, IN1d ago
-
Senior-level Full TimeBengaluru, Karnataka, India1d ago
-
Senior Lead Software Engineer - Java, PySpark, and AWS INR 1800K-2400KAWS | AWS Glue | AWS Lake Formation | AWS Lambda | AWS Step FunctionsSenior-level Full TimeHyderabad, Telangana, India1d ago
-
AWS | Agile | Amazon Web Services | Apache Airflow | Application ResiliencySenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Group Lead - Data Quality Engineer INR 1500K-2500KADLS Gen2 | Anomaly Detection | Apache Spark | Automated alerting | CI/CDSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Software Engineer (Data Engineering, Python, SQL, Snowflake, Cloud and Devops) INR 2500K-3380KAWS | AWS Step Functions | Airbyte | Airflow | Apache HudiCareer development opportunities | Employee Assistance Program (EAP) | Financial wellness tools | Flexible working environment | LinkedIn LearningSenior-level Full TimeChennai, TN, India1d ago