Software Engineer II - Data Engineer - Data & ML Engineering
Tasks
- Assemble large complex datasets
- Collaborate with data architects data analysts and data scientists
- Create and maintain data pipeline architecture
- Design real-time data ingestion pipelines
- Develop and maintain ETL/ELT pipelines
- Ensure data quality and integrity
- Implement and maintain data security protocols
- Ingest data into data warehouse
- Optimize data storage and retrieval
- Perform data validation and testing
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | AWS CloudFormation | AWS DataZone | AWS Glue | AWS Lambda | AWS Redshift | Amazon Athena | Amazon S3 | Amazon Web Services | Boto3 | Data Ingestion | Data Validation | Databricks | ELT | ETL | GitHub Actions | Lake Formation | Real Time | Real-time Data | Real-time data ingestion | Web Services
Education
N/A
Roles
Related jobs
-
Technical Support Engineer INR 850K-1100KAmazon Web Services | Apache Hadoop | Apache Spark | Bash | Cloud platformFlexible paid time offMid-level Full TimeHyderabad, India13h ago
-
Developer, Data Analytics INR 1200K-1968KBigQuery | Cloud Composer | Cloud Storage | Cloud platform | Data WarehousingHybrid workSenior-level Full TimeIndia-Telangana-Hyderabad18h ago
-
Senior Data Engineer INR 1300K-2000KBigQuery | Cloud Composer | Cloud Storage | Cloud platform | Data WarehousingHybrid workSenior-level Full TimeIndia-Telangana-Hyderabad18h ago
-
Software Engineer III Data Engineer-Python, AWS INR 2050K-3500KAWS | CI/CD | Databricks | ETL | PySparkSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Azure Data | Azure Data Factory | Azure Data Lake | Dashboards | Data CleansingSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Agentic AI Developer INR 2500K-2800KAPI Development | AWS | Azure | Deep learning | Deployment PipelinesMid-level Full Timepune, Maharastra, India20h ago
-
Software Engineer INR 316K-316KAzure Data | Azure Data Factory | Azure Synapse | Composite Models | DAXEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India20h ago
-
Cloud Engineer INR 750K-1000KAWS Lambda | Access Control | Access Control List | Amazon Web Services | Apache TomcatEnhanced medical benefits | Family well-being benefits | Health Safety and Wellbeing | Paid time off | Wellbeing benefitsMid-level Full TimeHyderabad, India20h ago
-
Analytics Solution Senior Associate INR 2000K-3380KAWS Glue | AWS Lambda | Agile methodologies | Data Governance | Data IngestionContinuous improvement | Inclusive work environment | TeamworkSenior-level Full TimeMumbai, Maharashtra, India20h ago
-
Senior Data Engineer INR 1200K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Alerting | Amazon EMRSenior-level Full TimeHyderabad, IN21h ago
-
Data Analytics - Power BI - ETL INR 1628K-2040KAzure Data | Azure Data Factory | DAX | Data Factory | Data ModelingSenior-level Full Time Part Timetelengana, India21h ago
-
Azure Data Engineer INR 1500K-2000KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SynapseMid-level Full TimeChennai, Tamil Nadu, India21h ago
-
Entry-level Full TimePune, ASIA, India23h ago
-
Senior-level Full TimePune, MAHĀRĀSHTRA, India23h ago
-
Lead Assistant Manager INR 1000K-2000KACID | Batch Processing | CI/CD | Data Ingestion | Data ModelingWork from office 5 days per weekSenior-level Full TimeGurugram, Haryana, India1d ago
-
Senior Data Engineer INR 2829K-3380KAccess Control | Airflow | Amazon Redshift | Apache Beam | Apache FlinkSenior-level Full TimeGurugram, India1d ago
-
Data Engineer INR 1000K-1350KAmazon Redshift | Apache Airflow | Apache Beam | Apache Flink | Apache HadoopMid-level Full TimeGurugram, India1d ago
-
Sr. SW Engineer - 3.5 Yrs to 6 Yrs , Java Backend , GenAI INR 2500K-3200KAI Observability | API Development | Agile | Angular | C#Senior-level Full TimeBengaluru, INDIA, India1d ago
-
Senior-level Full TimeMumbai, India1d ago
-
AI Foundry | AWS SageMaker | Amazon Web Services | Azure | Azure AIFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeBhubaneswar - Ihub, India1d ago
-
Amazon SageMaker | Amazon SageMaker Pipelines | Amazon Web Services | Azure | Azure Machine LearningMid-level Full TimeBhubaneswar - Ihub, India1d ago
-
Amazon Web Services | Anthropic | Azure | Azure Machine Learning | CI/CDMid-level Full TimeBhubaneswar - Ihub, India1d ago
-
Apache Airflow | Apache Hadoop | Azure Data | Azure Data Factory | Chroma DBFlexibility programs | Inclusive benefits | MentorshipSenior-level Full TimeKolkata Y-14, India1d ago
-
IN-Associate_Azure Databricks _ Data and Analytics_Advisory_Pune INR 2040K-2400KAnalytics Cloud | Azure Data | Azure Data Factory | BW/4HANA | Data FactoryFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimePune, India1d ago
-
IN_Associate 2_Azure Data Engineering _OC D&A_Advisory_Kolkata INR 1500K-2000KAgile | Azure | Azure Data | Azure Data Factory | Azure SQLFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportMid-level Full TimeKolkata Y-14, India1d ago