Software Engineer II - Data Engineer - Data & ML Engineering
Tasks
- Build real-time data ingestion pipelines
- Collaborate with data architects data analysts and data scientists
- Create and maintain data warehouse solutions
- Design and build data pipeline architecture
- Develop and maintain ETL/ELT pipelines
- Ensure data quality and integrity
- Implement and maintain security protocols
- Ingest data from multiple sources
- Optimize data storage and retrieval
- Validate and test data
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | AWS | AWS CloudFormation | AWS Glue | AWS Lake Formation | AWS Lambda | Amazon Athena | Amazon Glue | Amazon Glue Crawlers | Amazon Redshift | Amazon S3 | Boto3 | Data Ingestion | Data Quality | Data Security | Data Validation | Databricks | ELT | ETL | GitHub Actions | Glue Crawlers | Lake Formation | Real Time | Real-time Data | Real-time data ingestion | Tableau
Education
N/A
Roles
Data Engineer | Engineer | Engineer II | Software Engineer | Software Engineer II
Related jobs
-
Senior Data Engineer - Big Data & Automation INR 1500K-2500KAgile | Ansible | Apache Hive | Apache Spark | ArgoCDFlexible work policy | Work from homeSenior-level Full TimeIndia4h ago
-
Senior Data Engineer - ETL Framework INR 1500K-2500KApache Doris | Apache Hive | Apache Iceberg | Apache Spark | Apache TezFlexible work policy | Work from homeSenior-level Full TimeIndia4h ago
-
Lead Software Engineer - Java/Python, AWS, Spark INR 1500K-3000KAWS | AWS CloudFormation | AWS Step Functions | Airflow | Amazon S3Senior-level Full TimePune, Maharashtra, India6h ago
-
Consultant INR 1500K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageMid-level Full TimeBangalore, Karnataka, India6h ago
-
Executive-KDNI - Data & Analytics INR 1500K-5199KAWS | Azure | Dashboarding | Data Governance | Data ModelingExecutive-level Full TimeGurgaon, Haryana, India7h ago
-
Analytics Engineer - SQL & Data Visualization INR 1500K-2500KAgile | Cloud Data | Cloud Data Warehouse | Data Interpretation | Data ModelingMid-level Full TimeBengaluru, KA, India7h ago
-
AES - DE - Generative AI Application Developers INR 2500K-4200KAWS | Agent Loops | Anthropic | Asynchronous programming | AutogenSenior-level Full TimePune, Maharashtra, India7h ago
-
Ai / Data Engineer INR 2500K-3500KAgentic Workflows | Data Ingestion | Deduplication | Elasticsearch | Embedding ModelsMid-level Full TimeIndia8h ago
-
Senior-level Full TimePune8h ago
-
AWS | Apache Spark | Databricks | GenAI | Hugging FaceFlexible work arrangements | Professional growth opportunitiesSenior-level Full TimeIndia8h ago
-
Applied AI ML Senior Associate INR 2500K-4500KAPIs | AWS Bedrock | Azure OpenAI | CI/CD | DatabricksSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
TC-CS-IAM-AI and Agentic AI Engineer- Senior INR 2000K-4800KAWS | Agile | Autogen | Azure | ClassificationSenior-level Full TimeBengaluru, KA, IN, 56004814h ago
-
Data Architect INR 2600K-3380KAgile | Architecture governance | Architecture standards | Behavior-Driven Development | CI/CDDiversity and inclusion | Remote WorkingSenior-level Full Timehyderabad, India14h ago
-
Senior-level Full TimeBangalore, India14h ago
-
Data Analyst/PowerBI Engineer INR 1628K-2500KData Modeling | ETL | Microsoft Excel | Microsoft Fabric | Power BISenior-level Full TimeHyderabad, Telangana, India - Remote R14h ago
-
Senior Data Engineer INR 3000K-4000KAmazon Redshift | BigQuery | DBT | Data Modeling | Data WarehousingGlobal opportunities | Inclusive onboarding | Supportive work culture | Wellness programSenior-level Full TimeMumbai, Maharashtra, India14h ago
-
Data Engineer – Databricks INR 1500K-2500KAWS | AWS Glue | Amazon Redshift | Apache Spark | DatabricksSenior-level Full TimePune IN (Office: 5th & 6th …14h ago
-
Mid-level Full TimePune, Gera Commerzone SEZ, India14h ago
-
Data Scientist - MLOps INR 1500K-2500KAWS | Apache Airflow | CI/CD | CloudFormation | Data GovernanceMid-level Full TimePune, Gera Commerzone SEZ, India14h ago
-
Databricks AWS Engineer - Vice President INR 1500K-6000KAWS | Apache Spark | Auto Scaling | Data Modeling | Data ValidationExecutive-level Full TimePLOT NO-1, S.NO. 77, India14h ago
-
Artificial Intelligence / Machine Learning Engineer Lead (GenAI-powered applications) INR 2475K-3500KAWS | Agentic AI | Agents | Azure | CI/CDSenior-level Full TimeIND BNGL FL2-3 TWR 3, India14h ago
-
Software Engineer/AI-ML INR 2500K-5000KAI Search | AWS | AWS Bedrock | AWS SageMaker | Agent systemsSenior-level Full TimeIndia GCC-Puppalaguda Village14h ago
-
Entry-level Full TimePune, Gera Commerzone SEZ, India14h ago
-
Executive-level Full TimeMumbai, Nirlon Knowledge Park (BX) 9th …14h ago
-
Mid-level Full TimePune, Gera Commerzone SEZ, India14h ago