Software Development Engineer 3
Tasks
- Collaborate with stakeholders to gather requirements
- Develop data pipelines
- Document data architecture and workflows
- Integrate data from multiple sources
- Manage data pipelines and transformations
- Optimize data workflows
- Troubleshoot pipeline and job failures
Perks/Benefits
- N/A
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure DevOps | CI/CD | Cloud Data | Cloud Data Architecture | Data Architecture | Data Factory | Data Warehousing | Delta Lake | Git | GitHub Actions | Materialized views | PySpark | RBAC | SQL | Snowflake | Snowpipe | Spark SQL | Streams | Tasks
Education
Roles
Related jobs
-
Azure Databricks | CI/CD | Data Pipelines | Data integration | ETLSenior-level Full TimeGurugram 10 C, India9h ago
-
Azure Databricks | Data integration | ETL | Filtering | JoiningSenior-level Full TimeGurugram 10 C, India9h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Azure | CI/CD | Data Augmentation | Data PreprocessingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India9h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | CI/CD | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India9h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | Azure | CI/CDFlexibility program | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India9h ago
-
Module Lead - GCP Data Engineer Job INR 1650K-3200KBigQuery | Bigtable | CI/CD | Cloud Build | Cloud NetworkingContinuous learning | Flexible work arrangements | Stable employmentSenior-level Full TimeHyderabad, TG, IN9h ago
-
Senior Principal Engineer - Data Engineering INR 3000K-4000KAWS | Apache Spark | Automation | Azure Data | Azure Data FactoryHybrid work environment | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimePune - Panchshil, India R9h ago
-
Data Engineer INR 1200K-1496KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud BuildEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India15h ago
-
Staff Software Engineer - Semantic Layer INR 3000K-4000KAPI Design | Amazon Redshift | Backwards Compatibility | BigQuery | CompilationSenior-level Full TimeIndia - Remote R17h ago
-
Lead Associate - Data Architect INR 1500K-2000KAmazon Web Services | Automated data pipelines | Azure | Business Intelligence | Data GovernanceMid-level Full TimePune17h ago
-
Sr. DevOps Engineer INR 2500K-3500KAIOps | AKS | ARM | Azure Container | Azure Container RegistryRotational on-call supportSenior-level Full TimeHyderabad, India19h ago
-
Senior Data Engineer INR 3000K-4000KApache Airflow | Apache Spark | Azure | Azure Databricks | CI/CDSenior-level Full TimeBengaluru, Karnataka, India20h ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai20h ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai20h ago
-
Senior-level Full TimeIN-TN-Chennai20h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad20h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad20h ago
-
Aws Etl INR 1500K-2000KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon CloudWatchMid-level Full TimeIN-AP-Hyderabad20h ago
-
Senior-level Full TimeIndia21h ago
-
Azure | Azure Blob | Azure Blob Storage | Azure DevOps | Azure MLSenior-level Full Timebengaluru, India22h ago
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India22h ago
-
Mid-level Full TimeMumbai, Maharashtra, India22h ago
-
Mid-level Full TimePune1d ago
-
Manager - Python with Gen AI INR 1800K-3000KAutogen | Claude | CrewAI | Data Pipelines | Event DrivenMid-level Full TimeBangalore, Karnataka, India1d ago
-
Lead Software Engineer - Big Data INR 2040K-3380KAmazon DynamoDB | Apache Avro | Apache Hive | Apache Kafka | Apache ParquetSenior-level Full TimeMumbai, Maharashtra, India1d ago