Sr Data Engineer
Tasks
- Apply data security and privacy measures
- Build and maintain data pipelines
- Build integrations with SQL databases APIs and cloud storage
- Collaborate with cross-functional teams on data requirements
- Design data solutions for collection and processing
- Develop ETL ELT and data integration pipelines
- Develop and maintain data models and data dictionaries
- Identify and resolve complex data challenges
- Implement ETL processes for data migration and deployment
- Implement automated data ingestion transformation and deployment workflows
- Leverage cloud platforms to build scalable data solutions
- Monitor and schedule data pipeline jobs
- Perform Spark performance optimization
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | AWS | Apache Airflow | Apache Spark | CCPA | Caching | Data Governance | Data Modeling | Data Pipelines | Data Privacy | Data Security | Data Warehousing | Data integration | Databricks | Databricks Jobs | ELT | ETL | GDPR | Indexing | Partitioning | PySpark | SQL | Spark SQL | Workflow Orchestration
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Mid-level Full TimeHaryana, Gurugram, India2h ago
-
GCP Cloud Database Specialist INR 1000K-1500KBackup and Restore | Cloud Databases | Cloud platform | Data Reconciliation | Data ValidationMid-level Full TimeIN-AP-Hyderabad3h ago
-
Data Engineer II INR 1500K-2000KApache Spark | Azure Data | Azure Data Explorer | Azure Data Factory | Azure SynapseMid-level Full TimeHyderabad, TS, IN10h ago
-
AWS | Agent systems | Agentic AI | Amazon SageMaker | Autonomous AgentsSenior-level Full TimeBengaluru Millenia, India16h ago
-
Azure Databricks | CI/CD | Data Pipelines | Data integration | ETLSenior-level Full TimeGurugram 10 C, India16h ago
-
Azure Databricks | Data integration | ETL | Filtering | JoiningSenior-level Full TimeGurugram 10 C, India16h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Azure | CI/CD | Data Augmentation | Data PreprocessingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | CI/CD | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | Azure | CI/CDFlexibility program | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India16h ago
-
Module Lead - GCP Data Engineer Job INR 1650K-3200KBigQuery | Bigtable | CI/CD | Cloud Build | Cloud NetworkingContinuous learning | Flexible work arrangements | Stable employmentSenior-level Full TimeHyderabad, TG, IN16h ago
-
Senior Principal Engineer - Data Engineering INR 3000K-4000KAWS | Apache Spark | Automation | Azure Data | Azure Data FactoryHybrid work environment | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimePune - Panchshil, India R16h ago
-
Senior Data Engineer INR 3000K-4000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Machine LearningSenior-level Full TimeIT Centre Bengaluru GDTC, India16h ago
-
Lead AI Designer– Agentic AI (L6) INR 2000K-3500KAPIs | AWS | Agent SDK | Asynchronous programming | AutogenSenior-level Full TimePune, India16h ago
-
Senior Data Engineer INR 3000K-4000KAgile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DataSenior-level Full TimeIT Centre Bengaluru GDTC, India16h ago
-
Associate, Data Engineer INR 1400K-2700KApache Airflow | Azure Blob | Azure Blob Storage | Azure Event | Azure Event GridComprehensive healthcare | Flexible time off | Flexible-hybrid work | Tuition reimbursementMid-level Full TimeM11 - Commers III, 43, 44 … R16h ago
-
Senior-level Full TimeIndia19h ago
-
Data Engineer INR 1200K-1496KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud BuildEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India22h ago
-
Data Integration Engineer INR 1200K-2000KCycle management | Data Modeling | Data Quality | Data Reconciliation | Data ValidationSenior-level Full TimeHyderabad, Telangana, US23h ago
-
Staff Software Engineer - Semantic Layer INR 3000K-4000KAPI Design | Amazon Redshift | Backwards Compatibility | BigQuery | CompilationSenior-level Full TimeIndia - Remote R1d ago
-
Senior Associate - Data INR 1500K-2000KAzure Data | Azure Data Factory | Azure DevOps | Azure SQL | CI/CDMid-level Full TimePune1d ago
-
Lead Associate - Data Architect INR 1500K-2000KAmazon Web Services | Automated data pipelines | Azure | Business Intelligence | Data GovernanceMid-level Full TimePune1d ago
-
Data Governance Engineer INR 3000K-4200KAI Governance | Access Control | Data Classification | Data Governance | Data Lifecycle ManagementCompetitive leave | Equity | Growth opportunities | Health coverageSenior-level Full TimePune, India1d ago
-
Staff Engineer - Java,Scala,AWS INR 3000K-4000KAWS S3 | Agile | Amazon ECS | Amazon EFS | Amazon EMRFamily wellbeing benefits | Health benefits | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India1d ago
-
Senior Data Engineer INR 3000K-4000KApache Airflow | Apache Spark | Azure | Azure Databricks | CI/CDSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai1d ago