Data Engineer (PySpark)
Bengaluru, Karnataka, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Build and optimize data pipelines
- Contribute to continuous improvement in Agile environment
- Design and develop ETL pipelines
- Develop data solutions aligned with data models
- Ensure data quality, integrity, and consistency
- Gather data requirements
- Perform data profiling
- Perform impact analysis
- Perform unit testing
- Support deployments and production
- Use AI assisted tools for development efficiency
Perks/Benefits
- N/A
Skills/Tech-stack
AI Assisted Development | Data Mapping | Data Modeling | Data Warehousing | Data profiling | ELT | ETL | Informatica BDM | Informatica BDM Development | Performance Tuning | PySpark | SQL
Education
N/A
Roles
Related jobs
-
Mid-level Full TimeHaryana, Gurugram, India7h ago
-
GCP Cloud Database Specialist INR 1000K-1500KBackup and Restore | Cloud Databases | Cloud platform | Data Reconciliation | Data ValidationMid-level Full TimeIN-AP-Hyderabad8h ago
-
Data Engineer II INR 1500K-2000KApache Spark | Azure Data | Azure Data Explorer | Azure Data Factory | Azure SynapseMid-level Full TimeHyderabad, TS, IN15h ago
-
Azure Databricks | CI/CD | Data Pipelines | Data integration | ETLSenior-level Full TimeGurugram 10 C, India21h ago
-
Azure Databricks | Data integration | ETL | Filtering | JoiningSenior-level Full TimeGurugram 10 C, India21h ago
-
Module Lead - GCP Data Engineer Job INR 1650K-3200KBigQuery | Bigtable | CI/CD | Cloud Build | Cloud NetworkingContinuous learning | Flexible work arrangements | Stable employmentSenior-level Full TimeHyderabad, TG, IN21h ago
-
Senior Principal Engineer - Data Engineering INR 3000K-4000KAWS | Apache Spark | Automation | Azure Data | Azure Data FactoryHybrid work environment | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimePune - Panchshil, India R21h ago
-
Senior Data Engineer INR 3000K-4000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Machine LearningSenior-level Full TimeIT Centre Bengaluru GDTC, India21h ago
-
Senior Data Engineer INR 3000K-4000KAgile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DataSenior-level Full TimeIT Centre Bengaluru GDTC, India21h ago
-
Associate, Data Engineer INR 1400K-2700KApache Airflow | Azure Blob | Azure Blob Storage | Azure Event | Azure Event GridComprehensive healthcare | Flexible time off | Flexible-hybrid work | Tuition reimbursementMid-level Full TimeM11 - Commers III, 43, 44 … R21h ago
-
A/B | A/B Testing | AWS | Azure | B testingFlexible work arrangements | Hybrid work environment | MentorshipSenior-level Full TimeMumbai Goregaon, India21h ago
-
Agile | Data Cleansing | Data Enrichment | Data Governance | Data ManagementFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimePune, India21h ago
-
Azure | Azure Databricks | ETL | PySpark | PythonFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India21h ago
-
Azure Databricks | ETL | PySpark | PythonFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimeGurugram 10 C, India21h ago
-
26-2253: Data Engineer, AI/BI: Hyderabad, India INR 1500K-2040KAWS Kinesis | Access Control | Airflow | Amazon Redshift | Apache BeamMid-level Full TimeHyderabad, Telangana21h ago
-
Senior Data Engineer INR 3000K-4000KAgile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DataSenior-level Full TimeIT Centre Bengaluru GDTC, India21h ago
-
IN-Sr Associate_GEN AI _D&A _Advisory _Gurgaon INR 3000K-5000KAPI Gateway | AWS Bedrock | AWS Lambda | AWS SageMaker | AWS Step FunctionsSenior-level Full TimeGurugram 10 C, India21h ago
-
Senior-level Full TimeIndia1d ago
-
Data Engineer INR 1200K-1496KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud BuildEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India1d ago
-
Data Integration Engineer INR 1200K-2000KCycle management | Data Modeling | Data Quality | Data Reconciliation | Data ValidationSenior-level Full TimeHyderabad, Telangana, US1d ago
-
Staff Software Engineer - Semantic Layer INR 3000K-4000KAPI Design | Amazon Redshift | Backwards Compatibility | BigQuery | CompilationSenior-level Full TimeIndia - Remote R1d ago
-
Senior Associate - Data INR 1500K-2000KAzure Data | Azure Data Factory | Azure DevOps | Azure SQL | CI/CDMid-level Full TimePune1d ago
-
Lead Associate - Data Architect INR 1500K-2000KAmazon Web Services | Automated data pipelines | Azure | Business Intelligence | Data GovernanceMid-level Full TimePune1d ago
-
Database Engineer INR 1500K-2400KAWS RDS | Azure SQL | Backup and Recovery | Data Modeling | Data WarehousingSenior-level Full TimeIN-TN-Chennai1d ago
-
Database Engineer INR 1500K-2500KAWS RDS | Azure SQL | Azure SQL Database | Cassandra | Cloud DatabasesSenior-level Full TimeIN-TN-Chennai1d ago