Data Engineer (PySpark)
Bengaluru, Karnataka, India
INR 1500K-2000K (estimate) Mid-level Full Time
Tasks
- Build data solutions aligned with enterprise data models
- Collaborate with business teams to gather data requirements
- Conduct technical data mapping and data profiling
- Design and develop ETL pipelines
- Ensure data quality, consistency, and integrity
- Maintain ETL pipelines for data extraction transformation and loading
- Optimize data pipelines using PySpark
- Perform impact assessment for data changes
- Perform unit testing debugging and deployment for data solutions
- Work with cross functional teams including architects and QA
Perks/Benefits
- N/A
Skills/Tech-stack
Data Compliance | Data Governance | Data Mapping | Data Pipeline Architecture | Data Processing | Data Warehousing | Data pipeline | Data profiling | Distributed data | Distributed data processing | ELT | ETL | Hadoop | Informatica BDM | Pipeline architecture | PySpark | SQL
Education
N/A
Roles
Related jobs
-
Data Management AI Lead INR 2500K-3380KAWS | Agent Orchestration | Agent systems | Azure | Cloud DataSenior-level Full TimeBangalore, Karnataka, IN4h ago
-
Lead Data Engineer - Tieto Tech Consulting (m/f/d) INR 2400K-2800KAzure | Azure Data | Azure Data Factory | CI/CD | Data FactoryContinuous learning | Flexible hybrid work model | Open culture | Professional growth | Work-life balanceSenior-level Full TimeBangalore, India6h ago
-
Sr Data Engineer INR 3200K-4600KAWS | Apache Airflow | Apache Spark | Data Modeling | Google CloudCommuter benefits | Disability coverage | Financial wellness support | Healthcare | Life insuranceSenior-level Full TimeBengaluru, India7h ago
-
Principal Engineer – Data Platform INR 2000K-2000KAWS | Access Control | Apache Flink | Apache Iceberg | Apache KafkaContinuous learning | Culture first work environment | High-trust work environment | Unlimited vacation policySenior-level Full TimeBengaluru7h ago
-
QA Automation - Robot framework + Python INR 2092K-2829KAPI Testing | Cucumber | JUnit | Postman | PythonSenior-level Full TimeHyderabad, TG, IN12h ago
-
Systems Integration Specialist Advisor INR 2516K-3356KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeBangalore, KA, IN12h ago
-
Data Engineer (PySpark) INR 1500K-2500KAI Assisted Development | Data Mapping | Data Modeling | Data Warehousing | Data profilingMid-level Full TimeBengaluru, Karnataka, India12h ago
-
Senior Data Engineer INR 2520K-3380KAPI Authentication | Continuous integration | DevOps | Docker | DruidSenior-level Full TimeChennai, TN, IN12h ago
-
Data Engineer (PySpark/Informatica BDM) INR 500K-575KAWS | Azure | CI/CD | Data Governance | Data MappingSenior-level Full TimeBengaluru, Karnataka, India12h ago
-
EDS-Senior Associate-Databricks INR 1431K-2000KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | Data GovernanceSenior-level Full TimeTrivandrum, KL, IN, 69558112h ago
-
Power BI Engineer INR 800K-1500KAzure Data | Azure Data Factory | Azure SQL | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeChennai, Tamil Nadu, India12h ago
-
EDS-Associate-PowerBI and SQL INR 2000K-3000KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | Data GovernanceMid-level Full TimeTrivandrum, KL, IN, 69558112h ago
-
Senior-level Full TimeGH Office: Chennai, India (Keppel)12h ago
-
Lead - Data Platform Engineering INR 2000K-2156KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeHyderabad, India19h ago
-
Data Engineer INR 1500K-2300KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkOffice based 5 days per weekMid-level Full TimeGurgaon, India20h ago
-
Senior Analytics Engineer I INR 2535K-3500KAirflow | Amazon S3 | CI/CD | Cloud Storage | Command LineHybrid work modelSenior-level Full TimeGurugram21h ago
-
CI/CD | Cloud Platforms | Data Architectures | Data Engineering | Data ModelingHybrid work | Immediate join | VIRTUAL interviewMid-level ContractBangalore North, India22h ago
-
NLP Engineer (Remote) INR 2000K-3000KAsynchronous programming | BERT | Batch Processing | Data Preprocessing | ETLMid-level Full TimeGurgaon, India R22h ago
-
Lead BI Engineer (GenAI) INR 2500K-3380KAI Agents | Azure SQL | DAX | Data Modeling | Data WarehousingCareer growth | Certification support | Growth chats | Idea tanks | MentorshipSenior-level Full TimeHyderabad, TS, India1d ago
-
Lead - Data Platform Engineering INR 2040K-2400KAlerting | Automation | Bash | CPU | Concurrency ControlSenior-level Full TimeChennai, India1d ago
-
Mid-level Full TimeChennai, Tamil Nadu, India1d ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India1d ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India1d ago
-
Gen AI - Consultant INR 2500K-4500KAWS SageMaker | Apache Airflow | Azure Machine Learning | CI/CD | Cloud ComputingSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Gen AI - Consultant INR 2500K-4500KAPI Design | AWS SageMaker | Apache Airflow | Apache Spark | Azure MLAccess to AI research labs and cloud platforms | Certification access | Mentoring opportunities | Work on global clientsSenior-level Full TimeBangalore, Karnataka, India1d ago