Data Engineer (PySpark/Informatica BDM)
Bengaluru, Karnataka, India
INR 500K-575K (estimate) Senior-level Full Time
Tasks
- Deploy data pipelines
- Design ETL pipelines
- Develop data transformations
- Gather business requirements
- Load data into reporting systems
- Maintain documentation
- Map data sources
- Optimize data processing performance
- Perform impact analysis
- Profile data quality
- Run unit testing and validation
- Troubleshoot production issues
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Azure | CI/CD | Data Governance | Data Mapping | Data Modeling | Data Quality | Data Warehousing | Data profiling | Distributed Computing | ETL | GCP | GitHub Copilot | Informatica BDM | PySpark | SQL
Education
N/A
Roles
Related jobs
-
AWS | AWS Lambda | Agile | Apache Spark | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
Data Management AI Lead INR 2500K-3380KAWS | Agent Orchestration | Agent systems | Azure | Cloud DataSenior-level Full TimeBangalore, Karnataka, IN5h ago
-
Senior-level Full TimeBengaluru, INDIA, India6h ago
-
Senior ML Engineer INR 2500K-4500KAutogen | Automl | Azure | CI/CD | CrewAIEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeVadodara, GJ, India8h ago
-
Lead Data Engineer - Tieto Tech Consulting (m/f/d) INR 2400K-2800KAzure | Azure Data | Azure Data Factory | CI/CD | Data FactoryContinuous learning | Flexible hybrid work model | Open culture | Professional growth | Work-life balanceSenior-level Full TimeBangalore, India8h ago
-
Sr Data Engineer INR 3200K-4600KAWS | Apache Airflow | Apache Spark | Data Modeling | Google CloudCommuter benefits | Disability coverage | Financial wellness support | Healthcare | Life insuranceSenior-level Full TimeBengaluru, India8h ago
-
Principal Engineer – Data Platform INR 2000K-2000KAWS | Access Control | Apache Flink | Apache Iceberg | Apache KafkaContinuous learning | Culture first work environment | High-trust work environment | Unlimited vacation policySenior-level Full TimeBengaluru9h ago
-
Senior-level Full TimeHyderabad, India9h ago
-
QA Automation - Robot framework + Python INR 2092K-2829KAPI Testing | Cucumber | JUnit | Postman | PythonSenior-level Full TimeHyderabad, TG, IN13h ago
-
Systems Integration Specialist Advisor INR 2516K-3356KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeBangalore, KA, IN13h ago
-
Data Engineer (PySpark) INR 1500K-2500KAI Assisted Development | Data Mapping | Data Modeling | Data Warehousing | Data profilingMid-level Full TimeBengaluru, Karnataka, India13h ago
-
Data Engineer - Real-Time Streaming INR 1400K-1500KApache Flink | Apache Kafka | CI/CD | Cloudera | Distributed SystemsMid-level Full TimeChennai, Tamil Nadu, India13h ago
-
Data Engineer (PySpark) INR 1500K-2000KData Compliance | Data Governance | Data Mapping | Data Pipeline Architecture | Data ProcessingMid-level Full TimeBengaluru, Karnataka, India13h ago
-
Data Engineer - Real Time Streaming INR 1800K-2500KApache Flink | Apache Kafka | CI/CD | Cloudera | Design PatternsMid-level Full TimeBengaluru, Karnataka, India13h ago
-
EDS-Senior Associate-Databricks INR 1431K-2000KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | Data GovernanceSenior-level Full TimeTrivandrum, KL, IN, 69558113h ago
-
Power BI Engineer INR 800K-1500KAzure Data | Azure Data Factory | Azure SQL | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeChennai, Tamil Nadu, India13h ago
-
Senior AI Application Engineer, Enterprise AI INR 2500K-4500KAWS Bedrock | Agile | Amazon Web Services | Azure | Azure OpenAIRelocation assistance providedSenior-level Full TimeIND19-01-Bengaluru-EPIP 122 (Phase II), India13h ago
-
EDS-Associate-PowerBI and SQL INR 2000K-3000KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | Data GovernanceMid-level Full TimeTrivandrum, KL, IN, 69558113h ago
-
Technology Engineer - Kafka & Streaming Platform INR 2000K-2245KAWS | Apache Kafka | Argo CD | Azure | CI/CDSenior-level Full TimeChennai, Tamil Nadu, India13h ago
-
Technology Engineer - Redis & Streaming Platforms INR 1837K-2000KAWS | Ansible | Apache Kafka | ArgoCD | AzureSenior-level Full TimeChennai, Tamil Nadu, India13h ago
-
Data Scientist INR 625K-831KAI | Classification | Clustering | Data Design | Data VisualizationTravel opportunitiesMid-level Full TimeChennai, TN, IN13h ago
-
Data Scientist INR 625K-831KAI | Classification | Clustering | Data Design | Data VisualizationTravel opportunityMid-level Full TimeChennai, TN, IN13h ago
-
Data Scientist INR 625K-831KBatch Processing | Classification | Clustering | Data Design | Data VisualizationTravel 25 percentMid-level Full TimeChennai, TN, IN13h ago
-
Data Scientist INR 625K-831KBatch Scoring | Classification | Clustering | Data Design | Data VisualizationTravel opportunitiesMid-level Full TimeChennai, TN, IN13h ago
-
Data Scientist INR 625K-831KBatch Scoring | Classification | Clustering | Data Design | Data VisualizationTravel opportunityMid-level Full TimeChennai, TN, IN13h ago