Data Engineer (PySpark)
Bengaluru, Karnataka, India
INR 1500K-2500K (estimate) Mid-level Full Time
Tasks
- Build and optimize data pipelines
- Contribute to continuous improvement in Agile environment
- Design and develop ETL pipelines
- Develop data solutions aligned with data models
- Ensure data quality, integrity, and consistency
- Gather data requirements
- Perform data profiling
- Perform impact analysis
- Perform unit testing
- Support deployments and production
- Use AI assisted tools for development efficiency
Perks/Benefits
- N/A
Skills/Tech-stack
AI Assisted Development | Data Mapping | Data Modeling | Data Warehousing | Data profiling | ELT | ETL | Informatica BDM | Informatica BDM Development | Performance Tuning | PySpark | SQL
Education
N/A
Roles
Related jobs
-
Senior-level Full TimeIN-KA-Bangalore12h ago
-
RAG + Agentic AI Engineer (India) (Remote) INR 2500K-3500KAccess Control | Agent Orchestration | Asynchronous programming | Auditability | BM25Growth opportunities | Ownership and autonomy | Remote workMid-level Full TimeMaharashtra, Pune, India R12h ago
-
Staff Engineer, Data Engineering INR 2400K-3100KAPIs | Airflow | Apache Kafka | Apache Spark | AzureSenior-level Full TimeBengaluru, KA, India12h ago
-
Mid-level Full TimeHyderabad, TS, IN; Bengaluru, KA, IN13h ago
-
Sr. Staff Engineer (Java Fullstack or Python, AI) INR 2475K-3500KAWS | Angular | Anthropic | Azure OpenAI | Bias MitigationFamily well-being benefits | Health benefits | Paid time off | Work-life balanceSenior-level Full TimeHyderabad, India13h ago
-
Business Intelligence Engineer INR 2000K-2900KAgile | Bitbucket | DAX | Data Governance | Data WarehousingFlexible hybrid work model | Health insurance | Life insurance | Paid time off | Pension/retirement benefitsMid-level Full TimeHyderabad, India R14h ago
-
Data Engineer INR 1000K-2100KApache Airflow | Apache Spark | Azure | CI/CD | DatabricksEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India14h ago
-
Mid-level Full TimeMaharashtra, Pune, India14h ago
-
Senior Software Engineer (Microsoft .NET/Azure cloud) INR 2829K-4000K.NET | API Management | APIM | Angular | App ServicesHealth insurance | Paid time off | Wellbeing benefits | Work-life balanceSenior-level Full TimeHyderabad, India15h ago
-
Lead Data Engineer - Data Modeler INR 1500K-2400KAmazon EC2 | Amazon EMR | Amazon RDS | Amazon Redshift | Amazon Web ServicesSenior-level Full TimePune, Maharashtra, India15h ago
-
Staff GenAI Engineer INR 2000K-3500KAWS | Agentic AI | Azure | CI/CD | Distributed SystemsCollaborative team environment | Leadership development programs | Training sessionsSenior-level Full TimeMumbai, MH, India16h ago
-
API Testing | Apache Airflow | Azure | CI/CD | DatabricksEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, India17h ago
-
Tech Manager- GTM Applied AI & Analytics INR 2000K-3380KAirflow | Apache Spark | Databricks | Fine Tuning | LangchainFlexible work schedule | Hybrid work scheduleSenior-level Full TimeBengaluru, KA, India17h ago
-
Software Test Engineer- Must have- ETL Testing, Pyspark, SQL, Good to have-playwright or selenium, databricks or snowflake INR 1632K-2156KAzure | Bitbucket | CI/CD | Databricks | DockerEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India17h ago
-
Consultant INR 1500K-2000KAPI Integration | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeCode review supportMid-level Full TimeBengaluru, Karnataka, India17h ago
-
AM - Cloud Data Engineer INR 1500K-2400KAWS Lake Formation | Apache Airflow | Apache Kafka | Apache Spark | Azure CosmosClient-facing consulting experience | Growth mindset | Professional development opportunitiesSenior-level Full TimePune, Maharashtra, India18h ago
-
Data Operation Engineer INR 2040K-3000KAsset bundles | Azure | Cloud platform | Confluence | DBTHybrid work arrangementMid-level Full TimeChennai, Tamil Nadu, India18h ago
-
Senior Data Engineer, Payments INR 3050K-4350KAWS Glue | Amazon Redshift | Apache Airflow | Apache Flink | Apache KafkaSenior-level Full TimeBangalore, India18h ago
-
AWS | Access Control | Apache Airflow | Azure | CI/CDAutonomy | Career growth | Inclusive culture | Learning and developmentSenior-level Full TimeIndia19h ago
-
Senior - AWS Data Engineering INR 3000K-4000KAWS | Data Integrity | Data Modeling | Data Validation | Data throughputSenior-level Full TimeBangalore, Karnataka, India19h ago
-
Senior Software Engineer (Python, Pyspark, Databricks, AWS, SQL) INR 2475K-2829KAWS | AWS Glue | AWS Lambda | Amazon EMR | Amazon S3Employee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India20h ago
-
Forward Deployed Engineer INR 2000K-3500KAI | APIs | Agent Orchestration | Agent-based | Agent-based AISenior-level Full TimeHyderabad, India23h ago
-
Senior AI Engineer (Search/Retrieval) INR 2000K-3465KAWS | Azure | BM25 | CI/CD | Citation AccuracySenior-level Full TimeHyderabad, India23h ago
-
Computer Scientist ( Java Backend ) INR 2500K-3500KApache Kafka | CI/CD | Docker | Event Driven | Event-driven architectureSenior-level Full TimeBangalore, India R1d ago
-
Computer Scientist 2 ( Data Engineering + AI ) INR 2475K-3465KAWS | Apache Spark | Azure | CI/CD | DatabricksSenior-level Full TimeNoida, India R1d ago