Data Engineer, Pyspark,VP
Bengaluru, India
INR 4000K-6000K (estimate) Executive-level Full Time
Tasks
- Build data pipelines
- Build scalable data architecture
- Design ETL solutions
- Develop data models
- Ensure regulatory compliance
- Implement data automation
- Implement data quality testing
- Ingest streaming data
- Mentor engineering team members
- Monitor model performance
- Optimize spark performance
- Perform data transformations
- Provide governance and reporting
- Source data using appropriate tools
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Agile | Apache Spark | Data Modeling | Data Quality | Data Quality Testing | Data Warehousing | ETL | PySpark | Quality testing | SQL | Spark optimization | Streaming
Education
N/A
Roles
Related jobs
-
Agentic AI | Agile | Artificial Intelligence | Docker | Generative AISenior-level ContractShaikpet, India2h ago
-
Senior AI Engineer / Data Scientist (Agentic AI) INR 2000K-5000KAI Search | AI Services | Agentic AI | Azure | Azure AISenior-level Full TimeChennai, India2h ago
-
GenAI Developer INR 1800K-4500KAPI Development | AWS | Azure | C++ | Cloud platformFull-time work | Work from OfficeSenior-level Full TimeIN-TN-Chennai2h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India3h ago
-
Amazon S3 | Apache Iceberg | Cloud Computing | Concurrency | Data ModelingCareer development | Health benefits | Paid time off | Remote work flexibilitySenior-level Full TimeHyderabad, India4h ago
-
Agile | Apache Airflow | Azure Data | Azure Data Factory | Azure DevOpsEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India4h ago
-
Mid-level Full TimeBangalore, Karnataka, IN5h ago
-
Senior AI Engineer INR 2500K-5000KAPI Design | Agile | Azure | Azure AI | Azure ArcHybrid work | On-call supportSenior-level Full TimeBangalore, Karnataka, IN5h ago
-
Sr. Data Engineer INR 2800K-4000KApache Airflow | Apache Spark | Batch Processing | CI/CD | Cloud ComposerSenior-level Full TimeGurgaon, Haryana, India7h ago
-
Senior Data Scientist INR 2000K-5000KAWS | Artificial neural networks | Azure | Chunking | Data StructuresSenior-level Full TimeBengaluru, Karnataka, India7h ago
-
Senior Data Engineer, BizTech INR 2940K-4170KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch Data ProcessingSenior-level Full TimeBangalore, India10h ago
-
Mid-level Full TimeGurgaon, HR, India10h ago
-
Software Engineer II INR 1500K-2500KAzure | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Mid-level Full TimeIndia, Telangana, Hyderabad11h ago
-
Senior Machine Learning Engineer - Recommendations INR 3000K-5000KA/B | A/B Testing | Airflow | Amazon EMR | Amazon S3Senior-level Full TimeBengaluru, India11h ago
-
Senior Data Engineer INR 3000K-4000KAWS | Airflow | Cloud platform | Data Modeling | Data TransformationCommuter benefits | Dental insurance | Financial wellness support | Health insurance | Life insuranceSenior-level Full TimeBengaluru, India11h ago
-
Assistant Manager-Adobe Analytics INR 1000K-1890KA/B | A/B Testing | AWS | Adobe Analysis Workspace | Adobe AnalyticsMid-level Full TimePune, IN15h ago
-
Senior-level Full TimeOff Embassy Golf Links Business Park, …15h ago
-
APIs | Agentic AI | Azure | Bagging | BoostingFlexibility programmes | Inclusive benefits | Mentorship | Work-life balance supportSenior-level Full TimePune, India15h ago
-
Lead Consultant - Snowflake and Cortex AI Engineer INR 4000K-5000KAlerting | Audit Logging | Azure DevOps | CI/CD | Contract testingSenior-level Full TimeIndia - Bangalore15h ago
-
Sr Technical Lead-Azure Data Engineer INR 1500K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - BENGALURU - HP, IN15h ago
-
Data Engineer (AWS, Azure & Microsoft Copilot Studio) INR 3200K-4720KAI Foundry | AWS Bedrock | AWS Glue | AWS Identity | AWS Identity and Access ManagementHealthcare life sciences industry focus | Remote workSenior-level Full TimeBangalore, KA, IN15h ago
-
Senior Data Engineer II INR 3715K-5000KAPI Integration | Amazon Web Services | Apache Spark | Azure | Data GovernanceEmployee assistance program | Employee share plan | Flexible work arrangements | Generous holidays | Professional mentoringSenior-level Full TimeHyderabad, IN15h ago
-
Data Engineer (AWS, Azure & Microsoft Copilot Studio) INR 3200K-4580KAWS Glue | AWS Identity | AWS Identity and Access Management | AWS Lambda | Access ManagementSenior-level Full TimeBangalore, KA, IN15h ago
-
Sr Technical Lead-Azure Data Engineer INR 1500K-2800KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - BENGALURU - HP, IN15h ago
-
Azure Databricks Lead INR 2000K-2800KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …15h ago