Pyspark Data Engineer
Tasks
- Build ETL ELT workflows for healthcare interoperability
- Create technical documentation and data mapping specifications
- Design data pipelines with PySpark
- Develop reusable ingestion and transformation frameworks
- Ensure data quality, integrity, security, compliance
- Monitor pipeline performance and optimize
- Transform and validate HL7 healthcare data
- Troubleshoot data processing issues
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Data Modeling | ELT | ETL | HL7 | PySpark | SQL
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Data Engineer INR 1500K-2500KAWS Cloud | AWS Cloud Development Kit | AWS Glue | AWS IAM | AWS LambdaMid-level Full TimeIN-TN-Chennai3h ago
-
Gen Ai INR 2000K-3000KAI Agents | AI Governance | AWS CodePipeline | Agent architecture | AuthenticationMid-level Full TimeIN-KA-Bangalore3h ago
-
Senior-level Full TimeIN-KA-Bangalore3h ago
-
API Testing | Allure | BDD | CI/CD | CucumberExecutive-level Full TimePune, India7h ago
-
GCP Data Engineer INR 1500K-2500KAPI Integration | BigQuery | Cloud platform | Data Governance | Data ModelingSenior-level Full TimeGurugram, Haryana, India8h ago
-
Senior Consultant_AWS Developer INR 1500K-3500KAWS Glue | AWS Lambda | AWS Step Functions | AWS Storage Gateway | AWS storageSenior-level Full TimeThane, IN, 40060411h ago
-
Applied AI ML Lead INR 3264K-5000KAI Libraries | API Development | AWS | Agentic AI | Agentic AI librariesSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Data Systems Software Engineer INR 1500K-3000KA/B | A/B Testing | API Versioning | API interoperability | AutomationLife insurance | Medical insurance | Retirement options | Volunteer programsSenior-level Full TimeBENGALURU, KARNATAKA, India13h ago
-
Mid-level Full TimePune, MH, IN, 41101414h ago
-
Lead Data Engineer/ Data Architect INR 2000K-2800KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeHyderabad, Telangana, India - Remote R16h ago
-
Mid-level Full TimeBangalore, KA, IN16h ago
-
Data Engineer INR 1500K-2500KData Analysis | Data Engineering | Data Management | Data Modeling | Data pipelineHybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India16h ago
-
Agile | Angular | Bash | CI/CD | Continuous integrationSenior-level Full TimeMumbai Goregaon, India16h ago
-
Sr Software Developer INR 2040K-2500KAWS | Angular | Apache Airflow | Apache Beam | AzureGuided career tracks | Health care benefits | Hybrid work model | Online learning platform | Paid time offSenior-level Full TimeIND-Trivandrum-Equifax Analytics-PEC, India16h ago
-
Custom Software Engineer INR 1300K-2000KAWS | Apache Airflow | Data Warehousing | Data integration | Data pipelineMid-level Full TimeBengaluru, BDC7A, India16h ago
-
Mid-level Full TimeBengaluru, BDC6F, India16h ago
-
Mid-level Full TimeBengaluru, BDC6F, India16h ago
-
Custom Software Engineer INR 1200K-2000KApache Spark | Clustering | Data Normalization | Data Transformation | Data VisualizationMid-level Full TimeCoimbatore, CODC1A, India16h ago
-
Custom Software Engineer INR 3375K-4000KCloud Data | Cloud Data Platforms | Data Engineering | Data Modeling | Data WarehouseSenior-level Full TimeBengaluru, BDC14A, India16h ago
-
Custom Software Engineer INR 1000K-1800KCloud Data | Cloud Data Platforms | Data Engineering | Data Modeling | Data PipelinesMid-level Full TimeBengaluru, BDC14A, India16h ago
-
Vice President, Data Quality Lead Engineer INR 4000K-5000KAPI Design | Anomaly Detection | Audit trails | CD | CIComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeM11 - Commers III, 43, 44 … R16h ago
-
Associate Director Machine Learning Engineer INR 1200K-2205KAWS Cloud | Computer Vision | Data Preprocessing | Deep learning | Distributed ComputingContinuous learning | Family-friendly perks | Flexible time off | Health care coverageMid-level Full TimeIN - GURUGRAM DLF DOWNTOWN BLOCK …16h ago
-
Lead Business Intelligence Engineer INR 3000K-4000KAI integration | BigQuery | Cloud platform | DBT | Data ModelingContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offSenior-level Full TimeIN - NOIDA CANDOR TECHSPACE SECTOR …16h ago
-
Data Engineer INR 1500K-2000KData Migration | Data Quality | Data Storage | Data Validation | Data pipelineOffshore shift coverage A and B | Work from office 5 days per weekMid-level Full TimeMumbai, MDC2B, India16h ago
-
Data Engineer INR 1500K-2000KCloud Storage | Data Pipelines | Data Quality | Data Validation | Data integrationMid-level Full TimeBengaluru, BDC9A, India16h ago